- Letter to the Editor
- Open Access
A computerized expert system for diagnosing primary headache based on International Classification of Headache Disorder (ICHD-II)
SpringerPlus volume 2, Article number: 199 (2013)
The authors developed a computerized program designed to diagnose primary headache based on international classification of headache disorders, 2nd edition (ICHD-II) criteria for use by physicians.
An appropriate questionnaire was designed according to the ICHD-II criteria for all types of primary headaches and the computerized system provided diagnosis based on the criteria. The software was tested by analyzing 80 patients, recruited from an outpatient headache clinic, affected by primary headache. Each patient with a unique card number was interviewed up to 15 minutes. At the end of each day, software and neurologist diagnoses were evaluated for each patient.
Of 80 patients, the software was able to come up with correct results in 78 cases. The age of the patients ranged from 30 to 80 years old. Migraine headache accounted for 71 cases, five patients had tension type headache, and 2 had cluster headaches; all were correctly diagnosed by software. Two cases were not concordant with the neurologist’s diagnosis. The neurologist diagnosed these two cases as “Medical overuse syndrome headache” and “cluster headache”, which our software was not able to diagnosis them.
This software permitted the diagnosis of more than 97% of the patients similar to the physician's. We hope this questionnaire and applying the software to diagnose headache based on ICHD could be of help to better the diagnosis of headaches.
Headache is one of the most common complaints during life (Stang & Osterhaus 1993). During one year, 90% of people suffer from headaches, and over 10% have at least one migraine headache (Schwartz et al. 1998).
Although considerable advances are seen in the therapy of headache, it still remains underdiagnosed (Lipton et al. 2001). In the clinical setting, there are no possible imaging or laboratory tools to diagnose different types of primary headaches. However, the recently revised diagnostic criteria of International Classification of Headache Disorders, 2nd edition (ICHD-II) are the best available criteria to precisely diagnose the type of headache (2nd Edition of The International Headache Classification (ICHD-2) 2004. However, it is complicated for practitioners to memorize all ICHD-II criteria for the diagnosis of headaches which is about 150 pages long. On the other hand, the workload of practitioners obliges them to minimize the length of visits, therefore, making it often impossible to take a complete history and diagnose the headache as it should be in which case as a result, limits the quality of therapeutic choices.
For this reason, we developed a computerized program designed for use by physicians in populated headache clinics. This easy-to-use system provides an assisted diagnosis according to ICHD-II criteria for all types of primary headaches including migraine, tension-type headache, cluster headache and other trigeminal autonomic cephalalgias, as well as other primary headaches which are overall 61 types. Similar to other computerized programs (De Simone et al. 2007), this software can be used by operators with basic computer experience without increasing the time length of visits.
The software has 5 main parts including the descriptive page, disclaimer page, patient’s registration page, headache questions, and the final decision with the explanation of it, which are all prepared in Persian language (Additional file 1). The disclaimer page emphasizes that this software is made to facilitate and increase the accuracy of diagnosis.
The criteria were extracted from primary headaches. Then, based on these criteria, questions were designed to approach all these criteria. Questions would be asked based on responses, which take between 5 to 15 minutes depending on the answers. For example, if the patient has visual problem during a headache attack, further questions such as the association of headache with scotoma, flickering, scintillation, visual loss, diplopia, and bilateral/unilateral visual disturbances, and also the maximum duration of these symptoms would be asked. The system will get into conclusion based on all criteria of ICHD-II and explain how headache was approached and possible diagnosis was made.
An essential feature of the program is to report “No diagnosis was made based on these data”, which can also find certain unclassifiable headaches.
Furthermore, all demographic information and characteristics of the patients' headache, previously inserted in the program, are saved, allowing the creation of a complete database in Access software which would be an invaluable tool for more headache researches such as further modifications of ICHD-II.
Another feature of this software is that each patient has a profile, which can be updated at each successive follow-up. The profile is accessible to record the diagnosis, the recommended therapy and any further comments. Those who help the patient to answer the questions should not necessarily know the whole terminology of the words, since each terminology is simply explained by informative notes and explanations indicated by moving the pointer of the mouse over it.
Evaluating the software
We conducted a validation field-test to approve the accuracy of the software. In all, 95 consecutive patients were enrolled in our study from October to December 2012. Of them, 80 patients with primary headache were evaluated. The patients were recruited from an outpatient headache clinic, affiliated to Tehran University of Medical Sciences. By entering the study, each patient received a card with a unique number on it. The patients were primarily interviewed by the researchers. Each interview lasted up to 15 minutes. The data were collected from patients to fulfill the software’s entry. The questions were instructed based on ICHD-II. The software output described the proposed diagnosis. The software’s diagnosis was recorded for the card number each patient had. Next, in the same visit, the patients were interviewed by a neurologist in another room. The neurologist and the researcher were not aware of each others’ diagnosis. The patient was not informed of the software output either. The neurologists’ final diagnosis was separately recorded for the card number each patient had. The neurologist was asked to define the final first-ranked diagnosis by choices in concordance with ICHD-II classification. At the end of each day, software and neurologist diagnoses were evaluated for each patient.
The approval of local research ethics committee of Tehran University of Medical Sciences and verbal consents from all patients were obtained before any evaluation. The patients were informed that no-participation would in no way affect their care.
A total of 80 patients, over 18 years of age, were included in the study. Female patients outnumbered male patients (female patients n = 62). The age of patients ranged from 30 to 80 years old. The software was able to come up with correct results in 78 out of 80 cases. Migraine headache accounted for 71 cases, five patients had tension type headache, and 2 had cluster headaches; all were correctly diagnosed by software. Two cases were not concordant with the neurologist’s diagnosis. The neurologist diagnosed these two cases as “Medical overuse syndrome headache” and “cluster headache”, which our software was not able to diagnosis them.
This computerized system uses simple human-like algorithmic logic to determine the most appropriate type of headache. However, similar to other medical software, the accuracy of diagnosis depends on the accuracy of patient responses. Also, the interviewer has an invaluable role to obtain accurate responses in comparison with a computer program.
In our evaluation, 2 patients had different diagnoses by the computer and the physician. The reason was inaccurate and different responses of these 2 patients to the interviewer and physician. Different computerized headache programs are designed for use by general practitioners (Mainardi et al. 2005) to neurologists (Sarchielli et al. 2005). Maizel et al. (2008), in their study using a computerized headache assessment tool, correctly identified 100% of the patients with episodic migraine and 85.7% with transformed migraine. Also, it correctly categorized all patients with tension-type headache, and cluster headache. Sarchielli et al. (2007), in their study using a computerized system, permitted correct diagnosis in 78% of 200 headache patients.
As these criteria are under change over time (Olesen 2011; Bigal et al. 2007; Olesen 2006), we hope that applying the software to diagnose headache based on ICHD could be of help for modifying the current diagnostic criteria, finding the answer to issues which need to be studied more in the ICHD-II guideline. However, in a clinical practice, we face a large number of patients who do not qualify for any defined criteria. As an example, a few criteria include a response to a particular drug. A marked overlap exists among criteria. On the other hand, the patients cannot fit their responses to the algorithm that any software undertakes. These all should be addressed before considering such type of design. Yet still, an expert neurologists’ diagnosis is the standard for comparing such software. For the same purpose, we conducted our validation survey in the neurologist’s clinic. However, this may result in further limitations. Many of the patients in such clinics are referred from other clinics due to the complicated nature of their headache or inconclusive diagnosis. They may have received different medications which might have altered the pattern of their headache, as well. For instance, one would have had one sided throbbing headache in the beginning, but recently has experienced both sided compression-like headache. Yet though, the software needs a definite input. We used the primary pattern of the headache as the input. Without the precise import of the specified inputs, the software would come up with a number of diagnoses including different types of headache. However, an expert neurologist can handle such situations through history taking and proper weighting of differential diagnoses. Also, patient’s willingness to cooperate and trust this method is another limitation to be mentioned. Finally, we recommend using such software to promote diagnosis in settings like general day clinics instead of sub-specialized neurology clinics.
2nd Edition of The International Headache Classification (ICHD-2) 2004.http://ihs-classification.org/en/ Available at: . Accessed 01_15_13
Bigal ME, Rapoport AM, Sheftell FD, Tepper SJ, Lipton RB: The International Classification of Headache Disorders revised criteria for chronic migraine-field testing in a headache specialty clinic. Cephalalgia 2007, 27(3):230-234. 10.1111/j.1468-2982.2006.01274.x
De Simone R, Coppola G, Ranieri A, Bussone G, Cortelli P, D’Amico D, D’Onofrio F, Manzoni GC, Marano E, Perini F, Torelli P, Beneduce L, Ciccarelli G, Mea E, Penza P, Ripa P, Sancisi E, Bonavita V: Validation of AIDA Cefalee, a computer-assisted diagnosis database for the management of headache patients. Neurol Sci 2007, 28(Suppl 2):S213-S216. 10.1007/s10072-007-0779-z
Lipton RB, Diamond S, Reed M, Diamond ML, Stewart WF: Migraine diagnosis and treatment: results from the American migraine study II. Headache 2001, 41(7):638-645. 10.1046/j.1526-4610.2001.041007638.x
Mainardi F, Maggioni F, Dainese F, Zanchin G: Development of a ICHD-II based computerised system for the general practitioner. J Headache Pain 2005, 6(4):211-212. 10.1007/s10194-005-0187-9
Maizels M, Wolfe WJ: An expert system for headache diagnosis: the Computerized Headache Assessment tool (CHAT). Headache 2008, 48(1):72-78. 10.1111/j.1526-4610.2007.00918.x
Olesen J: International Classification of Headache Disorders, Second Edition (ICHD-2): current status and future revisions. Cephalalgia 2006, 26(12):1409-1410. 10.1111/j.1468-2982.2006.01214.x
Olesen J: New plans for headache classification: ICHD-3. Cephalalgia 2011, 31(1):4-5. 10.1177/0333102410375628
Sarchielli P, Pedini M, Alberti A, Rossi C, Baldi A, Corbelli I, Calabresi P: Application of ICHD 2nd edition criteria for primary headaches with the aid of a computerised, structured medical record for the specialist. J Headache Pain 2005, 6(4):205-210. 10.1007/s10194-005-0186-x
Sarchielli P, Pedini M, Coppola F, Rossi C, Baldi A, Corbelli I, Mancini ML, Calabresi P: Application of the ICHD-II criteria to the diagnosis of primary chronic headaches via a computerized structured record. Headache 2007, 47(1):38-44. 10.1111/j.1526-4610.2007.00651.x
Schwartz BS, Stewart WF, Simon D, Lipton RB: Epidemiology of tension-type headache. JAMA 1998, 279(5):381-383. 10.1001/jama.279.5.381
Stang PE, Osterhaus JT: Impact of migraine in the United States: data from the National Health Interview Survey. Headache 1993, 33(1):29-35. 10.1111/j.1526-4610.1993.hed3301029.x
The authors thank Dr. Faeze Dehghan (occupationalist at Aja university of Medical Sciences) for her helpful comments, also Mrs. Bita Pourmand (Sina Hospital, Research Development Center) for her careful editing of the manuscript.
The designing of the software was supported by the AJA University of Medical Sciences, Tehran, Iran [grant number 990158].
The authors declare that they have no competing interests.
VE was the designer of this software. He developed the first idea. Also, he partially drafted the manuscript and performed submission and final approval of the article. He performed parts of the data analysis. SR-E was the software developer. He managed the operation of the software. He performed transferring of the database from access to the SPSS and other data analysis as well as upgrading the system and translating to English. Also, he partially drafted the manuscript and performed submission and final approval of the article. NH-N cooperated in the evaluation of the software and managing 80 patients. He participated in software analysis as well as finding the bugs of the system. He also had role on changing the article from letter to original article. Also, he partially drafted the manuscript and performed submission and final approval of the article. FR participated in evaluation of the software on more than 80 patients. Also, he partially drafted the manuscript and performed submission and final approval of the article. He performed the literature review and changing the article format from letter to original article. SA participated in the software designation. Developing the first idea and also solving problems using ICHD-II criteria. Also, he partially drafted the manuscript and performed submission and final approval of the article. MT was the leader of the team, managed the patients for software evaluation, visited the patients in the clinic and diagnosed them, as well as, parts of design of the study. Also, she partially drafted the manuscript. She performed submission and final approval of the article. All authors read and approved the final manuscript.