This article has Open Peer Review reports available.
Clinical coding of prospectively identified paediatric adverse drug reactions – a retrospective review of patient records
© Bellis et al.; licensee BioMed Central. 2014
Received: 21 August 2014
Accepted: 12 December 2014
Published: 17 December 2014
National Health Service (NHS) hospitals in the UK use a system of coding for patient episodes. The coding system used is the International Classification of Disease (ICD-10). There are ICD-10 codes which may be associated with adverse drug reactions (ADRs) and there is a possibility of using these codes for ADR surveillance. This study aimed to determine whether ADRs prospectively identified in children admitted to a paediatric hospital were coded appropriately using ICD-10.
The electronic admission abstract for each patient with at least one ADR was reviewed. A record was made of whether the ADR(s) had been coded using ICD-10.
Of 241 ADRs, 76 (31.5%) were coded using at least one ICD-10 ADR code. Of the oncology ADRs, 70/115 (61%) were coded using an ICD-10 ADR code compared with 6/126 (4.8%) non-oncology ADRs (difference in proportions 56%, 95% CI 46.2% to 65.8%; p < 0.001).
The majority of ADRs detected in a prospective study at a paediatric centre would not have been identified if the study had relied on ICD-10 codes as a single means of detection. Data derived from administrative healthcare databases are not reliable for identifying ADRs by themselves, but may complement other methods of detection.
National Health Service (NHS) hospitals in the UK use a system of coding alongside the length of hospital stay to determine the chargeable cost of care for each patient. The coding system used is the International Classification of Disease (ICD-10). The process of coding is by case note review, undertaken by trained coders. It relies on diagnoses, procedures and other events being written down by the clinical team caring for the patient. The data are submitted to become part of the national hospital episode statistics (HES) for the NHS in England and are used for research and planning.
There are ICD-10 codes which may be associated with adverse drug reactions (ADRs). Although these codes can also be associated with overdose and medication errors, there is a possibility of using ICD-10 codes for ADR surveillance. Previous studies in the adult population have identified ADRs or ADEs either by retrospective case note review or by prospective monitoring, and then reviewed the ICD-10 codes for these cases; these studies showed that, in the majority of cases, ADRs and ADEs had not been coded properly [1–3]. Other studies have used ICD-10 codes to determine ADR or ADE incidence followed by a review of the case note record to confirm the accuracy of the code. This method can identify false positives but does not allow the investigator to estimate how many ADRs have been missed by using ICD codes for their identification [4–7]. A previous paediatric study identified ADR cases by searching for the relevant ICD codes and compared these with spontaneously reported cases. They found that not all ADRs were identified by both methods and concluded that neither method in isolation was reliable for ADR surveillance .
In this study, we aimed to determine whether prospectively identified ADRs in a paediatric population could have been detected via review of ICD-10 codes.
The electronic records of children in whom a total of 241 ADRs had been prospectively identified in an earlier study, were reviewed. The aim was to determine whether an ICD-10 code related to the ADR had subsequently been added to their electronic admission abstract.
The methodology of the prospective study in which the 241 ADRs were initially detected has been described previously , here a brief summary is provided. The study duration was 12 months (2008–2009) and the participants were children admitted to a paediatric tertiary referral centre (Alder Hey Children’s NHS Foundation Trust). A prospective review of each unplanned admission was undertaken by a member of a multi-disciplinary research team which comprised a paediatrician, a paediatric nurse and a pharmacist. The total number of reviews undertaken by each team member and the types of patients in each caseload were similar. The research team reviewed medication taken in the two weeks prior to admission alongside the reason for admission to determine whether the admission was partly or entirely related to an ADR. The severity, causality and avoidability of each suspected ADR were subsequently evaluated by the research team. The records of the patients identified in this study as having experienced an ADR were examined in order to undertake the retrospective study described below.
For each ADR, the following information was obtained from the prospective study dataset to meet the specific objectives of this retrospective study: patient identification, suspected drug(s), ADR description (usually a symptom), ADR type, severity and causality. ADR type was defined as either Type A (augmented) resulting from an exaggeration of a drug’s normal pharmacological actions or Type B (bizarre) which are novel responses that are not expected from the known pharmacological actions of the drug . ADR severity was classified according to an adaptation of the Hartwig scale ; 1 - No change in treatment with suspected drug, 2 - Drug dosing or frequency changed, without antidote or treatment, 3 - Required treatment, or drug administration discontinued, 4 - Resulted in patient transfer to higher level of care, 5 - Caused permanent harm or significant haemodynamic instability, 6 - Directly or indirectly resulted in patient death. ADR causality was assessed using the Liverpool Causality Assessment Tool (LCAT) and the outcome could be unlikely, possible, probable or definite .
The electronic admission abstract for each patient identified through the earlier prospective study as having experienced at least one ADR was examined and a record was made of whether the ADR(s) and/or their signs and symptoms had been coded using ICD-10 and if so, which code(s) had been used.
ICD-10 codes which may apply to adverse drug events or adverse drug reactions
Other systemic anti-infectives/antiparasitics
Hormones (including synthetic, antagonists)
Primarily systemic agents
Agents primarily affecting blood constituents
Sedatives, hypnotics, antianxiety drugs
Anaesthetics, therapeutic gases
Drugs affecting autonomic nervous system
Agents primarily affecting cardiovascular system
Agents primarily affecting gastrointestinal system
Agents affecting water/mineral balance/uric acid
Agents affecting muscle/respiratory system
Topical agents affecting skin, ENT, dental
Other and unspecified medicaments
A Chi-square test for difference in proportions was used to determine whether there were any differences in the characteristics of coded and uncoded ADRs.
This study used routinely collected clinical data in an anonymized format. The Chair of the Liverpool Paediatric LREC informed us that this study did not require individual patient consent or review by an Ethics Committee.
ADRs coded using ICD-10 ordered by reaction frequency (n = 76, two reactions had two codes)
Description of reaction (s)
ICD -10 code
Number of reactions
ADRs secondary to chemotherapy: neutropenia, anaemia, thrombocytopenia, immunosuppression, deranged liver function tests, mouth ulcers, nausea, vomiting, diarrhoea, back pain, fever, deranged renal function
Y43.3 Other antineoplastic drugs
Rash secondary to penicillin
Vomiting secondary to penicillin
Hyperglycaemia secondary to dexamethasone
Y42.7 Androgens and anabolic congeners
Anaemia, immunosuppression, thrombocytopenia, neutropenia
Z51.2 Other chemotherapy
Hypoglycaemia secondary to insulin
E16.0 Drug induced hypoglycaemia without coma
Irritability following pneumococcal and DTP vaccines
T88.1 Other complications following immunization
Irritability following pneumococcal and DTP vaccines
Y59.9 Vaccine or biological substance, unspecified
A large proportion of ADRs in the prospective study  occurred in patients under the care of the oncologists; we refer to these as oncology ADRs and to the remaining ADRs as non-oncology. There were 126 non-oncology ADRs and 115 oncology ADRs. Of the 126 non-oncology ADRs, 6 (4.8%) were coded using an ICD-10 ADR code. Of the 115 oncology reactions, 70 (61%) were coded using an ICD-10 ADR code (difference in proportions 56%, 95% CI (46.2% to 65.8%); p < 0.001). Without exception, the code ‘Y43.3 other antineoplastic drugs’ was used to indicate adverse effects which had occurred secondary to the therapeutic use of oncology drugs.
The signs and symptoms of 212/241 (88%) ADRs were acknowledged by ICD-10 sign and symptom code(s). These 212 ADRs cases were made up of 107 oncology cases of which 70 also had an ADR code and 104 non-oncology cases of which 4 also had an ADR code. There were a variety of ICD-10 codes used for the same reaction type (Additional file 1: Table S1). There were 20/126 (15.9%) non-oncology ADRs and 8/115 (7.0%) oncology ADRs not acknowledged by either an ICD-10 ADR code or an ICD-10 sign and symptom code.
Considering oncology and non-oncology reactions together, coded ADRs were not more likely to be type A than type B reactions (difference in proportions 3%, 95% CI: -3.0% to 8.9%, p = 0.26). Coded ADRs were not more likely to be of severity 1, 2 and 3 than those of severity 4 and 5 (difference in proportions 6%, 95% CI -0.1% to 11.9%, p = 0.07). Finally, coded ADRs were more likely to be definite and probable ADRs than possible ADRs (difference in proportions 47%, 95% CI 32.3% to 59.7%; p < 0.001).
This retrospective study of electronic patient records demonstrates that the majority of ADRs detected in a prospective cohort study at a paediatric tertiary care centre would not have been identified if the study had relied on ICD-10 codes as a single means of detection. The use of ICD10 ADR codes was infrequent. The use of ICD-10 sign and symptom codes was more frequent but a wide variety of codes were used for the same ADR type. When undertaking research which uses data derived from administrative healthcare databases it is essential to first consider the reliability of those data.
The limitations of this study relate to those of the prospective cohort study in which the ADR cases were identified. The recording of a medication history for each participant relied on parents and/or patients recalling and communicating accurately all medicines administered prior to admission. Clearly there was scope for errors and omissions in this process. The detection of suspected ADRs by the study team relied on two things: a) signs and symptoms associated with the ADR being recorded by the clinical team looking after the patient; and b) the study team suspecting a link between signs and symptoms recorded and the medicines administered before admission. Where signs and symptoms were not recorded or the study team missed the link, the ADR was not highlighted and an evaluation of how it had been coded could not be undertaken.
In previous studies of ICD-10 coding for ADRs and ADEs in the adult population, the reported rate of coding was 2.0-6.8% [1, 2]. Here, a higher rate of ICD-10 codes being used to record ADRs (31.5%) was found. This can be explained by the high proportion of oncology ADRs that were coded using an ICD-10 ADR code. The two main reasons for this were: a) the oncology unit was using a structured admission proforma for unplanned admissions presenting with febrile neutropenia (one of the most common ADRs in this study); this proforma was also used to record details of other drug-related problems and b) there were specifically trained, non-clinical, coding staff assigned to the oncology unit. If we consider the non-oncology ADRs only, the rate of ADR coding (4.8%) is more comparable to that in adult studies.
As a result of the system by which coding is undertaken, there are reasons why ADRs may not be coded using an ICD-10 ADR code. An ADR cannot be coded if it is not identified and subsequently recorded by the clinical team; this relies on many factors including the ability of the clinical team to identify an ADR and record it as such. It is interesting to note that ADRs which were classified as probable or definite in this study were more likely to have been coded using an appropriate ICD-10 ADR code. This suggests that a more confident causality assessment by the clinician is more likely to lead to a case-note entry which is picked up by coders.
Many ADRs which were not coded using an ICD-10 ADR code had their signs and symptoms coded (Additional file 1: Table S1). The ICD-10 sign and symptom codes for each reaction were recorded to explore whether any of these codes were commonly being used for ADR cases and if so, whether they could provide an additional means of ADR detection. However, there was inconsistency in coding. For example, amongst the non-oncology ADRs, 15 different ICD-10 codes were associated with 18 cases of immunosuppression. The diversity of sign and symptom codes used would have limited their usefulness for the detection of ADRs in our cohort of patients.
In summary, the use of ICD-10 codes to identify ADRs leading to admission at a paediatric tertiary care centre is not currently a reliable method of pharmacovigilance but may complement other approaches. A standardised approach to the use of administrative healthcare data for the identification of adverse drug events has the potential to improve the reliability of this method .
This report presents independent research funded by the National Institute for Health Research (NIHR) under its Programme Grants for Applied Research scheme (RP-PG-0606-1170). The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the DH.
- Juntti-Patinen L, Kuitunen T, Pere P, Neuvonen PJ: Drug-related visits to a district hospital emergency room. Basic Clin Pharmacol Toxicol. 2006, 98: 212-217. 10.1111/j.1742-7843.2006.pto_264.x.View ArticlePubMedGoogle Scholar
- Brvar M, Fokter N, Bunc M, Mozina M: The frequency of adverse drug reaction related admissions according to method of detection, admission urgency and medical department specialty. BMC ClinPharmacol. 2009, 9 (8): doi:10.1186/1472-6904-9-8Google Scholar
- Hohl C, Kuramoto L, Yu E, Rogula B, Stausberg J, Sobolev B: Evaluating adverse drug event reporting in administrative data from emergency departments: a validation study. BMC Health Serv Res. 2013, 13: 473-10.1186/1472-6963-13-473.View ArticlePubMedPubMed CentralGoogle Scholar
- Schlienger RG, Oh PI, Knowles SR, Shear NH: Quantifying the costs of serious adverse drug reactions to antiepileptic drugs. Epilepsia. 1998, 39 (Suppl 7): S27-S32.View ArticlePubMedGoogle Scholar
- Backstrom M, Mjorndal T, Dahlqvist R: Under-reporting of serious adverse drug reactions in Sweden. Pharmacoepidemiol Drug Saf. 2004, 13: 483-487. 10.1002/pds.962.View ArticlePubMedGoogle Scholar
- Hougland P, Xu W, Pickard S, Masheter C, Williams SD: Performance of international classification of diseases, 9th revision, clinical modification codes as an adverse drug event surveillance system. Med Care. 2006, 44: 629-636. 10.1097/01.mlr.0000215859.06051.77.View ArticlePubMedGoogle Scholar
- Hodgkinson MR, Dirnbauer NJ, Larmour I: Identification of adverse drug reactions using the ICD-10 Australian modification clinical coding surveillance. J Pharm Prac Res. 2009, 39: 19-23.View ArticleGoogle Scholar
- Batz A, Bondon-Guitton E, Durrieu G, Lapeyre-Mestre M, Petiot D, Montastruc J: Using PMSI database to identify adverse drug reactions in a pediatric university hospital. Fundamental Clin Pharmacol. 2011, 25: 65-Google Scholar
- Gallagher RM, Mason JR, Bird KA, Kirkham JJ, Peak M, Williamson PR, Nunn AJ, Turner MA, Pirmohamed M, Smyth RL: Adverse drug reactions causing admission to a paediatric hospital. PLoS One. 2012, 7: e50127-10.1371/journal.pone.0050127.View ArticlePubMedPubMed CentralGoogle Scholar
- Rawlins MD, Thompson JW: Pathogenesis of adverse drug reactions. Textbook of adverse drug reactions. Edited by: Davies DM. 1977, Oxford: Oxford University PressGoogle Scholar
- Hartwig SC, Siegel J, Schneider PJ: Preventability and severity assessment in reporting adverse drug reactions. Am J Hosp Pharm. 1992, 49: 2229-2232.PubMedGoogle Scholar
- Gallagher RM, Kirkham JJ, Mason JR, Bird KA, Williamson PR, Nunn AJ, Turner MA, Smyth RL, Pirmohamed M: Development and inter-rater reliability of the Liverpool adverse drug reaction causality assessment tool. PLoS One. 2011, 6: e28096-10.1371/journal.pone.0028096.View ArticlePubMedPubMed CentralGoogle Scholar
- International statistical classification of diseases and related health problems 10th revision.http://apps.who.int/classifications/icd10/browse/2008/en,
- Hohl CM, Karpov A, Reddekopp L, Stausberg J: ICD-10 codes used to identify adverse drug events in administrative data: a systematic review. J Am Med Inform Assoc. 2014, 21: 547-557. 10.1136/amiajnl-2013-002116.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/2050-6511/15/72/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.