Journal of Pediatric Psychology, Vol. 28, No. 5, 2003, pp. 355-361
© 2003 Society of Pediatric Psychology
The Reliability of Reports of Medical Adherence From Children With HIV and Their Adult Caregivers
1 New York State Psychiatric Institute, 2 Columbia University
All correspondence should be sent to Curtis Dolezal, New York State Psychiatric Institute, 1051 Riverside Drive, Unit # 15, New York, New York 10032. E-mail: dolezalc{at}childpsych.columbia.edu.
| Abstract |
|---|
|
|
|---|
Objective To compare children's reports of their medication adherence to those of their adult caregivers. Method Several indicators of medication adherence were assessed for 48 adult-child dyads. Kappa statistics were calculated as measures of agreement. Results Adherence problems were common, although the level of agreement between the child and the adult was quite low (kappas for adherence variables ranged from .05 to .32). Compared to adult-child dyads that agreed, dyads that disagreed tended to include older children who had more responsibility for managing their own medications. Conclusions Both researchers and clinicians would benefit from acquiring information on children's adherence from multiple sources.
Key words: HIV; medication adherence; pediatric AIDS; adherence reliability.
| Introduction |
|---|
|
|
|---|
The introduction of antiretroviral therapy has resulted in a significant decrease in morbidity and mortality in the pediatric AIDS population (Abrams et al., 2001
Many factors make attaining high levels of adherence a challenge: multiple
medications, high pill burden, poor palatability, side effects, long-term
toxicities, issues of disclosure, and simple forgetfulness. Across other
chronic medical conditions, 40%-50% of adults and children typically do not
use medications as prescribed (Ley,
1988
; Matsui,
2000
; Quittner, Espelage,
Ievers-Landis, & Drotar, 2000
). Although the literature is
limited, the few studies of HIV-infected children's adherence to
antiretroviral medication indicate that nonadherence is a problem
(Albano, Spagnuolo, Canani, & Guarino,
1999
; Falkenberg,
1999
; Martinez et al.,
2000
; Van Dyke et al.,
2002
; Weidle et al.,
1998
). Furthermore, the majority of children born with HIV disease
are living in chronic poverty with limited resources and are affected by
discrimination, family disruption and substance abuse, and inner-city
stressors (Havens, Mellins, & Hunter,
2002
), all of which can impair the families' ability to manage the
children's illness, including the proper administration of medications.
One major barrier to measuring and ultimately improving adherence is the
lack of any gold standard for measuring this behavior. A number of measurement
strategies exist, including pill counts, electronic monitors, diaries, and
interviewer-administered or self-report questionnaires
(Chesney, Ickovicks, et al.,
2000
; Drotar,
2000
; Matsui,
2000
). Each of these methods has limitations and can provide
different estimates of adherence (La Greca
& Schuman, 1995
; Rapoff,
1999
; Steele et al., 2001).
The limitations of these strategies can be even more pronounced with
children. For example, regarding pill counts, many children have difficulties
swallowing pills and require liquid medication (if available). Electronic
monitors, or MEMS caps (Medication Event Monitoring Systems; also known as
eDEM caps: electronic Drug Exposure Monitors), which record each time a pill
bottle has been opened, are not currently practical with liquid medications.
Furthermore, they overestimate adherence problems when patients prefill pill
boxes. As a result, self-reports are commonly used in most research studies
and clinical work. However, accurate measurement of adherence remains a
challenge. Younger children are typically given their medications by a parent
or other family member and may not even know their medication regimen or even
their illness diagnosis (Mellins,
Brackis-Cott, Dolezal, & Abrams, 2002
). As children get older,
they may assume more responsibility for taking their own medications and, in
the transition, the role of the adult caregiver changes. Rather than
administering all of the medications, the adult might simply remind the child
to take her or his medicine, check medications to determine whether the child
has taken them, or continue to administer some, but not all, of the
medications. Other people may be involved in the process: other family
members, babysitters, home health aids, school nurses. In these situations
several people may have different information, and it is not clear who, if
anyone, is the most accurate reporter.
Given the complicated nature of the issue, collecting information on
adherence from multiple sources has been recommended
(Matsui, 2000
), at a minimum,
from the child and from his or her primary adult caregiver. However, the mixed
responsibility for administering the medications, limited child knowledge of
the regimen or even HIV diagnosis, the changing developmental stage of the
child, and the issue of social desirability (some adults and children may feel
social pressure and be reluctant to admit to nonadherence) may result in poor
concordance between children and adults in their reports of adherence. To
understand more about the quality of self-reported adherence in children
infected with HIV disease, we devised this study to examine medication
adherence in children with HIV and to assess the level of agreement between
reports of adherence from the children and their adult caregivers. In light of
the multiple challenges, we hypothesized that concordance would be difficult
to establish and that agreement between the adults' and the children's reports
would be low.
| Method |
|---|
|
|
|---|
Research Participants
Participants included families recruited from two pediatric HIV programs in northern Manhattan in 2000. Families were eligible if (1) the child had a confirmed diagnosis of HIV infection; (2) the primary caregiver was a birth parent, relative, or adoptive caregiver; (3) the child and his or her primary caregiver spoke English or Spanish; and (4) the child was between the ages of 3 and 13 years. Overall, we were able to interview 90% (77/86) of eligible families who were approached (96 children were eligible from both clinics; 10 were not approached because we had achieved our target sample size). Among the nine approached families who did not participate, six guardians refused and three guardians were too ill at the time. As a result, 77 families participated in the study. Interviews were conducted with all primary caregivers (n = 77) and children who were 7 years of age or older (n = 50).
For these analyses, we included participants for whom there were both child and caregiver reports of adherence to antiretroviral medications (n = 48). There were 27 families who were excluded because the child was not interviewed (too young). Among the 50 children who were interviewed, 2 were not taking antiretroviral medications; thus, adherence data were not available. As a result, data are available on a total of 48 caregiver-child dyads. These 48 families did not differ from the other dyads in demographic characteristics, other than child age. Children did not need to know their HIV diagnosis to participate. Informed consent was obtained from each adult, and each child gave assent. The study received local institutional review board approval.
Measures
Demographics and Medical Data. Demographic variables included
child and caregiver gender, age, and ethnicity; caregiver relationship to the
child (biological or adoptive parent, other relative); and caregiver HIV
status. Also available from the child's medical charts were CD4+ cell count
and percent, HIV RNA viral load, and CDC AIDS diagnosis. The determination of
whether the child knew her or his HIV+ status was based on the caregiver's
report. Child's Adherence to Antiretroviral Medication. First, were
medications missed, off schedule, or only partially administered in the past 2
days? For the caregiver interview, we modified a self-report procedure used by
the Adult AIDS Clinical Trials Group (AACTG)
(Chesney, Ickovics, et al.,
2000
) and more recently by the Pediatric AIDS Clinical Trials
Group (PACT-G; Van Dyke et al.,
2002
). This instrument is based on previous research on adherence
to medication regimens in clinical trials
(Besch, 1955
;
Urguhart, 1991
), and
significant correlations between self-reported medication use on the AACTG
measure and participant viral load have been found
(Mannerheimer, Friedland, Matts, Child,
& Chesney, 2000
; Mellins
et al., in press
). Participants were asked to describe their
child's antiretroviral medication regimen (e.g., the names/colors/descriptions
of all antiretroviral medications, prescribed doses per day, prescribed number
of pills/teaspoons/etc. per dose). They were then asked for each medication to
report on the number of missed, partial, or off schedule (late by 1 hour or
more) doses for each medication per day, during the past 2 days. We selected
two days to maximize accurate recall. A dichotomous variable was calculated
that indicated whether the adult reported any missed, partial, or off-schedule
medication in the past 2 days.
The child interview was structured differently based on cognitive/developmental differences and the fact that many children did not know the names of their medications or their HIV status. Adherence questions referred to all of their medications as a group. We asked them to report on whether they had taken all, some, or none of the medications that they were supposed to take at four different time points during the previous day: morning, afternoon, evening, and night. We also asked them the same questions about the day before yesterday. As with the adults, a dichotomous variable was calculated indicating whether there were any adherence problems in the previous 2 days.
Second, were medications missed in the past 2 days because the child refused to take them or the child "threw it up"? Both the adult and the child were asked how many times this had happened, and two dichotomous variables were calculated to indicate whether any medications were missed because of refusal or vomiting.
Third, were medications missed on the previous weekend? We asked both adult and child in a simple yes/no format.
Fourth, were medications missed in the previous week? Both child and adult were asked when was the last time the child's medications were missed and responded using a 5-point response scale that ranged from never to within the past week. From these responses, we calculated a dichotomous variable to indicate whether the children had missed any medications in the past week.
Fifth, does the child have some responsibility for taking his or her own medications? The adults were asked whether the children was totally dependent on their adult caregiver or another person for taking their medications or whether the children had minimal, some, or primary responsibility themselves. The children were asked about who was responsible for giving them their medications. For both the adult and the child, a dichotomous variable indicated whether the child had any responsibility.
Data Analysis
Kappa was calculated as a measure of agreement between the children and
their caregivers for all six of the variables. This statistic measures the
extent of agreement between two raters, adjusting for the amount of agreement
expected by chance (Cohen,
1960
). Landis and Koch
(1977
) have provided
guidelines for interpreting the kappa statistic and consider kappas of .20 and
below "slight" agreement; kappas of .21 to .40 "fair";
and kappas of .41 to .60 "moderate." Additional analyses compare
child-adult dyads with concordant adherence reports to dyads with discordant
reports. T tests were used to compare the two groups on continuous
variables; chi-square tests were used for dichotomous variables. McNemar tests
were used to determine whether the children or their adult caregivers were
more likely to report adherence problems.
| Results |
|---|
|
|
|---|
Table I describes the 48 dyads. Mellins et al. (2002
|
The six dichotomous adherence-related variables available from both the adult and the child were compared (see Table II). In 46% of the child-adult dyads, at least one of the pair reported adherence problems in the last 2 days, and 44% reported missing doses in the past week (the past week question does not consider partial or off-schedule doses, as the 2-day questions do). Child refusal and medication-related sickness were rare in the previous 2 days.
|
In general, the level of agreement was quite low. When considering missed,
partial, or off-schedule medications in the last 2 days, we found that 38% of
the adult-child pairs were in disagreement. Of the five variables that assess
adherence problems, the highest level of agreement was for missed medications
during the past week (
= .32), although there was disagreement in 29%
of the cases. Agreement was somewhat better, although still moderate,
regarding whether the children had some responsibility for taking their own
medications (
= .42).
McNemar tests were conducted to examine whether children or adults reported nonadherence more often. Two variables approached statistical significance, with children being more likely to report nonadherence: whether medications were missed during the previous week and whether medications were missed on the previous weekend.
We compared adult-child dyads who disagreed regarding missed doses in the past 2 days, past weekend, and past week to dyads that agreed. They were compared on the child's gender, age, responsibility for taking medications, and knowledge of HIV status. Disagreement was more common when the child was a boy. For example, 41% of the boys disagreed with the adult regarding missed medications in the past week, compared to 19% of the girls. However, none of the gender differences was statistically significant.
Children who disagreed with the adult on these three adherence variables
were older than those who agreed. This age difference was statistically
significant for missed medications on the previous weekend, t(46) =
2.2, p = .03; there was a 1.3-year age difference between the two
groups (M = 10.6, SD = 2.0 vs. M = 9.4, SD
= 1.7). There was also a marginally significant age difference for missed
medications in the past week. Neither the adults' rating of whether the child
had some responsibility for taking his or her medications nor whether the
child knew if he or she was HIV+ was related to adult-child disagreement on
any of the three adherence variables. However, the child's rating of
responsibility for taking his or her medications was related to disagreement
regarding adherence for the previous weekend and the past week. The children
reported having some responsibility for taking their medications in 100% of
the cases where there was disagreement regarding the past weekend, compared to
57% of those cases where there was agreement (
2 p =
.01). Similar differences were found regarding the past week
(
2 p = .04). These findings, combined with the age
effects, suggest that, as the children get older and take on more
responsibility for their medications, the adult is less aware of the child's
actual adherence, and, therefore, there is more likely to be adult-child
disagreement on reports of the child's adherence.
| Discussion |
|---|
|
|
|---|
Adherence problems were quite common in this population. In nearly half of the sample, either the adult or the child reported having medication problems in the past 2 days or having missed medications within the past week. This level of adherence is typical of pediatric populations with other chronic illnesses (La Greca & Schuman, 1995
There are clinical and research implications of these findings. As noted in
other pediatric conditions (Bender,
Milgrom, Wamboldt, & Rand, 2000
), it is not sufficient to
assess adherence levels based only on the child or the caregiver, and
adherence problems may more likely be identified if both are interviewed. In a
clinical setting, asking about adherence problems from both the child and the
caregiver also raises awareness for both about the proper medication regimen
and potential barriers to adherence that they are experiencing. It also
provides an opportunity to encourage the adult to monitor the child's
adherence even in situations where the child has primary responsibility for
taking his own medications.
In research regarding adherence to HIV medications, these findings also illustrate the importance of multiple informants. Sometimes the child is aware of problems that the adult is not aware of and vice versa. One approach to resolving discrepancies in a research setting may be to have a joint interview with caregivers and children, following the individual ones, to discuss any discrepancies. First, if the discrepancies are resolved, the researcher obtains a more accurate assessment of actual adherence. Second, if qualitative data are collected regarding the discrepancies, something could be learned about the sources of inaccurate reporting. We speculate that discrepancies are sometimes due to lack of child or adult knowledge regarding adherence, as well as issues of social desirability. A joint qualitative interview would provide data to see how often this is the case or whether other factors are more relevant.
There are several limitations to this study. The relatively small sample
may not be representative of all children who perinatally contract HIV.
However, the sample was demographically similar to the general population of
perinatally HIV-infected children in New York City, in which 91% are black or
Hispanic and living in inner-city impoverished neighborhoods
(NYC DOH Surveillance, 2002
).
In addition, we did not have an objective measure of actual adherence
(electronic monitoring pill bottles, blood tests, etc.), and so were unable to
determine which participant, the child or the adult, was providing the more
accurate information. We cannot therefore determine who is the better source
of adherence data if only one member of the dyad is to be assessed. However,
until more objective measures of adherence are developed and commercially
available for pediatric HIV studies (e.g., therapeutic blood monitoring,
electronic monitoring devices for liquids, etc.), self-report will continue to
be the primary mode of collecting adherence to antiretroviral data. Thus, a
better understanding of the validity of such data is important. Another
limitation is that, when assessing problems in the past 2 days, we asked the
child and the adult somewhat different adherence questions due to
developmental/cognitive considerations. The goal in research should be to get
the most accurate data possible, and that will often require questions in a
different form for the adults and the children. Unfortunately, this presents
serious limitations for assessing interrater reliability.
In conclusion, studies on medication adherence in children should consider multiple sources of information regarding adherence. The children's information is important but should be supplemented by data from their caregiver. Research is needed that attempts to identify the reasons for discrepancies between reports so that reliable assessments of adherence can be collected. Objective measures of adherence should also be developed, such as electronic monitoring devices more appropriate for the medications commonly administered to children. Finally, biological markers of medication in the body would be useful to validate various methods of assessing adherence among children.
| Acknowledgments |
|---|
This research was supported by the following: (1) a pilot grant to Dr. Mellins from a center grant from the National Institute of Allergy and Infectious Diseases to the Columbia-Rockefeller Center for AIDS Research (P30 AI42848; Principal Investigator, David Ho, MD); (2) a comprehensive center grant from the National Institute of Mental Health to the HIV Center for Clinical and Behavioral Studies at the New York State Psychiatric Institute and Columbia University (P50-MH43520; Principal Investigator, Anke A. Ehrhardt, PhD); (3) a training grant from the National Institute of Mental Health (T32 MH19139 Behavioral Sciences Research in HIV Infection; Principal Investigator, Zena Stein, MD). In addition, we gratefully acknowledge our research assistants Megan Block, Daisy Reyes, and Evelyn Badillo-Cordero; the clinic staff at Harlem Hospital's Family Care Center and the Incarnation Children's Center; FCC's clinic director, Maxine Frere; and all of the families who contributed their time.
Received August 29, 2002; accepted September 27, 2002
| References |
|---|
|
|
|---|
Abrams, E. J., Thomas, P., Weedon, J., Bertolli, J., Bornsclegel, K., Cervia, J., et al. (2001). Aging cohort of HIV-infected children in New York City. Pediatric Infectious Disease Journal, 20, 511 517.[Web of Science][Medline]
Albano, F., Spagnuolo, M. I., Canani, R. B., & Guarino, A. (1999). Adherence to antiretroviral therapy in HIV-infected children in Italy. AIDS Care, 11, 711 714.[CrossRef][Web of Science][Medline]
Bangsberg, D. R., Hecht, F. M., Charlebois, E. D., Zolopa, A. R., Holodniy, M., Sheiner, L., et al. (2000). Adherence to protease inhibitors, HIV-1 viral load, and development of drug resistance in an indigent population. AIDS, 14, 357 366.[CrossRef][Web of Science][Medline]
Bender, B. G., Milgrom, H., Wamboldt, F. S., and Rand, C. (2000). Measurement of treatment non-adherence in children with asthma. In D. Drotar (Ed.), Promoting adherence to medical treatment in chronic childhood illness: Concepts, methods, and interventions (pp. 153172). Hillsdale, NJ: Lawrence Erlbaum.
Besch, C. L. (1995). Compliance in clinical trials. AIDS, 9, 1 10.[Web of Science][Medline]
Carpenter, C. C., Cooper, D., Fischl, M. A., Gatell, J. M.,
Gazzard, B. G., Hamme, S. M., et al. (2000). Antiretroviral
therapy in adults: Updated recommendations of the international AIDS Society,
USA Panel. Journal of the American Medical
Association, 283, 381
390.
Chesney, M. A., Ickovics, J. R., Chambers, D. B., Gifford, A. L., Neidig, J., Zwickl, B., et al. (2000). Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: The AACTG adherence instruments. AIDS Care, 12, 255 266.[CrossRef][Web of Science][Medline]
Chesney, M. A., Morin, M., & Sherr, L. (2000). Adherence to HIV combination therapy. Social Science and Medicine, 50, 1599 1605.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37 46.[CrossRef][Web of Science]
de Martino, M., Tovo, P., Balducci, M., Galli, L., Gabiano, C.,
Rezza, G., et al. (2000). Reduction in mortality with
availability of antiretroviral therapy for children with perinatal HIV-1
infection. Journal of the American Medical
Association, 284, 190
197.
Drotar, D. (2000). Promoting adherence to medical treatment in chronic childhood illness: Concepts, methods, and interventions. Hillsdale, NJ: Lawrence Erlbaum.
Falkenberg, J. (1999). The longest triple-drug combination trial reported in HIV+ children. Women's Treatment News, 1, 3 4.
Gortmaker, S. L., Hughes, M., Cervia, J., Brady, M., Johnson, G.
M., Seage III, G. R., et al. (2001). Effect of combination
therapy including protease inhibitors on mortality among children and
adolescents infected with HIV-1. New England Journal of
Medicine, 345, 1522
1528.
Havens, J. F., Mellins, C. A., & Hunter, J. (2002). Psychiatric aspects of HIV/AIDS in childhood and adolescence. In M. Rutter and E. Taylor (Eds.), Child and adolescent psychiatry: Modern approaches (4th ed., pp. 828 841). Malden, MA: Blackwell.
La Greca, A. M., & Schuman, W. B. (1995). Adherence to prescribed medical regimens. In M. C. Roberts (Ed.), Handbook of pediatric psychology (2nd ed., pp. 55 83). New York: Guilford.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159 174.[CrossRef][Web of Science][Medline]
Ley, P. (1988). Communicating with patients: Improving communication, satisfaction and compliance. New York: Chapman and Hall.
Macilwain, C. (1997). Better adherence vital in AIDS therapies. Nature, 392, 431.
Mannerheimer, S., Friedland, G., Matts, J., Child, C., & Chesney, M. (2000). Self-reported antiretroviral adherence correlates with HIV viral load and declines over time. XIII International AIDS Conference, Durban, South Africa, July 9-14, 2000.
Martinez, J., Bell, D., Camacho, R., Henry-Reid, L. M., Watson, C., & Rodriguez, F. (2000). Adherence to antiretroviral drug regimens in HIV-infected adolescent patients engaged in care in a comprehensive adolescent and young adult clinic. Journal of the National Medical Association, 92, 55 61.[Medline]
Matsui, D. (2000). Children's adherence to medicaiton treatment. In D. Drotar (Ed.), Promoting adherence to medical treatment in chronic childhood illness: Concepts, methods, and interventions (pp. 135152). Hillsdale, NJ: Lawrence Erlbaum.
Mellins, C. A., Brackis-Cott, E., Dolezal, C., & Abrams, E. J. (2002). Factors mediating medical adherence in HIV-infected children. Paper presented at the International AIDS Conference, Barcelona, Spain.
Mellins, C. A., Brackis-Cott, E., Dolezal, C., Richards, A.,
Nicholas, S. W., & Abrams, E. J. (2002). Patterns of HIV
status disclosure to perinatally HIV-infected children and subsequent mental
health outcomes. Clinical Child Psychology and
Psychiatry, 7, 101
114.
Mellins, C. A., Havens, J., McCaskill, E. O., Leu, C. S., Brudney, K., & Chesney, M. (in press). Mental health, subsance use and disclosure are significantly associated with the medical treatment adherence of HIV-infected mothers. Psychology, Health, and Medicine.
New York City Department of Health. (June, 2002). HIV/AIDS surveillance update: Semi annual 2002.
Patterson, D. L., Swindells, S., Mohr, J., Brester, M., Vergis, E. N., Squier, C., et al. (2000). Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Annals of Internal Medicine, 1333, 21 30.
Quittner, A. L., Espelage, D. L., Ievers-Landis, C., & Drotar, D. (2000). Measuring adherence to medical treatments in childhood chronic illness: Considering multiple methods and sources of information. Journal of Clinical Psychology in Medical Settings, 7, 41 54.
Rapoff, M. A. (1999). Adherence to pediatric medical regimens. New York: Kluwer Academic/Plenum.
Steel, R. G., Anderson, B., Rindel, B., Dreyer, M. L., Perrin, K., Christensen, R., et al. (2001). Adherence to antiretroviral therapy among HIV-positive children: Examination of the role of caregiver health beliefs. AIDS Care, 13, 617 629.[CrossRef][Web of Science][Medline]
Urguhart, J. (1991). Compliance and clinical trials. Lancet, 337, 1224 1225.[Web of Science][Medline]
Van Dyke, R. B., Lee, S., Johnson, G. M., Wiznia, A., Mohan, K.,
Stanley, K., et al. (2002). Reported adherence as a determinant
of response to highly active antiretroviral therapy in children who have human
immunodeficiency virus infection. Pediatrics,
109, e61
71.
Weidle, P. J., Ganea, C. E., Ernst, J., McGowan, J., Irwin, K. L., & Holberg, S. D. (1998). Multiple reasons for nonadherence to antiretroviral medications in an inner-city minority population: Need for a multifaceted approach to improve adherence. 12th World AIDS Conference, Geneva, Switzerland.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
J. M. Simoni, A. Montgomery, E. Martin, M. New, P. A. Demas, and S. Rana Adherence to Antiretroviral Therapy for Pediatric HIV Infection: A Qualitative Systematic Review With Recommendations for Research and Clinical Management Pediatrics, June 1, 2007; 119(6): e1371 - e1383. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Nicholson, C. Mellins, C. Dolezal, E. K. Santamaria, E. Brackis-Cott, and E. J. Abrams The Association Between Caregiver Knowledge of Antiretroviral Therapy Regimens and Disease Parameters Among Perinatally Human Immunodeficiency Virus-Infected Children Arch Pediatr Adolesc Med, December 1, 2006; 160(12): 1307 - 1308. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||

