Skip Navigation



Journal of Pediatric Psychology Advance Access published online on December 20, 2006

Journal of Pediatric Psychology, doi:10.1093/jpepsy/jsl047
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
32/5/527    most recent
jsl047v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Karsdorp, P. A.
Right arrow Articles by Mulder, B. J.M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Karsdorp, P. A.
Right arrow Articles by Mulder, B. J.M.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author 2006. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oxfordjournals.org

Psychological and Cognitive Functioning in Children and Adolescents with Congenital Heart Disease: A Meta-Analysis

Petra A. Karsdorp, MA1, Walter Everaerd, PhD1, Merel Kindt, PhD1 and Barbara J.M. Mulder, MD, PhD2

1University of Amsterdam, and 2Academic Medical Center, Amsterdam, The Netherlands

All correspondence concerning this article should be addressed to P.A. Karsdorp, Department of Clinical, Medical and Experimental Psychology, Maastricht University, Universiteitssingel 50, 6229 ER Maastricht, The Netherlands. E-mail: P.Karsdorp{at}DMKEP.unimaas.nl


    Abstract
 Top
 Abstract
 Methods
 Results
 Discussion
 Acknowledgments
 References
 
Objective Findings in the literature are inconsistent on the impact of congenital heart disease (CHD) on the psychological and cognitive functioning of children and adolescents. The aim of the present study was to systematically review this empirical body of literature. Methods We conducted a meta-analysis to review studies on behavior problems and cognitive functioning in CHD. Results Only older children and adolescents with CHD displayed an increased risk of overall, internalizing, and to a lesser extent externalizing behavior problems. In addition, patients with severe CHD exhibited lower cognitive functioning than patients with less severe CHD, specifically with respect to performance intelligence. Moreover, decreased cognitive functioning remained relatively stable across different age groups. Conclusions Children with severe heart disease may benefit from interventions specifically targeting perceptual organizational abilities, such as visual–spatial abilities. Moreover, older children and adolescents with CHD may benefit from psychological interventions reducing anxiety symptoms and depression.

Key words: cognitive functioning; congenital heart disease; meta-analysis; pediatric chronic illness; psychopathology..


Congenital heart disease (CHD) refers to a heterogeneous group of diseases characterized by a structural heart defect at birth. The incidence of moderate to severe CHD is estimated to be 6/1000 live births, based on 62 studies from different countries (e.g., US, Europe, Australia, and China; Hoffmann & Kaplan, 2002Go). This incidence rate rises to 19/1000 live births if the potentially serious bicuspid aortic valve is included and to 75/1000 live births if tiny muscular ventricular septum defects (VSDs) and other trivial lesions are included. Most patients with CHD are diagnosed in infancy and childhood and are expected to undergo an operation or interventional catheterization in infancy to correct or palliate their defect (Warnes et al., 2001Go). After cardiac intervention, residual anatomical abnormalities may remain and patients may still be at risk for premature death or comorbidities, such as arrhythmias, hypertension, pulmonary, renal, and myocardial disease or coronary artery disease. Most patients with CHD need to be seen regularly by a cardiologist and in the US almost 50% of the patients who have undergone surgery require additional surgery at an older age (Warnes et al., 2001Go). Advances in diagnostic and surgical techniques have increased survival rates in CHD remarkably. For example, in the US it is estimated that >85% of the children with complex CHD survive the first year of life as compared with 20% in the forties (Warnes et al., 2001Go). Due to increased survival rates, greater attention has been directed toward understanding the impact of CHD on psychological and cognitive functioning. The goal of medical care is not only to achieve long-term survival but also to achieve the best possible psychological and cognitive development.

A considerable number of studies have been conducted to assess the impact of CHD on children's and adolescents' psychological and cognitive functioning. The outcome measure that is used in the majority of these studies assessing psychological functioning is the Child Behavior Checklist (CBCL; Achenbach & Edelbrock, 1983Go) parent form. This is a parent report measure that provides an estimate of overall emotional and behavioral problems, and of internalizing (e.g., anxiety, depression, social withdrawal), and externalizing behavior problems (e.g., hyperactivity, oppositional behavior, aggression). The outcome measure that is used in the majority of studies assessing overall cognitive functioning, verbal (VIQ; e.g., verbal comprehensive abilities), and performance intelligence quotients (PIQ; e.g., perceptual organizational abilities) is the Wechsler Intelligence Tests for Children (WISC; Wechsler, 1991Go). Consensus among studies assessing psychological and cognitive functioning in CHD has not been reached. Authors report higher rates of behavior problems and reduced cognitive functioning among children and adolescents with CHD as compared with norms (e.g., Hövels-Gürich et al., 2002Go; Ikle, Hale, Fashaw, Boucek, & Rosenberg, 2003Go) or study-recruited control groups (e.g., Mahle et al., 2000Go; Oates, Turnbull, Simpson, & Cartmill, 1994Go), whereas others report no significant differences between patients with CHD and norms (e.g., Hövels-Gürich, Seghaye, Dabritz, Messmer, & Von Bernuth, 1997Go; Utens et al., 2001Go) or study-recruited control groups (e.g., Karl et al., 2004Go).

An important distinction among studies is the severity of heart disease of the patient sample. Studies provide estimates of behavior problems and cognitive functioning for separate patient groups with only simple or severe CHD, such as VSD or transposition of the great arteries (TGA; e.g., Clarkson, MacArthur, Barett-Boyes, Whitlock, & Neutze, 1980Go), or for a heterogeneous group of patients with CHD (Utens et al., 1993Go). The different findings among studies could be explained by the fact that patients with severe heart disease are at increased risk for psychological and cognitive problems. In the literature, however, no consensus has been reached on the effect of disease severity on psychological and cognitive functioning. That is, some authors report worse psychological and cognitive functioning in more severe CHD (e.g., Haneda, Itoh, Togo, Ohmi, & Mohri, 1996Go; Hesz & Clark, 1988Go), whereas others do not (e.g., Forbess, Visconti, Bellinger, Howe, & Jonas, 2002Go; Utens et al., 1993Go).

A second discrepancy among studies has been the age of the patients with CHD. Cognitive and psychological functioning is tested in patients varying in age from 4 months to 18 years old. The reliability and predictive validity of assessments of IQ and behavior problems is low in infancy and toddlerhood (e.g., Gruneau, Whitfield, & Petrie, 2000Go; McGrath, Wypij, Rappaport, Newburger, & Bellinger, 2004Go) and is moderate to high in children aged 4 years or above (Hofstra, van der Ende, & Verhulst, 2000Go; Sameroff, Seifer, Baldwin, & Baldwin, 1993Go). Therefore, the different findings across studies may reflect the low reliability and validity of the findings in infancy. Additionally, the different findings may reflect real differences between older and younger patients with CHD. Some studies showed age effects on psychological and cognitive functioning (e.g., Jedlicka-Köhler, Sinko-Sanz, Schlemmer, & Wimmer, 1995Go; Wray & Sensky, 1998Go).

Some reviews have been written to integrate the literature on psychological and cognitive functioning in CHD. However, the conclusions of these reviews as to whether patients with CHD are at increased risk of diminished psychological and cognitive functioning and whether disease severity is a risk factor have been inconsistent (Delamater, 2003Go; Foster et al., 2001Go; Gardner & Angelini, 1995Go; Griffin, Elkin, & Smith, 2003Go; Samango-Sprouse, & Suddaby, 1997Go; Shillingford & Wernovsky, 2004Go). Moreover, these reviews have not included all relevant literature and the criteria for inclusion are not always presented. Furthermore, these reviews rely on significance testing, increasing the likelihood of a type II error, as the sample sizes of the patients with CHD are often small.

The goal of the present study is to determine the impact of CHD on psychological and cognitive functioning in children and adolescents. We provide a systematic review of the current empirical body of literature on psychopathology and cognitive functioning in CHD, using meta-analytic techniques. Meta-analytic techniques provide a reliable overall estimate of effect sizes (ESs) and statistical tests to determine whether differences in methodological characteristics (e.g., control group used), and sample characteristics, such as chronological age and severity of heart disease, influence the findings.


    Methods
 Top
 Abstract
 Methods
 Results
 Discussion
 Acknowledgments
 References
 
Literature Search
Because medical technology and medical treatment have changed dramatically over the last 25 years (Griffin et al., 2003Go), the literature search was restricted to articles published between 1980 and May 2005. We performed a search in Medline and Psychinfo databases using the following keywords: "congenital heart defects or disease", paired with the descriptors "mental disorders", "behavior", "psychology", and "cognitive". In addition, we searched reference lists of studies included in this meta-analysis. To ascertain the likelihood of a publication bias, a file drawer analysis was conducted. A file drawer analysis is a method to estimate the number of additional studies (x) averaging null findings that would be necessary to bring small and medium ESs for psychopathology and cognitive functioning (dk) to negligible ESs (dc) using the formula dc = {sum}dk/(k + x), with k being the number of studies included in the analysis (Hunter & Schmidt, 1990Go).

Inclusion Criteria
Criteria for inclusion in the meta-analysis were as follows: (a) studies had to be published in a peer-reviewed English- or German-language journal; (b) studies solely included patients with CHD; (c) studies included patients between 2 and 19 years old, and with a mean age of 4 years or above; (d) studies included solely patients who had undergone surgery or interventional catheterization; (e) studies included the CBCL (Achenbach, 1991Go; Achenbach & Edelbrock, 1983Go) parent form to measure psychopathology; (f) and/or studies included a measure of cognitive function: British Ability Scale (BAS; Elliot, 1983Go), Bayley Scales of Infant Development (BSID; Bayley, 1969Go), Differential Ability Scale (DAS; Elliot, 1990), Hamburger Wechsler Intelligence Test for Adults (HAWIE; Wechsler, 1964Go), Hamburger Wechsler Intelligence Test for Children (HAWIK; Bondy, 1966Go), Hamburger Wechsler for Children in Pre-school Age (HAWIVA; Eggert, 1975Go), Kaufman Assessment Battery for Children (K-ABC; Kaufman & Kaufman, 1983Go), Leiter International Scale (LIS; Arthur, 1952Go), McCarthy Scales of Children's Abilities (MCSA; McCarthy, 1972Go), Stanford Binet Scale (SB; Terman & Merrill, 1961Go; Thorndike, Hagen, & Sattler, 1986Go), Wechsler Intelligence Test for Children (WISC; Wechsler, 1974Go, 1991Go), Wechsler Preschool and Primary Scale of Intelligence (WPPSI; Wechsler, 1967Go, 1989Go); (g) studies reported sufficient data necessary to compute ESs; (h) studies included a control group (healthy controls, siblings, individuals with innocent heart murmur, or published norms).

Studies were excluded that tested patients with only syndromes in which CHD was part of the total syndrome, like Williams, Marfan, or velo-cardio-facial syndrome.

Variables Coded from Each Study
To determine between-rater agreement, two independent judges coded 19 randomly selected studies of the sample. Information coded from each study included: meeting inclusion criteria, year of publication, age of the patients, name of questionnaires, construct measured, type of heart disease, type of control group, sample sizes, inferential statistics, and mean and standard deviation of psychopathology and cognitive functioning. Discrepancies in coding were measured with Kappa's coefficient and Pearson's correlation for categorical and noncategorical data, respectively (e.g., Whittington, Podd, & Kan, 2000Go). Between-rater agreement showed that the coding for each variable was very reliable (mean agreement for the variables coded: r = .93, SD = 13). Discrepancies in coding were solved through discussion between judges. A cardiologist classified the heart defects into complex (e.g., transposition of the great arteries), moderate (e.g., tetralogy of Fallot), and simple CHD (e.g., ventricular septum defect) based on risk of morbidity and mortality, according to the classification system presented at the 32nd Bethesda Conference (Warnes et al., 2001Go).

Meta-analytic Procedures
The basic approach primarily focused on ESs and was modeled on the meta-analytic techniques of Hunter and Schmidt (1990Go). This method provides the opportunity to determine how much of the variance in ESs across studies is due to sampling error. Moreover, this method allows adjusting for the effect of sampling error, yielding an estimate of the true population variability of study outcomes. Finally, it provides a method to test whether ESs across studies are uniform (homogeneous). This method is less vulnerable to type II error (i.e., concluding that the ES are uniform when in fact they are not) than the often-used chi-square statistics (Hedges & Olkin, 1985Go).

Calculation of Effect Sizes
The standardized mean difference, d (Cohen, 1988Go), was used as the estimate of ES. The d statistics can be defined as the difference between the group means divided by the pooled standard deviation. Where a study reported the percentages of patients with CHD who exceeded a cutoff score, the ES was determined by consulting a table using probit transformation methods to convert differences in proportions to ES (Glass, McGaw, & Smith, 1981Go). ESs expressed in eta squared were transformed to Cohen's d (Cohen, 1988Go). Where published norms or standard scores were provided, the sample size of the control group was equated with the sample size of the patient group. Where standard deviation of the patient group was missing, the standard deviation of the control group was substituted. For psychopathology, a positive ES reflects more psychopathology in CHD relative to controls. For cognitive functioning, a negative ES reflects decreased cognitive functioning in CHD relative to controls.

To correct for differences in sample size, the weighted mean ES and variance were computed (Hunter & Schmidt, 1990Go). To correct for sampling error, the population (residual) variance was then computed by subtracting the sampling error variance from the observed variance (Hunter & Schmidt, 1990Go). Sampling error variance was computed using the formula Se2 = [(N 1)]/[(N – 3)] [(4/N)] [(1 + D2/8)], N being the average sample size across all groups and D the weighted average of Cohen's d. The estimate of the population variance served as the multiplier in the formula for the 95% confidence interval. Finally, an unbiased ES (d*) was calculated by removing a small sample bias. The unbiased ES was computed by d* = d/a, where a = 1 + .75/(N–3) (Hunter & Schmidt, 1990Go).

To reliably interpret the estimated population ES, the ESs should be uniform across studies, (i.e. homogenous). To test to what extent the ESs are homogenous, we determined the degree in which any residual variance of the ESs (i.e., variance after removal of sampling error) could be explained by artifacts not corrected for. This was calculated by the percentage of observed variance explained by sampling error variance. The data set can be considered homogeneous if ≥75% of the observed variance is explained by sampling error (Hunter & Schmidt, 1990Go). If <75% of the observed variance is explained by sampling error, the data set can be considered heterogeneous. This may indicate that there are moderating variables explaining the residual variance of the ESs.

To examine the effect of moderating variables, the data set was subdivided as a function of the moderator. For continuous moderator variables, Pearson product-moment correlation coefficients were calculated between the unbiased ESs and the moderator variable. According to Cohen (1988Go), small, medium, and large ESs were d = 0.20, 0.50, and 0.80, respectively.


    Results
 Top
 Abstract
 Methods
 Results
 Discussion
 Acknowledgments
 References
 
Psychopathology
Eleven studies were selected for inclusion in the meta-analysis, providing 16 ESs for overall behavior problems and 14 for internalizing (e.g., anxiety, depression) and externalizing (e.g., hyperactivity, aggression) behavior problems (Table I). The analysis showed that patients with CHD exhibited more overall (medium ES), internalizing (medium ES), and externalizing (small ES) behavior problems than controls (Table II). However, only for externalizing behavior problems a homogeneous data set was obtained, indicating that significant moderators were present with respect to overall and internalizing behavior problems.


View this table:
[in this window]
[in a new window]

 
Table I. Overview of Studies Included in the Meta-analysis With Respect To Behavior Problems

 

View this table:
[in this window]
[in a new window]

 
Table II. Cumulated ES Estimates and Residual Variation as a Function of Behavior Problems after Accounting for Sampling Error

 
Correlations between age and ESs for behavior problems showed that only older patients with CHD showed more overall, internalizing, and externalizing problems as compared with a comparison group, r(16) = .67, p = .005; r(14) = .77, p = .001; and r(14) = .73, p = .003 respectively. Separate analysis of younger children (mean age <6 years) and older children and adolescents (mean age >10 years) showed homogeneous data sets (Table II). Younger children with CHD showed less internalizing (negligible ES) and externalizing behavior problems (small ES) than controls. In contrast, older children and adolescents showed more internalizing (medium ES) and to a lesser extent externalizing problems (small ES) than controls. Disease severity was not significantly related to overall: r(13) = .18, p = ns, internalizing: r(12) = .11, p = ns, and externalizing: r (12) = –.05, p = ns problems.1

Overall Cognitive Functioning
Twenty-five studies were selected for inclusion in the meta-analysis, providing 50 ESs for overall cognitive functioning (Table III). There was considerable heterogeneity in the data set (Table IV), which points to significant moderators. Because healthy controls, patients with innocent heart murmurs, and siblings scored significantly higher on cognitive functioning (medium ES) as compared with normative data (Table IV), we substituted their means and SDs by means and SDs of the norm, in order to create a more homogeneous data set. However, the data set remained heterogeneous.


View this table:
[in this window]
[in a new window]

 
Table 3. Overview of Studies Included in the Meta-analysis With Respect To Cognitive Functioning

 

View this table:
[in this window]
[in a new window]

 
Table IV. Cumulated ES Estimates and Residual Variation as a Function of Overall Cognitive Functioning after Accounting for Sampling Error

 
Correlations between CHD severity and ESs of cognitive functioning revealed that patients with more severe CHD exhibited lower cognitive functioning than patients with less severe CHD; r(46) = –.45, p = .002.1 In addition, older patients showed less adverse cognitive outcome than younger patients; r(50) = .31, p = .03. The effect of disease severity on cognitive functioning remained after controlling for mean age; r(43) = –.39, p = .009. The effect of chronological age did not reach significance after controlling for disease severity; r(43) = .23, p = ns.

Table IV provides the ESs of overall cognitive functioning for the various congenital heart defects including: hypoplastic left heart syndrome (HLHS), TGA, tetralogy of Fallot (ToF), atrium septum defect (ASD), and VSD. The data sets are homogeneous, except for ToF. Mean cognitive functioning was higher among patients with VSD than normative data (small ES). Cognitive functioning of patients with ASD was within the normative range. Patients with HLHS and TGA had significantly lower cognitive functioning than normative data, respectively a large and small ES. For patients with ToF, the analysis showed that older patients tended to exhibit higher cognitive functioning than younger patients, but this effect did not reach significance; r (7) = .77, p = .08. For the other patient groups separately (VSD, ASD, TGA, and HLHS), no association was observed between mean age and cognitive functioning, all ps = ns. For these patient groups together, a significant relation between chronological age and cognitive functioning was found; r(25) = .40, p < .05. However, when patients with HLHS were excluded from the analysis, the age effect dissipated; r(21) = .16, p = ns, indicating that age effects were observed because patients with HLHS were tested at an earlier age. This suggestion was confirmed by t tests showing that patients with HLHS were significantly younger than patients with ASD, t (8) = 3.37, p = .01 (ASD: M = 10.63, SD = 2.09; VSD: M = 9.31, SD = 3.05; TGA: M = 8.26, SD = 2.37; ToF: M = 7.96, SD = 3.08; HLHS: M = 5.82, SD = 2.08). It is noteworthy that no other significant differences were found in mean chronological age between the patient groups. This indicates that differences in cognitive functioning among patients with VSD, ASD, TGA, and ToF could not be explained by differences in chronological age.

Verbal and Performance IQ
Twelve studies (Table III) were selected for inclusion in the meta-analysis, providing 21 ESs for verbal IQ (VIQ; verbal comprehensive abilities) and performance IQ (PIQ; perceptual organizational abilities). The analysis demonstrated that the data sets of PIQ and VIQ were characterized by considerable heterogeneity (Table V). Follow-up analysis demonstrated that patients with more severe CHD exhibited lower PIQ and VIQ than would be expected by normative data; respectively, r (20) = –.62, p = .003 and r(20) = –.59, p = .006. Moreover, younger patients with CHD exhibited lower PIQ but not lower VIQ than normative data, respectively, r (21) = .53, p = .01 and r(21) = .38, p = .09. The effect of age on PIQ dissipated after excluding patients with HLHS or after controlling for disease severity; respectively, r(17) = .39, p = ns and r (16) = .32, p = ns. The effect of disease severity on PIQ and VIQ remained after controlling for mean age, respectively, r(17) = –.42, p = .07 and r(17) = –.47, p = .04.


View this table:
[in this window]
[in a new window]

 
Table V. Cumulated ES Estimates and Residuals Variation as a Function of Verbal and Performance Intelligence Quotients After Accounting for Sampling Error

 
Table V provides the ESs of VIQ and PIQ for HLHS, TGA, VSD, and ASD; the data sets are homogeneous. Patients with ASD and VSD had significantly higher VIQ and PIQ than normative data, respectively a small and negligible ES. Patients with HLHS had lower VIQ and PIQ than normative data, respectively a medium and large ES. Patients with TGA had lower VIQ than normative data (a negligible ES). With respect to PIQ, no homogeneous data set was obtained for the patients with TGA. Exclusion of one study in which full-flow cardiopulmonary bypass was used as a surgical technique (ES = 0.34; Karl et al., 2004Go), resulted in a homogeneous data set with lower PIQ scores for patients with TGA as compared with normative data (small ES).

File Drawer Analysis
We estimated the number of additional studies averaging null findings that would be necessary to bring the small and medium ESs for psychopathology and cognitive functioning below a negligible ES, d = |0.1| (Cohen, 1988Go). The results provide confidence that the effects found would not be invalidated even if a publication bias existed, since an increase of 50–850% in existing numbers of studies would be necessary.


    Discussion
 Top
 Abstract
 Methods
 Results
 Discussion
 Acknowledgments
 References
 
The findings of the present study indicate that the sole presence of CHD does not adversely affect behavior problems among children and adolescents. The variance in ESs across studies with respect to psychopathology could not solely be attributed to sampling error; chronological age appeared to be significantly related to psychopathology in CHD, whereas disease severity was unrelated to psychopathology. The findings indicate that only older children and adolescents with CHD display an increased risk of overall, internalizing (medium ES), and to a lesser extent externalizing behavior problems (small ES). These findings suggest that exposure to potential risk factors during the course of a patient's life may increase the development of specifically internalizing behavior problems in older children and adolescents with CHD.

The finding that older children and adolescents with CHD exhibited more internalizing than externalizing problems is consistent with other reviews of pediatric chronic disease (Lavigne & Faier-Routman, 1992Go; Lebovidge, Lavigne, Donenberg, & Miller, 2003Go). Future research may focus on the mechanism that may explain increased levels of internalizing problems among older children and adolescents with CHD. An overprotective parenting style in CHD (Casey, Sykes, Craig, Power, & Mulholland, 1996Go; Linde, 1982Go) may be a possible risk factor for internalizing problems (Gilliom & Shaw, 2004Go). Alternatively, hormonal and brain changes during adolescence triggering the expression of genetic vulnerabilities in combination with potential stressful disease experiences may increase internalizing behavior problems (Walker, Sabuwalla, & Huot, 2004Go).

The findings of the present study indicate that CHD does not adversely impact on cognitive functioning among all children and adolescents. The variance in ESs across studies with respect to cognitive functioning could not solely be attributed to sampling error; disease severity was significantly related to overall cognitive functioning. Patients with HLHS (large ES) and patients with TGA (small and medium ES) demonstrated decreased cognitive functioning compared with study-recruited control groups and normative data, specifically in the area of perceptual organizational abilities. Patients with ASD and VSD showed cognitive functioning within the normative range. An additional finding is that cognitive functioning in CHD remained relatively stable across age groups. For the patients with VSD, ASD, TGA, and HLHS separately, no effect of chronological age was observed. Moreover, although for the patients with CHD overall, chronological age was related to cognitive functioning, additional analysis demonstrated that the observed effect was confounded by disease severity. That is, patients with severe CHD, specifically those with HLHS, were tested at an earlier age than were patients with less severe CHD. Removal of the patients with HLHS from the analysis yielded no age effects.

The finding that severe CHD resulted in more impaired cognitive functioning relative to their counterparts with less severe CHD may possibly be explained by the fact that severe CHD is associated with risk factors that have a cumulative adverse effect on cognitive functioning. For example, patients with more severe disease are at increased risk for congenital brain anomalies (Glauser, Rorke, Weinberg, & Clancy, 1990bGo) that may be associated with prenatal physiological events (Kaltman, Tian, & Rychik, 2005Go) and by chromosomal anomalies (Tennstedt, Chaoui, Korner, & Dietel, 1999Go). Moreover, patients with severe heart disease are at increased risk for acquired cognitive impairments (Glauser, Rorke, Weiberg, & Clancy, 1990aGo; Trittenwein, et al., 2003Go) as a result of more difficult and frequent surgery (Clarkson et al., 1980Go; Stavinoha, Fixler, & Mahony, 2003Go), pre- and postoperative poor cerebral perfusion, seizures, and physical incapacity (Forbess et al., 2002Go; Goldberg et al., 2000Go; Newburger, Silbert, Buckley, & Fyler, 1984Go).

The present results suggest that specifically perceptual organizational abilities are impaired in TGA and HLHS as compared with normative data. Although some caution is warranted, as the number of studies was small, the present findings are in accordance with other studies of children with early brain damage (Ewing-Cobbs, Barnes, & Fletcher, 2003Go; Muter, Taylor, & Vargha-Khadem, 1997Go). The basis for the detrimental effects on perceptual organizational abilities is unclear. One possibility is that reduced motor abilities resulting from CHD and operative recovery time may specifically impede the normal development of motor and spatial relation skills (Goldberg et al., 2000Go; Muter et al., 1997Go). Alternatively, left-hemisphere injury may result in functional re-organization of language functions from the left to the right hemisphere to preserve language functions. This compensation may be achieved at the expense of visuospatial abilities (Muter et al., 1997Go). The present finding, that patients with CHD have verbal abilities within the normal range, despite the fact that they may have missed considerable schooling due to hospitalizations, may support this notion. Nevertheless, the present findings also indicate that overall IQ, VIQ, and PIQ are relatively stable in patients with TGA, HLHS, ToF, ASD, and VSD across different age groups, suggesting that decreased verbal and perceptual abilities may remain after compensation for language functions. A possible explanation for the observed stability of decreased cognitive functioning in CHD is that patients with CHD suffer from neurological impairment at an early age. Brain damage at an early age has been shown to be a risk factor for enduring decreased cognitive functioning (Ewings-Cobbs et al., 2003Go; Levin, 2003Go; Mutter et al., 1997Go). One possibility is that, young patients are more vulnerable to brain damage because they have a less-well-established skill repertoire (Ewings-Cobbs et al., 2003Go) and because myelination takes place during this period (Levin, 2003Go).

Several potential limitations of this review should be considered. The present meta-analysis excluded studies that tested patient groups with a mean age of <4 year, because the reliability and predictive validity of assessments of IQ and behavior problems is low in infancy and toddlerhood (e.g., Gruneau et al., 2000Go; McGrath et al., 2004Go). As a result, the findings of the present study may not apply to infants and toddlers with CHD. Additionally, the meta-analysis is based on the assumption that IQ is normally distributed among patients with CHD. However, some studies have shown a non-normal distribution of IQ that is skewed to the left (e.g., Mahle et al., 2000Go). This may indicate that the present meta-analysis underestimates the extent to which patients with CHD evidence diminished functioning.

Research has shown a rise in mean intelligence scores during the 20th century (Rowe & Rodgers, 2002Go). This so-called Flynn effect may explain why patients with simple CHD (e.g., VSD) showed higher cognitive functioning than suggested by normative data. If this Flynn effect influenced the present findings, the adverse effect of CHD on cognitive outcome may be underestimated.

In the present study, the ESs of cognitive functioning were computed using normative data as opposed to data of a study-recruited control group. However, a study-recruited control group provides the opportunity to carefully match patients and controls on demographic characteristics and to control for a Flynn effect. The present study reveals that the study-recruited control groups evidence higher cognitive functioning than would be suggested by normative data. This indicates that comparison of patients with CHD with a recruited control group could have resulted in larger ESs than a simple comparison of patients with normative data. These findings may be interpreted to suggests that the present data underestimate the degree of cognitive dysfunction in CHD.

The present meta-analysis included only studies that employed tests of overall cognitive functioning. It is possible, however, that patients with CHD exhibit a deficit in a specific area of cognitive functioning. Because IQ scores may average scores on unaffected and affected areas (Schatz, Finke, Kellett, & Kramer, 2002Go) the present study may underestimate cognitive dysfunction in CHD.

Some caution is warranted with respect to the observed effect of chronological age on psychopathology. The meta-analysis is cross-sectional, and may therefore be subject to potential confounds such as cohort effects across studies or sampling biases. Therefore, the association between chronological age and psychopathology should be viewed only as suggestive. Prospective studies of children with CHD and control groups are needed to clearly establish the age effect posited in this review.

The meta-analysis relied only on studies using the CBCL as a measure of child psychopathology. However, concerns have been raised regarding the use of the CBCL in research with children with chronic disease, because the internalizing problem scale includes items that tap physical symptoms (Perrin, Stein, & Drotar, 1991Go). One study on CHD addressed this issue and demonstrated that the difference between patients and the reference group remained after excluding items with a somatic content (Utens et al.,1993Go). Moreover, the present study provided results indicating that severity of heart disease was unrelated to internalizing problem scores. Therefore, it is unlikely that the specific medical diagnosis explained an increased report of internalizing problems in older children and adolescents.

Another limitation of the meta-analysis is the potential impact of rater bias on reported psychopathology in CHD. Assessment of behavior problems was exclusively based on parents’ reports. However, studies comparing parent and child reports have found that children tend to report more behavior problems (specifically internalizing) than their parents (Utens et al., 1993Go). Consequently, the ratings of caregivers of psychopathology in the current study may have underestimated the level of internalizing problems of children and adolescents of CHD.

One of the most frequent criticisms leveled against meta-analysis in general is the argument that the studies available for analysis are biased samples of all available studies. It is often suspected that published studies will show results that are more often statistically significant and have larger ESs than unpublished studies. However, this argument applies equally well to the narrative review (Hunter & Schmidt, 1990Go). Moreover, there is evidence that the availability bias is much less severe than some have believed (Glass, McGaw, & Smith, 1981Go; Hunter & Schmidt, 1990Go). Finally, the number of "lost" studies averaging null results that would be necessary to derive negligible ESs is so large in the present study that it is unlikely that there has been an availability bias.

Another frequent argument against meta-analysis is that it combines studies that are so different that they are not comparable (Hunter & Schmidt, 1990Go). First, a meta-analysis does not analyze studies; it analyzes study results. Any set of numbers can be compared or averaged. Second, the question of whether study results differ across settings is an empirical question rather than a semantic or logical question. The question of whether a potential moderator variable (study characteristic) is an actual moderator variable is impossible to answer without a meta-analysis of some kind (Hunter & Schmidt, 1990Go).

The present study suggests that the sole presence of CHD may not affect the development of overall, internalizing, and externalizing problems. Only older children and adolescents show behavior problems in this investigation, specifically with respect to internalizing difficulties. Moreover, the present study suggests that severe CHD may adversely impact cognitive functioning, specifically in the area of perceptual organizational abilities. To promote psychological and cognitive functioning, future research should attempt to unravel the role of possible risk factors such as diminished cerebral perfusion, treatment characteristics, overprotective parents, or hospitalizations. Although, a lot of work has been done is this area (e.g., Casey et al., 1996Go; Ellerbeck et al., 1998Go; Karl et al., 2004Go; Wernovsky et al., 2000Go), the findings are difficult to integrate, because different surgical techniques have been applied, different patient groups have been tested, or because many risk factors are highly interrelated. Therefore, future studies are required in which cognitive and psychological functioning are assessed longitudinally and in which homogeneous patient groups are randomly assigned to medical treatments (e.g., McGrath et al., 2004Go). Once the impact of individual risk factors is clarified, adverse psychological and cognitive functioning in CHD can be prevented. Another important direction for future research is to move beyond the broad focus on internalizing and externalizing problems and verbal and performance IQ toward the examination of specific domains of psychopathology and cognitive functioning (e.g., anxiety, depression, and visual–spatial skills). Overall, the current study suggests that young children with severe heart disease (HLHS and TGA) may benefit from interventions specifically targeting perceptual organizational abilities (e.g., visual – spatial abilities). Moreover, older children and adolescents with CHD may benefit from psychological interventions that reduce anxiety symptoms and depression.


    Acknowledgments
 Top
 Abstract
 Methods
 Results
 Discussion
 Acknowledgments
 References
 
We gratefully acknowledge Kiki Hohnen for her grammatical advice.

The report was written as part of a project funded by the Dutch Heart Foundation (No. 99.038).

Conflict of interest: None declared.


    Footnotes
 
1 Year in which the study was conducted was unrelated to ESs of psychopathology and cognitive functioning, p > .05. Back

Received November 7, 2005; revision received April 15, 2006; accepted November 3, 2006


    References
 Top
 Abstract
 Methods
 Results
 Discussion
 Acknowledgments
 References
 
Achenbach TM. (1991) Manual for the Child Behavior Checklist/4 – 18 and 1991 Profile(University of Vermont, Department of Psychiatry, Burlington, VT).

Achenbach TM and Edelbrock CS. (1983) Manual for the Child Behavior Checklist and revised profile(University of Vermont, Department of Psychiatry, Burlington).

Arthur G. (1952) Leiter International Performance Scale from the Arthur Adaptation(Psychological Service Press, Chicago IL).

Bondy C. (1966) Handbuch für den Hamburg-Wechsler Intelligenztest für Kinder(Huber, Bern).

Bayley N. (1969) Bayley Scales of Infant Development(The Psychological Corporation, New York).

Casey FA, Sykes DH, Craig BG, Power R, Mulholland HC. (1996) Behavioral adjustment of children with surgically palliated complex congenital heart disease. Journal of Pediatric Psychology 21:335–352.[Abstract/Free Full Text]

Clarkson PM, MacArthur BA, Barrat-Boyes BG, Whitlock RM, Neutze JM. (1980) Developmental progress after cardiac surgery in infancy using hypothermia and circulatory arrest. Circulation 62:855–861.

Cohen J. (1988) Statistical power analysis for the behavioral sciences(Lawrence Erlbaum Associates, Hillsdale, NJ).

Delamater AM. (2003) Cardiovascular disease. In Roberts MC (Ed.). Handbook of pediatric psychology 3rd (The Guilford Press, New York) pp. 409–432.

DeMaso DR, Baerdslee WR, Silbert AR, Fyler DC. (1990) Psychological functioning in children with cyanotic heart defects. Journal of Developmental and Behavioral Pediatrics 11:289–294.[Web of Science][Medline]

Dunbar-Masterson C, Wypij D, Bellinger DC, Rappaport LA, Baker AL, Jonas RA, et al. (2001) General health status of children with D-transposition of the great arteries after the arterial switch operation. Circulation 104:142.

Eggert D. (1975) Hannover Wechsler Intelligenztest für das Vorschulalter(Huber, Bern).

Ellerbeck KA, Smith ML, Holden EW, McMenamin SC, Badawi MA, Brenner JI, et al. (1998) Neurodevelopmental outcomes in children surviving d-transposition of the great arteries. Journal of Developmental and Behavioral Pediatrics 19:335–341.[Web of Science][Medline]

Elliot CD. (1983) The British Ability Scales: introductory handbook, technical handbook and manuals for administration and scoring(NFER-Nelson, Windsor).

Elliot CD. (1990) Differential Ability Scales(The Psychological Corporation, San Antonio, TX).

Ewing-Cobbs L, Barnes MA, Fletcher JM. (2003) Early brain injury in children: Development and reorganization of cognitive function. Developmental Neuropsychology 24:669–704.[CrossRef][Web of Science][Medline]

Forbess JM, Visconti KJ, Bellinger DC, Howe RJ, Jonas RA. (2002) Neurodevelopmental outcomes after biventricular repair of congenital heart defects. Journal of Thoracic and Cardiovascular Surgery 123:631–639.[Abstract/Free Full Text]

Foster E, Graham TP, Driscoll DJ, Reid GJ, Reiss JG, Russell IA, et al. (2001) Task force 2: special health care needs of adults with congenital heart disease. Journal of the American College of Cardiology 37:1176–1183.[Free Full Text]

Gardner FV and Angelini GD. (1995) Psychological aspects of congenital heart disease. Cardiology in the Young 5:302–309.

Gilliom M and Shaw DS. (2004) Codevelopment of externalizing and internalizing problems in early childhood. Developmental Psychopatholology 16:313–333.

Glass GV, McGaw B, Smith ML. (1981) Meta-analysis in social research(Sage, Beverly Hills, CA).

Glauser TA, Rorke LB, Weinberg PM, Clancy RR. (1990a) Acquired neuropathologic lesions associated with the hypoplastic left heart syndrome. Pediatrics 85:991–1000.[Abstract/Free Full Text]

Glauser TA, Rorke LB, Weinberg PM, Clancy RR. (1990b) Congenital brain anomalies associated with the hypolastic left heart syndrome. Pediatrics 85:984–990.[Abstract/Free Full Text]

Goldberg CS, Schwarz EM, Brunberg JA, Mosca RS, Bove EL, Schork MA, et al. (2000) Neurodevelopmental outcome of patients after the fontan operation: A comparison between children with hypoplastic left heart syndrome and other functional single ventricle lesions. Journal of Pediatrics 137:645–652.

Griffin KJ, Elkin TD, Smith CJ. (2003) Academic outcomes in children with congenital heart disease. Clinical Pediatrics 42:401–409.[Abstract/Free Full Text]

Gupta S, Giuffre RM, Crawford S, Waters J. (2001) Covert fears and anxiety in asthma and congenital heart disease. Child: Care, Health, and Development 27:335–348.[CrossRef][Web of Science][Medline]

Gruneau RE, Whitfield MF, Petrie J. (2000) Predicting IQ of biologically "at risk" children from age 3 to school entry: Sensitivity and specificity of the Stanford–Binet Intelligence Scale IV. Journal of Developmental and Behavioral Pediatrics 21:401–407.[CrossRef][Web of Science][Medline]

Haneda K, Itoh T, Togo T, Ohmi M, Mohri H. (1996) Effects of cardiac surgery on intellectual function in infants and children. Cardiovascular Surgery 4:303–307.[CrossRef][Medline]

Hedges LV and Olkin I. (1985) Statistical methods for meta-analysis(Academic Press, Orlando, FL).

Hesz N and Clark EB. (1988) Cognitive development in transposition of the great vessels. Archives of Disease in Childhood 63:198–200.[Abstract/Free Full Text]

Hoffmann JL and Kaplan S. (2002) The incidence of congenital heart disease. Journal of American College of Cardiology 39:1890–1900.[Abstract/Free Full Text]

Hofstra MB, van der Ende J, Verhulst FC. (2000) Continuity and change of psychopathology from childhood into adulthood: A 14-year follow-up study. Child and Adolescent Psychiatry 37:850–858.

Hövels-Gurich HH, Seghaye M, Däbritz S, Messmer BJ, von Bernuth G. (1997) Cognitive and motor development in preschool and school-age children after neonatal switch operation. Journal of Thoracic Cardiovascular Sugery 114:578–585.

Hövels-Gurich HH, Konrad K, Wiesner M, Minkenberg R, Herpertz-Dahlmann B, Messmer BJ, et al. (2002) Long term behavioral outcome after neonatal arterial switch operation for transposition of the great arteries. Archives of Disease in Childhood 87:506–510.[Abstract/Free Full Text]

Hunter JE and Schmidt FL. (1990) Methods of meta-analysis: Correcting error and bias in research findings(Sage Publications, Newbury Park, CA).

Ikle L, Hale K, Fashaw L, Boucek M, Rosenberg AA. (2003) Developmental outcome of patients with hypoplastic left heart syndrome treated with heart transplantation. Journal of Pediatrics 142:20–25.[CrossRef][Web of Science][Medline]

Jedlicka-Köhler I, Sinko-Sanz K, Schlemmer M, Wimmer M. (1995) Kognitive Entwicklung von Kindern und Jugendlichen nach Korrektur einer Transposition der großen Gefäße. Klinische Pädiatrie 207:68–72.[Web of Science][Medline]

Jedlick-Köhler I and Wimmer M. (1987) Der Einfluß des Operationszeitpunktes auf die intellektuelle und psychosziale Entwicklung bie Kindern mit Fallotischer Tetralogie. Klinische Pädiatrie 199:86–89.[Web of Science][Medline]

Kaltman JR, Tian HDIZ, Rychik JR. (2005) Impact of congenital heart disease on cerebrovascular blood flow dynamics in the fetus. Ultrasound in Obstetrics and Gynecology 25:32–36.[CrossRef][Web of Science][Medline]

Karl TR, Hall S, M Ford G, Kelly EA, Brizard CPR, Mee RBB, et al. (2004) Arterial switch with full-flow cardiopulmonary bypass and limited circulatory arrest: Neurodevelopmental outcome. Journal of Thoracic and Cardiovascular Surgery 127:213–222.[Abstract/Free Full Text]

Kaufman AS and Kaufman NL. (1983) Kaufman Assessment Battery for Children (K-ABC)(American Guidance Service, Circle Pines).

Kern JH, Hinton VJ, Nereo NE, Hayes CJ, Gersony WM. (1998) Early developmental outcome after the Norwood procedure for hypoplastic left heart syndrome. Pediatrics 102:1148–1152.[Abstract/Free Full Text]

Lavigne JV and Faier-Routman J. (1992) Psychological adjustment to pediatric physical disorders: A meta-analytic review. Journal of Pediatric Psychology 17:133–157.[Abstract/Free Full Text]

Lebovidge JS, Lavigne JV, Donenberg GR, Miller ML. (2003) Psychological adjustment of children and adolescents with arthritis: A meta-analytic review. Journal of Pediatric Psychology 28:29–39.[Abstract/Free Full Text]

Levin HS. (2003) Neuroplasticity following non-penetrating traumatic brain injury. Brain Injury 17:665–674.[CrossRef][Web of Science][Medline]

Linde LM. (1982) Psychiatric aspects of congenital heart disease. Psychiatric Clinics of North America 5:399–406.[Web of Science][Medline]

Mahle WT, Clancy RR, Moss EM, Gerdes M, Jobes DR, Wernovsky G. (2000) Neurodevelopmetal outcome and lifestyle assessment in school-aged and adolescent children with hypoplastic left heart syndrome. Pediatrics 105:1082–1089.[Abstract/Free Full Text]

McCarthy DA. (1972) Manual for the McCarthy Scales of Children's Abilities(The Psychological Corporation, San Antonio, TX).

McGrath E, Wypij D, Rappaport LA, Newburger JW, Bellinger DC. (2004) Prediction of IQ and achievement at age 8 years from neurodevelopmental status at age 1 year in children with D-transposition of the great arteries. Pediatrics 114:e572–e576.[Abstract/Free Full Text]

Muter V, Taylor S, Vargha-Khadem F. (1997) A longitudinal study of early intellectual development in hemiplegic children. Neuropsychologia 35:289–298.[CrossRef][Web of Science][Medline]

Newburger JW, Silbert AR, Buckley LP, Fyler DC. (1984) Cognitive function and age at repair of transposition of the great arteries in children. New England Journal of Medicine 310:1495–1499.[Abstract]

Oates RK, Simpson JM, Cartmill TB, Turnbull JAB. (1995) Intellectual function and age of repair in cyanotic congenital heart disease. Archives of Disease in Childhood 72:298–301.[Abstract/Free Full Text]

Oates RK, Turnbull JAB, Simpson JM, Cartmill TB. (1994) Parent and teacher perceptions of child behavior following cardiac surgery. Acta Paediatrica 83:1303–1307.[Web of Science][Medline]

O’Dougherty M, Wright FS, Loewenson RB, Torres F. (1985) Cerebral dysfunction after chronic hypoxia in children. Neurology 35:42–46.[Abstract/Free Full Text]

Perrin EC, Stein REK, Drotar D. (1991) Cautions in using the Child behavior Checklist: Observations based on research about children with a chronic disease. Journal of Pediatric Psychology 16:411–421.[Abstract/Free Full Text]

Rowe DC and Rodgers JL. (2002) Expanding variance and the case of historical changes in IQ means: A critique of Dickens and Flynn (2001). Psychological Review 108:346–369.[CrossRef][Web of Science]

Samango-Sprouse C and Suddaby EC. (1997) Developmental concerns in children with congenital heart disease. Current Opinion in Cardiology 12:91–98.[Web of Science][Medline]

Sameroff AJ, Seifer R, Baldwin A, Baldwin C. (1993) Stability of intelligence from preschool to adolescence: The influence of social and family risk factors. Child Development 64:80–97.[CrossRef][Web of Science][Medline]

Schatz J, Flinke RL, Kellett JM, Kramer JH. (2002) Cognitive functioning in children with sickle cell disease: A meta-analysis. Journal of Pediatric Psychology 27:739–748.[Abstract/Free Full Text]

Shillingford AJ and Wernovsky G. (2004) Academic performance and behavioral difficulties after neonatal and infant heart surgery. Pediatric Clinics of North America 51:1625–1639.[CrossRef][Web of Science][Medline]

Spurkland I, Bjornstad PG, Lindberg H, Seem E. (1993) Mental health and psychosocial functioning in adolescents with congenital heart disease. A comparison between adolescents born with severe heart defect and atrial septal defect. Acta Paediatrica 82:71–76.[Web of Science][Medline]

Stavinoha PL, Fixler DE, Mahony L. (2003) Cardiopulmonary bypass to repair an atrial septal defect does not affect cognitive function in children. Circulation 107:2722–2725.

Tindall S, Rothermell RR, Delamater A, Pinsky W, Klein MD. (1999) Neuropsychological abilities of children with cardiac disease treated with extracorporeal membrane oxygenation. Developmental Neuropsychology 16:101–115.

Tennstedt C, Chaoui R, Korner H, Dietel M. (1999) Spectrum of congenital heart defects and extracardiac malformations associated with chromosomal abnormalities: Results of a seven year necropsy study. Heart 82:34–39.[Abstract/Free Full Text]

Terman LM and Merrill MA. (1961) Stanford–Binet Intelligence Scale: Manual for the Third Revision Form L-M(Harrap, London).

Thorndike RL, Hagen EP, Sattler JM. (1986) Stanford–Binet Intelligence Scale 4th (Riverside Publishing Company, Itaska, IL).

Trittenwein G, Nardi A, Pansi H, Golej J, Burda G, Hermon M, et al. (2003) Early postoperative prediction of cerebral damage after pediatric cardiac surgery. Annuals of Thoracic Surgery 76:576–580.[CrossRef]

Utens EMWJ, Verhulst FC, Meijboom F, Duivenvoorden HJ, Erdman RAM, Bos E, et al. (1993) Behavioral and emotional problems in children and adolescents with congenital heart disease. Psychological Medicine 23:415–424.[Web of Science][Medline]

Utens EMWJ, Versluis-Den EMWJ, Bieman HJ, Witsenburg M, Bogers JJC, Verhulst FC, et al. (2001) Cognitive, and behavioral and emotional functioning of young children awaiting elective cardiac surgery or catheter intervention. Cardiology in the Young 11:153–160.[Web of Science][Medline]

Uzark K, Lincoln A, Lamberti JL, Mainwaring RD, Spicer RL, Moore JW. (1998) Neurodevelopmental outcomes in children with fontan repair of functional single ventricle. Pedriatrics 101:630–603.[Abstract/Free Full Text]

Visconti KJ, Bichell DP, Jonas RA, Newburger JW, Bellinger DC. (1999) Developmental outcome after surgical versus interventional closure of secundum atrial septal defect in children. Circulation 100:II–150.

Walker EF, Sabuwalla Z, Huot R. (2004) Pubertal neuromaturation, stress sensitivity, and psychopathology. Developmental Psychopathology 16:807–824.[CrossRef][Web of Science][Medline]

Warnes CA, Liberthson R, Danielson GK, Dore A, Harris L, Hoffman JI, et al. (2001) Task force 1: The changing profile of congenital heart disease in adult life. Journal of the American College of Cardiology 37:1170–1175.[Free Full Text]

Wechsler D. (1964) Die Messung der Intelligenz Erwachsenener(Huber, Bern).

Wechsler D. (1967) Wechsler Preschool and Primary Scale of Intelligence(The Psychological Corporation, New York).

Wechsler D. (1974) Wechsler Intelligence Scale for Children-Revised(The Psychological Corporation, New York).

Wechsler D. (1989) Wechsler Preschool and Primary Scale of Intelligence-Revised Manual(The Psychological Corporation, San Antonio, TX).

Wechsler D. (1991) Wechsler Intelligence Scale for Children 3rd (The Psychological Corporation, San Antonio, TX).

Wernovsky G, Stiles KM, Gauvreau K, Gentles TL, duPlessis AJ, Bellinger DC, et al. (2000) Cognitive development after the Fontan operation. Circulation 102:883–889.

Whittington CJ, Podd J, Kan MM. (2000) Recognition memory impairment in Parkinson's disease: Power and meta-analyses. Neuropsychology 14:233–246.[CrossRef][Web of Science][Medline]

Wray J and Sensky T. (1998) How does the intervention of cardiac surgery affect the self-perception of children with congenital heart disease? Child: Care Health and Development 24:57–72.[CrossRef][Web of Science][Medline]

Wray J and Sensky T. (2001) Congenital heart disease and cardiac surgery in childhood: Effects on cognitive function and academic ability. Heart 85:687–691.[Abstract/Free Full Text]

Wright M and Nolan T. (1994) Impact of cyanotic heart disease on school performance. Archives of Disease in Childhood 71:64–70.[Abstract/Free Full Text]


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?



This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
32/5/527    most recent
jsl047v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Karsdorp, P. A.
Right arrow Articles by Mulder, B. J.M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Karsdorp, P. A.
Right arrow Articles by Mulder, B. J.M.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?