Manual

CAARS 2 Manual

Chapter 7: Description of ADHD Reference Sample


Description of ADHD Reference Sample

Demographic Characteristics of the ADHD Reference Sample

The following section describes features of the individuals with ADHD being rated as part of the ADHD Reference Sample (i.e., those completing the Self-Report form and those being rated by Observers). Information about observers providing ratings about these individuals with ADHD can be found in appendix J.

A total of 425 individuals were included in the ADHD Combined Gender Reference Sample (N = 255 for Self-Report and N = 170 for Observer1). Whereas the purpose of the Normative Sample is to enable interpretation of an individual’s results relative to what is typical in the general population, the purpose of the ADHD Reference Sample is to facilitate clinical decision-making by enabling comparisons to results that are typical of individuals diagnosed with ADHD (see Clinical Group Differences in chapter 9, Validity, for details on distinct score profiles within the ADHD Reference Sample). The ADHD Reference Sample consists of individuals from a clinical population who had been previously diagnosed with one of the three DSM ADHD presentations (i.e., Predominantly Inattentive, Predominantly Hyperactive/Impulsive, or Combined; note however that the sample for Predominantly Hyperactive/Impulsive is relatively small, which reflects the rarity of this diagnosis in practice for adults). Table 7.11 displays the distribution of gender by age group within the Combined Gender ADHD Reference Sample and Table 7.12 summarizes key demographic characteristics of the Combined Gender ADHD Reference Sample. Though the sample sizes are modest when divided by age group, continuous norming methodology was applied to allow for the conversion of raw scores to T-scores (see Standardization Procedures in this chapter).

The majority of rated individuals in the ADHD Reference Sample were married (51.0% Self-Report, 55.3% Observer), followed by individuals who were single (38.0% Self-Report, 36.5% Observer); the remaining individuals were separated, divorced, or widowed. A substantial portion of the rated individuals were employed full-time (47.1% Self-Report, 47.1% Observer); the rest were employed part-time (24.3% Self-Report, 23.5% Observer), were unemployed (20.4% Self-Report, 23.5% Observer), were retired (3.1% Self-Report, 3.5% Observer), or indicated some other employment status. Nearly one quarter of rated individuals were currently enrolled as students (24.0% Self-Report, 24.7% Observer). A large percentage of the rated individuals spoke only English (79.6% Self-Report, 83.5% Observer); the remaining individuals were multilingual (i.e., they spoke English and other language[s]).

Click to expand

Table 7.11. Gender × Age Group of the Rated Individuals: CAARS 2 Combined Gender ADHD Reference Samples

Age Group Self-Report Observer
Female Male Other Female Male Other
18-24 27 28 1 19 22 1
25-29 20 17 1 13 9 1
30-39 33 41 0 21 32 0
40-49 26 20 0 15 14 0
50-59 11 16 0 8 7 0
60+ 7 7 0 4 3 0
Total 124 129 2 80 87 2
Note. Due to the sparse data for older age ranges, 60–69 years old and 70+ years old were collapsed into a single group (60+ years).

Treatment Status of the ADHD Reference Sample

Raters in the ADHD Reference Sample were asked to report the mental health treatment status of the person being rated (including medication and/or psychosocial treatments). The majority of those rated were receiving at least one form of treatment (83.1% for Self-Report, 77.5% for Observer).

For the Self-Report sample, 79.3% reported taking medication for psychological/psychiatric conditions; 75.3% of the Observer sample reported that the individual being rated was taking medication (see Table 7.13 and 7.14). Medications included those often prescribed for ADHD (both stimulant and non-stimulant varieties), as well as medications indicated for treating various co-occurring diagnoses (such as mood stabilizers and anti-anxiety medications). Over half of the individuals rated in the ADHD Reference Sample indicated medication only (i.e., no other current treatment; 57.2% Self-Report; 58.1% Observer). For those receiving non-pharmacological treatment, the most common treatment reported was individual psychological therapy (31.4% Self-Report 27.9% Observer), followed by “Other” (8.7% Self-Report; 10.6% Observer). Other forms of treatment that were specified included mindfulness training or meditation, trauma therapy, and couples’ therapy. See Table 7.13 and Table 7.14 for a summary of the forms of treatments that were reported in the Combined Gender and Gender Specific ADHD Reference Samples, respectively.

Click to expand

Table 7.13. Treatment Status of the Rated Individuals: CAARS 2 Combined Gender ADHD Reference Samples

Treatment Type Self-Report Observer
N % N %
Medication 202 79.3 128 75.3
Group Therapy 4 1.5 3 1.7
Psychological Therapy 83 31.4 50 27.9
Occupational Therapy 1 0.4 1 0.6
Speech Therapy 0 0.0 0 0.0
Special Education 2 0.8 2 1.1
Other Treatment 23 8.7 19 10.6
No Treatment 43 16.8 38 22.4
Total 255 100.0 170 100.0
Note. The total number of cases is less than the sum of cases across treatment types because respondents were instructed to select all applicable types of treatment. Selections were not mutually exclusive as clients could be receiving multiple forms of treatment concurrently.
Click to expand

Table 7.14. Treatment Status of the Rated Individuals: CAARS 2 Gender Specific ADHD Reference Samples

Treatment Type Self-Report Observer
Female Male Female Male
N % N % N % N %
Medication 103 83.1 89 69.0 65 80.2 51 58.6
Group Therapy 2 1.5 2 1.5 3 3.5 0 0.0
Psychological Therapy 37 28.5 46 34.1 24 28.2 26 28.3
Occupational Therapy 1 0.8 0 0.0 1 1.2 0 0.0
Speech Therapy 0 0.0 0 0.0 0 0.0 0 0.0
Special Education 0 0.0 2 1.5 0 0.0 2 2.2
Other Treatment 14 10.8 9 6.7 9 10.6 10 10.9
No Treatment 76 58.5 76 56.3 48 56.5 54 58.7
Total 124 100.0 129 100.0 81 100.0 87 100.0
Note. The total number of cases is less than the sum of cases across treatment types because respondents were instructed to select all applicable types of treatment. Selections were not mutually exclusive as clients could be receiving multiple forms of treatment concurrently.

All respondents who indicated that the individual being rated was taking medication were instructed to complete the CAARS 2 based on the person’s functioning when not taking medication or when the medication has worn off. At the end of the assessment, these respondents were asked to confirm that they followed the instructions by answering items while thinking about the off-medication status of the individual being rated. The majority of raters (82.4% Self-Report; 70.3% Observer) describing someone taking medication were consistent in their mindset, reporting at the end of the rating scale that they answered the questions as instructed (i.e., while thinking about the individual being rated when “off their medication”).

Effect sizes (as measured by Cliff’s d; Cliff, 1993) were used to consider whether medication use impacted ratings and scores for the CAARS; however, no meaningful differences were observed. First, results for the medicated group were examined. Specifically, scores were compared between those who reported following the instructions to think about the person being rated when not taking medication versus those who reported that they rated the individual as if they were taking medication or combined observations across on/off medication status (i.e., contrary to instructions). No meaningful differences were found between these two groups (effects were negligible to small; see Table 7.15). Next, results were compared between those not taking medication and those taking medication. Scale-level differences ranged from trivial to small effect sizes across all groupings for Self-Report and Observer (see Table 7.15). Considering the absence of meaningful group differences, all subsequent analyses were conducted on the full ADHD Reference Sample.

Click to expand

Table 7.15. Differences in Scale Scores × Medication Use by the Rated Individuals: CAARS 2 ADHD Reference Samples

Scale Answered Thinking About Off vs. On Medication Not Taking Medication vs. Taking Medication
Self-Report Observer Self-Report Observer
Content Scales Inattention/Executive Dysfunction -.22 .02 -.22 -.22
Hyperactivity -.08 .19 -.08 -.08
Impulsivity -.14 .20 -.14 -.14
Emotional Dysregulation -.09 -.05 -.09 -.09
Negative Self-Concept -.09 -.11 -.09 -.09
DSM Symptom Scales ADHD Inattentive -.12 .20 -.12 -.12
ADHD Hyperactive/Impulsive -.17 .08 -.17 -.17
Total ADHD Symptoms -.15 .16 -.15 -.15
Note. Values reported are Cliff's delta effect size estimates for group differences. Guidelines for interpreting Cliff's |d|: negligible effect size < .15; small effect size = .15 to .32; medium effect size = .33 to .46; large effect size ≥ .47. A positive Cliff's d value indicates that the group listed first in the heading provided higher ratings than the group listed second (i.e., indicating higher levels of the symptoms in that category).

1 The majority (71.8%) of the Observer reports in the ADHD Reference Sample also had matching Self-Report data. See Inter-Rater Reliability in chapter 8, Reliability, for information on consistency between Self-Report and Observer ratings on the CAARS 2.

< Back Next >