-
Chapter 1: Introduction
-
Chapter 2: Background
-
Chapter 3: Administration and Scoring
-
Chapter 4: Interpretation
-
Chapter 5: Case Studies
-
Chapter 6: Development
-
Chapter 7: Standardization
-
Chapter 8: Reliability
-
Chapter 9: Validity
-
Chapter 10: Fairness
-
Chapter 11: CAARS 2–Short
-
Chapter 12: CAARS 2–ADHD Index
-
Chapter 13: Translations
-
Appendices
CAARS 2 ManualChapter 6: Development, Tables |
Click to expand |
Table 6.1. Demographic Characteristics of the CAARS 2 Self-Report Pilot Study General Population Samples
Demographic | Self-Report |
2010 Census % |
||
N | % | |||
Age (in years) | 18–24 | 77 | 13.9 | –– |
25–34 | 82 | 14.8 | ||
35–44 | 87 | 15.7 | ||
45–54 | 76 | 13.7 | ||
55–64 | 76 | 13.7 | ||
65–74 | 78 | 14.1 | ||
75+ | 79 | 14.2 | ||
Gender | Male | 271 | 48.8 | –– |
Female | 284 | 51.2 | ||
U.S. Race/Ethnicity | Hispanic | 71 | 12.8 | 10.1 |
Black | 52 | 9.4 | 10.0 | |
White | 406 | 73.2 | 73.2 | |
Other | 26 | 4.7 | 6.6 | |
U.S. Region | Northeast | 100 | 18 | 17.8 |
Midwest | 120 | 21.6 | 21.4 | |
South | 203 | 36.6 | 36.0 | |
West | 132 | 23.8 | 22.9 | |
Education Level | High school diploma or lower | 208 | 37.5 | 42.9 |
Some college or associate degree | 187 | 33.7 | 31.6 | |
Bachelor’s degree or higher | 160 | 28.8 | 26.4 | |
Total | 555 | 100.0 | 100.0 |
Click to expand |
Table 6.2. Demographic Characteristics of the CAARS 2 Observer Pilot Study General Population Samples
Demographic | Observer: Rated Individual |
2010 Census % |
Observer: Rater | |||
N | % | N | % | |||
Age (in years) | 18–24 | 70 | 13.8 | –– | 67 | 13.2 |
25–34 | 72 | 14.2 | 77 | 15.2 | ||
35–44 | 74 | 14.6 | 55 | 10.9 | ||
45–54 | 74 | 14.6 | 77 | 15.2 | ||
55–64 | 72 | 14.2 | 93 | 18.4 | ||
65–74 | 72 | 14.2 | 74 | 14.6 | ||
75+ | 72 | 14.2 | 63 | 12.5 | ||
Gender | Male | 243 | 48.0 | –– | 214 | 42.3 |
Female | 263 | 52.0 | 292 | 57.7 | ||
U.S. Race/Ethnicity | Hispanic | 47 | 9.3 | 10.1 | 38 | 7.5 |
Black | 47 | 9.3 | 10.0 | 82 | 16.2 | |
White | 387 | 76.5 | 73.2 | 359 | 170.9 | |
Other | 25 | 4.9 | 6.6 | 27 | 5.3 | |
U.S. Region | Northeast | 91 | 18 | 17.8 | 92 | 18.2 |
Midwest | 117 | 23.1 | 21.4 | 115 | 22.7 | |
South | 182 | 36.0 | 36.0 | 183 | 36.2 | |
West | 116 | 22.9 | 22.9 | 116 | 22.9 | |
Education Level | High school diploma or lower | 200 | 39.5 | 42.9 | 146 | 28.9 |
Some college or associate degree | 154 | 30.4 | 31.6 | 203 | 40.1 | |
Bachelor’s degree or higher | 152 | 27.7 | 26.4 | 157 | 31.0 | |
Relation to individual being rated | Spouse | –– | –– | –– | 148 | 29.2 |
Friend | –– | –– | –– | 121 | 23.9 | |
Other Family Member | –– | –– | –– | 233 | 46.0 | |
Other | –– | –– | –– | 4 | 0.8 | |
Length of relationship | 1–3 years | –– | –– | –– | 23 | 4.5 |
More than 3 years | –– | –– | –– | 483 | 95.5 | |
How well does the rater know the individual being rated? | Moderately Well | –– | –– | –– | 57 | 11.3 |
Very Well | –– | –– | –– | 449 | 88.7 | |
How often does the rater interact with the individual being rated? | Monthly | –– | –– | –– | 55 | 10.9 |
Weekly | –– | –– | –– | 175 | 34.6 | |
Daily | –– | –– | –– | 276 | 54.5 | |
Total | 506 | 100.0 | 100.0 | 506 | 100.0 |
Click to expand |
Table 6.3. Demographic Characteristics of the CAARS 2 Pilot Study Clinical Samples
Demographic | Self-Report |
Observer: Rated Individual |
Observer: Rater |
||||
N | % | N | % | N | % | ||
Age (in years) | 18–24 | 53 | 35.3 | 50 | 40.7 | 16 | 13.0 |
25–34 | 37 | 24.7 | 30 | 24.4 | 32 | 26.0 | |
35–44 | 31 | 20.7 | 26 | 21.1 | 24 | 19.5 | |
45–54 | 20 | 13.3 | 13 | 10.6 | 30 | 24.4 | |
55–64 | 8 | 5.3 | 4 | 3.3 | 16 | 13.0 | |
65+ | 1 | 0.7 | 0 | 0.0 | 5 | 4.1 | |
Gender | Male | 63 | 42.0 | 54 | 43.9 | 34 | 27.6 |
Female | 87 | 58.0 | 69 | 56.1 | 89 | 72.4 | |
Race/Ethnicity | Hispanic | 12 | 8.0 | 5 | 4.1 | 8 | 6.5 |
Black | 5 | 3.3 | 5 | 4.1 | 3 | 2.4 | |
White | 129 | 86.0 | 108 | 87.8 | 106 | 86.2 | |
Other | 4 | 2.7 | 5 | 4.1 | 6 | 4.9 | |
Region | U.S. Northeast | 37 | 24.7 | 36 | 29.3 | 36 | 29.3 |
U.S. Midwest | 23 | 15.3 | 19 | 15.4 | 19 | 15.4 | |
U.S. South | 56 | 37.3 | 43 | 35.0 | 41 | 33.3 | |
U.S. West | 12 | 8.0 | 12 | 9.8 | 14 | 11.4 | |
Canada | 22 | 14.7 | 13 | 10.6 | 13 | 10.6 | |
Education Level | High school diploma or lower | 32 | 21.3 | 25 | 20.3 | 24 | 19.5 |
Some college or associate degree | 51 | 34.0 | 44 | 35.8 | 24 | 19.5 | |
Bachelor’s degree or higher | 67 | 44.7 | 53 | 43.1 | 75 | 61.0 | |
Diagnosis | ADHD Inattentive | 62 | 41.3 | 48 | 39.0 | –– | –– |
ADHD Combined | 56 | 37.3 | 46 | 37.4 | –– | –– | |
Other clinical diagnoses | 32 | 21.3 | 29 | 23.6 | –– | –– | |
Relation to individual being rated | Spouse | –– | –– | –– | –– | 57 | 46.3 |
Friend | –– | –– | –– | –– | 14 | 11.4 | |
Other Family Member | –– | –– | –– | –– | 48 | 39.0 | |
Other | –– | –– | –– | –– | 4 | 3.3 | |
Length of relationship | 1–3 years | –– | –– | –– | –– | 21 | 17.1 |
More than 3 years | –– | –– | –– | –– | 101 | 82.1 | |
How well does the rater know the individual being rated? | Moderately Well | –– | –– | –– | –– | 10 | 8.1 |
Very Well | –– | –– | –– | –– | 113 | 91.9 | |
How often does the rater interact with the individual being rated? | Monthly | –– | –– | –– | –– | 0 | 0.0 |
Weekly | –– | –– | –– | –– | 21 | 17.1 | |
Daily | –– | –– | –– | –– | 102 | 82.9 | |
Total | 150 | 100.0 | 123 | 100.0 | 123 | 100.0 |
Click to expand |
Table 6.4. Demographic Characteristics: CAARS 2 Standardization Phase Self-Report and Observer Total Samples
Demographic | Self-Report |
Observer: Rated Individuals |
Observer: Raters |
||||
N | % | N | % | N | % | ||
Gender | Male | 1,031 | 46.2 | 1,022 | 47.5 | 764 | 35.5 |
Female | 1,190 | 53.3 | 1,125 | 52.3 | 1,386 | 64.4 | |
Other | 11 | 0.5 | 5 | 0.2 | 2 | 0.1 | |
U.S. Race/Ethnicity | Hispanic | 229 | 10.3 | 232 | 10.8 | 238 | 11.1 |
Asian | 92 | 4.1 | 69 | 3.2 | 59 | 2.7 | |
Black | 187 | 8.4 | 200 | 9.3 | 185 | 8.6 | |
White | 1,336 | 59.9 | 1,281 | 59.5 | 1,292 | 60.0 | |
Other | 43 | 1.9 | 41 | 1.9 | 42 | 2.0 | |
Canadian Race/Ethnicity | Not a visible minority | 286 | 12.8 | 262 | 12.2 | 271 | 12.6 |
Visible minority | 59 | 2.6 | 67 | 3.1 | 65 | 3.0 | |
U.S. Region | Northeast | 341 | 15.3 | 337 | 15.7 | 328 | 15.2 |
Midwest | 430 | 19.3 | 417 | 19.4 | 409 | 19.0 | |
South | 710 | 31.8 | 662 | 30.8 | 708 | 32.9 | |
West | 406 | 18.2 | 407 | 18.9 | 371 | 17.2 | |
Canadian Region | Central | 208 | 9.3 | 216 | 10.0 | 224 | 10.4 |
East | 24 | 1.1 | 25 | 1.2 | 25 | 1.2 | |
West | 113 | 5.1 | 88 | 4.1 | 87 | 4.0 | |
Education Level | No high school diploma | 154 | 6.9 | 173 | 8.0 | 68 | 3.2 |
High school diploma/GED | 559 | 25.0 | 624 | 29.0 | 509 | 23.7 | |
Some college or associate degree | 758 | 34.0 | 666 | 30.9 | 809 | 37.6 | |
Bachelor’s degree or higher | 473 | 21.2 | 418 | 19.4 | 520 | 24.2 | |
Graduate or professional degree | 288 | 12.9 | 271 | 12.6 | 246 | 11.4 | |
Diagnosis | ADHD Inattentive | 114 | 5.1 | 65 | 3.0 | –– | –– |
ADHD Hyperactive/Impulsive | 10 | 0.4 | 9 | 0.4 | –– | –– | |
ADHD Combined | 131 | 5.9 | 96 | 4.5 | –– | –– | |
Other clinical diagnoses | 184 | 8.2 | 145 | 6.7 | –– | –– | |
No Diagnosis | 1,793 | 80.3 | 1,837 | 85.4 | –– | –– | |
Relation to individual being rated | Spouse | –– | –– | –– | –– | 620 | 28.8 |
Friend | –– | –– | –– | –– | 530 | 24.6 | |
Other Family Member | –– | –– | –– | –– | 975 | 45.3 | |
Other | –– | –– | –– | –– | 27 | 1.3 | |
Length of relationship | 1–5 months | –– | –– | –– | –– | 14 | 0.7 |
6–11 months | –– | –– | –– | –– | 16 | 0.7 | |
1–3 years | –– | –– | –– | –– | 140 | 6.5 | |
More than 3 years | –– | –– | –– | –– | 1,982 | 92.1 | |
How well does the rater know the individual being rated? | Moderately Well | –– | –– | –– | –– | 141 | 6.6 |
Very Well | –– | –– | –– | –– | 2,011 | 93.4 | |
How often does the rater interact with the individual being rated? | Monthly | –– | –– | –– | –– | 150 | 7.0 |
Weekly | –– | –– | –– | –– | 608 | 28.3 | |
Daily | –– | –– | –– | –– | 1,394 | 64.8 | |
Age in years M (SD) | 47.5 (19.3) | 47.7 (19.7) | 43.8 (15.8) | ||||
Total N | 2,232 | 2,152 | 2,152 |
Click to expand |
Table 6.5. Classification Accuracy Statistics: CAARS 2 Self-Report and Observer
Classification Accuracy Statistic | Self-Report | Observer | ||||
Fake ADHD vs. Honest Responders |
Fake ADHD vs. Genuine ADHD |
Fake Bad vs. Honest Responders |
Fake ADHD vs. Honest Responders |
Fake ADHD vs. Genuine ADHD |
Fake Bad vs. Honest Responders |
|
Overall Correct Classification (%) | 94.7 | 82.6 | 95.5 | 94.3 | 79.9 | 95.6 |
Sensitivity (%) | 59.0 | 59.0 | 79.4 | 53.2 | 53.2 | 85.1 |
Specificity (%) | 96.3 | 91.8 | 96.3 | 96.1 | 94.7 | 96.1 |
Positive Predictive Value (%) | 41.3 | 73.8 | 49.1 | 37.0 | 84.7 | 48.5 |
Negative Predictive Value (%) | 98.1 | 85.1 | 99.0 | 97.9 | 78.5 | 99.3 |
Kappa | .46 | .54 | .58 | .41 | .52 | .60 |
Click to expand |
Table 6.6. Classification Accuracy Statistics: CAARS 2 Self-Report and Observer Negative Impression Index Validation Study
Classification Accuracy Statistic | Self-Report | Observer | ||
Fake ADHD vs. Honest Responders |
Fake ADHD vs. Genuine ADHD |
Fake ADHD vs. Honest Responders |
Fake ADHD vs. Genuine ADHD |
|
Overall Correct Classification (%) | 94.9 | 84.7 | 91.4 | 75.8 |
Sensitivity (%) | 68.5 | 68.5 | 42.6 | 44.7 |
Specificity (%) | 96.3 | 91.8 | 96.1 | 94.7 |
Positive Predictive Value (%) | 47.5 | 78.4 | 50.6 | 83.6 |
Negative Predictive Value (%) | 98.4 | 87.0 | 94.6 | 73.9 |
Kappa | .54 | .63 | .42 | .43 |
Click to expand |
Table 6.7. Classification Accuracy Adjusted for Base Rate: CAARS 2 Negative Impression Index
Base Rate | Self-Report | Observer | ||||||
Fake ADHD vs. Honest Responders |
Fake ADHD vs. Genuine ADHD |
Fake ADHD vs. Honest Responders |
Fake ADHD vs. Genuine ADHD |
|||||
PPV (%) | NPV (%) | PPV (%) | NPV (%) | PPV (%) | NPV (%) | PPV (%) | NPV (%) | |
10% Base Rate | 62.5 | 93.6 | 59.0 | 91.8 | 62.8 | 89.5 | 66.8 | 91.0 |
60% Base Rate | 90.9 | 70.8 | 89.6 | 65.1 | 91.0 | 58.8 | 92.3 | 62.8 |
70% Base Rate | 92.1 | 67.5 | 91.0 | 61.5 | 92.2 | 55.0 | 93.4 | 59.1 |
80% Base Rate | 93.0 | 64.5 | 92.0 | 58.3 | 93.1 | 51.7 | 94.1 | 55.8 |
Click to expand |
Table 6.8. Classification Accuracy Statistics: CAARS 2 Inconsistency Index
Classification Accuracy Statistics | Self-Report | Observer |
Overall Correct Classification (%) | 87.1 | 87.9 |
Sensitivity (%) | 81.5 | 81.5 |
Specificity (%) | 93.8 | 95.0 |
Positive Predictive Power (%) | 94.1 | 94.8 |
Negative Predictive Power (%) | 80.7 | 82.3 |
Kappa | .74 | .76 |