Manual

CAARS 2 Manual

Chapter 8: Reliability, Tables

print this section

Click to expand

Table 8.1a. Internal Consistency and Standard Error of Content Scales: CAARS 2 Self-Report Normative Samples

Scale Number of Items Age Group Combined Gender Male Female
N α ω SEM N α ω SEM N α ω SEM
Inattention/​Executive Dysfunction 30 18-24 110 .97 .97 1.70 55 .97 .97 1.67 55 .97 .97 1.73
25-29 110 .98 .98 1.46 55 .98 .98 1.55 55 .98 .98 1.33
30-39 220 .98 .98 1.53 110 .98 .98 1.50 110 .98 .98 1.54
40-49 220 .98 .98 1.36 110 .98 .98 1.40 110 .98 .98 1.30
50-59 220 .98 .98 1.50 110 .98 .98 1.54 110 .98 .98 1.39
60-69 220 .98 .98 1.53 110 .97 .97 1.69 110 .98 .98 1.36
70+ 220 .97 .97 1.82 94 .97 .97 1.74 126 .96 .96 1.93
Hyperactivity 13 18-24 110 .93 .93 2.62 55 .91 .92 2.88 55 .94 .94 2.42
25-29 110 .94 .94 2.39 55 .94 .95 2.33 55 .94 .95 2.32
30-39 220 .93 .93 2.71 110 .92 .93 2.72 110 .93 .93 2.57
40-49 220 .93 .93 2.61 110 .92 .92 2.80 110 .94 .94 2.37
50-59 220 .93 .93 2.60 110 .91 .92 2.90 110 .95 .95 2.24
60-69 220 .93 .93 2.62 110 .92 .92 2.76 110 .94 .94 2.47
70+ 220 .91 .91 2.99 94 .91 .92 2.89 126 .90 .91 3.06
Impulsivity 13 18-24 110 .91 .91 2.95 55 .91 .92 2.91 55 .91 .91 2.94
25-29 110 .92 .92 2.81 55 .90 .90 3.10 55 .93 .94 2.53
30-39 220 .91 .92 2.91 110 .91 .91 2.96 110 .91 .91 2.95
40-49 220 .91 .91 2.97 110 .90 .90 3.09 110 .92 .92 2.77
50-59 220 .91 .91 3.02 110 .89 .89 3.25 110 .92 .92 2.76
60-69 220 .93 .93 2.69 110 .91 .91 3.01 110 .94 .94 2.35
70+ 220 .90 .91 3.07 94 .90 .91 3.00 126 .90 .90 3.16
Emotional Dysregulation 9 18-24 110 .93 .93 2.63 55 .94 .94 2.35 55 .91 .92 2.91
25-29 110 .91 .91 3.00 55 .91 .91 2.94 55 .91 .91 2.95
30-39 220 .93 .93 2.58 110 .94 .94 2.50 110 .93 .93 2.62
40-49 220 .94 .94 2.45 110 .93 .93 2.67 110 .95 .95 2.16
50-59 220 .92 .92 2.81 110 .90 .90 3.11 110 .94 .94 2.44
60-69 220 .94 .94 2.43 110 .92 .92 2.86 110 .96 .96 2.00
70+ 220 .91 .92 2.91 94 .93 .93 2.62 126 .90 .90 3.11
Negative Self-Concept 7 18-24 110 .91 .91 2.98 55 .88 .89 3.37 55 .92 .92 2.84
25-29 110 .92 .93 2.69 55 .91 .92 2.90 55 .94 .94 2.36
30-39 220 .94 .94 2.50 110 .93 .94 2.54 110 .94 .94 2.43
40-49 220 .93 .94 2.52 110 .93 .94 2.52 110 .94 .94 2.45
50-59 220 .92 .92 2.82 110 .92 .92 2.76 110 .92 .93 2.72
60-69 220 .92 .92 2.78 110 .88 .9 3.23 110 .94 .95 2.32
70+ 220 .86 .87 3.62 94 .88 .89 3.31 126 .84 .84 3.99
Note. α = alpha; ω = omega; SEM = standard error of measurement.
Click to expand

Table 8.1b. Internal Consistency and Standard Error of DSM Symptom Scales: CAARS 2 Self-Report Normative Samples

Scale Number of Items Age Group Combined Gender Male Female
N α ω SEM N α ω SEM N α ω SEM
ADHD Inattentive Symptoms 11 18-24 110 .95 .95 2.30 55 .94 .94 2.37 55 .95 .95 2.22
25-29 110 .96 .96 2.03 55 .95 .95 2.27 55 .97 .97 1.68
30-39 220 .95 .95 2.16 110 .96 .96 2.10 110 .95 .95 2.23
40-49 220 .96 .96 2.07 110 .95 .95 2.17 110 .96 .96 1.93
50-59 220 .95 .95 2.17 110 .95 .96 2.11 110 .95 .96 2.11
60-69 220 .95 .95 2.19 110 .95 .95 2.32 110 .96 .96 2.03
70+ 220 .94 .94 2.53 94 .94 .95 2.34 126 .92 .93 2.72
ADHD Hyperactive/​Impulsive Symptoms 12 18-24 110 .92 .92 2.85 55 .90 .90 3.16 55 .93 .93 2.66
25-29 110 .93 .93 2.60 55 .93 .93 2.57 55 .93 .94 2.50
30-39 220 .91 .92 2.88 110 .91 .92 2.88 110 .92 .92 2.78
40-49 220 .92 .92 2.87 110 .91 .91 3.03 110 .93 .93 2.57
50-59 220 .92 .92 2.76 110 .91 .91 2.99 110 .94 .94 2.43
60-69 220 .92 .92 2.79 110 .90 .91 3.06 110 .94 .94 2.51
70+ 220 .91 .91 3.02 94 .92 .92 2.83 126 .90 .90 3.19
Total ADHD Symptoms 23 18-24 110 .96 .96 2.00 55 .95 .95 2.14 55 .96 .96 1.91
25-29 110 .97 .97 1.74 55 .97 .97 1.82 55 .97 .97 1.59
30-39 220 .96 .96 1.99 110 .96 .96 1.95 110 .96 .96 2.03
40-49 220 .96 .96 1.95 110 .96 .96 2.08 110 .97 .97 1.74
50-59 220 .96 .96 1.99 110 .95 .96 2.10 110 .97 .97 1.79
60-69 220 .96 .96 1.94 110 .95 .96 2.10 110 .97 .97 1.77
70+ 220 .95 .95 2.23 94 .96 .96 2.00 126 .94 .94 2.49
Note. α = alpha; ω = omega; SEM = standard error of measurement.
Click to expand

Table 8.2a. Internal Consistency and Standard Error of Content Scales: CAARS 2 Observer Normative Samples

Scale Number of Items Age Group Combined Gender Male Female
N α ω SEM N α ω SEM N α ω SEM
Inattention/​Executive Dysfunction 30 18-24 110 .97 .97 1.60 55 .97 .97 1.65 55 .98 .98 1.53
25-29 110 .98 .98 1.34 55 .98 .98 1.42 55 .95 .95 2.21
30-39 220 .98 .98 1.27 110 .99 .99 1.17 110 .98 .98 1.37
40-49 220 .98 .98 1.35 110 .98 .98 1.26 110 .98 .98 1.44
50-59 220 .98 .98 1.40 110 .98 .98 1.28 110 .98 .98 1.49
60-69 220 .98 .98 1.56 110 .98 .98 1.55 110 .97 .97 1.66
70+ 220 .97 .97 1.66 94 .97 .97 1.68 126 .97 .97 1.63
Hyperactivity 13 18-24 110 .94 .94 2.40 55 .92 .93 2.70 55 .95 .96 2.12
25-29 110 .96 .96 2.08 55 .95 .95 2.15 55 .87 .87 3.57
30-39 220 .95 .95 2.12 110 .95 .95 2.15 110 .96 .96 2.04
40-49 220 .95 .95 2.30 110 .95 .95 2.27 110 .94 .94 2.37
50-59 220 .94 .94 2.38 110 .94 .94 2.45 110 .95 .95 2.28
60-69 220 .94 .94 2.40 110 .94 .94 2.47 110 .94 .94 2.41
70+ 220 .93 .93 2.58 94 .90 .91 3.04 126 .94 .95 2.34
Impulsivity 13 18-24 110 .93 .93 2.61 55 .91 .91 2.94 55 .94 .95 2.32
25-29 110 .94 .94 2.38 55 .93 .93 2.61 55 .95 .95 2.15
30-39 220 .95 .95 2.23 110 .95 .95 2.15 110 .95 .95 2.30
40-49 220 .94 .94 2.50 110 .93 .94 2.51 110 .94 .94 2.49
50-59 220 .94 .95 2.31 110 .95 .96 2.11 110 .93 .94 2.50
60-69 220 .93 .93 2.63 110 .93 .93 2.63 110 .92 .93 2.68
70+ 220 .93 .93 2.57 94 .92 .93 2.71 126 .93 .94 2.48
Emotional Dysregulation 9 18-24 110 .93 .93 2.56 55 .93 .93 2.66 55 .93 .94 2.47
25-29 110 .94 .94 2.36 55 .94 .94 2.38 55 .95 .95 2.27
30-39 220 .94 .94 2.42 110 .95 .95 2.24 110 .94 .94 2.52
40-49 220 .95 .95 2.14 110 .95 .96 2.12 110 .95 .96 2.11
50-59 220 .96 .96 1.89 110 .96 .97 1.85 110 .96 .96 1.90
60-69 220 .94 .94 2.40 110 .94 .94 2.41 110 .94 .94 2.48
70+ 220 .94 .94 2.42 94 .94 .94 2.38 126 .94 .94 2.44
Negative Self-Concept 7 18-24 110 .91 .91 2.98 55 .89 .90 3.19 55 .91 .92 2.91
25-29 110 .92 .92 2.76 55 .91 .92 2.91 55 .93 .94 2.51
30-39 220 .93 .93 2.67 110 .93 .93 2.66 110 .93 .93 2.67
40-49 220 .92 .93 2.71 110 .93 .93 2.67 110 .92 .93 2.70
50-59 220 .90 .90 3.14 110 .85 .86 3.74 110 .91 .92 2.87
60-69 220 .92 .92 2.76 110 .92 .92 2.79 110 .93 .93 2.65
70+ 220 .89 .90 3.19 94 .92 .93 2.66 126 .86 .86 3.69
Note. α = alpha; ω = omega; SEM = standard error of measurement.
Click to expand

Table 8.2b. Internal Consistency and Standard Error of DSM Symptom Scales: CAARS 2 Observer Normative Samples

Scale Number of Items Age Group Combined Gender Male Female
N α ω SEM N α ω SEM N α ω SEM
ADHD Inattentive Symptoms 11 18-24 110 .95 .95 2.29 55 .94 .94 2.40 55 .95 .95 2.19
25-29 110 .96 .96 2.06 55 .96 .96 2.01 55 .96 .96 2.06
30-39 220 .97 .97 1.83 110 .97 .97 1.61 110 .96 .96 2.05
40-49 220 .96 .97 1.86 110 .97 .97 1.84 110 .96 .96 1.88
50-59 220 .96 .96 1.93 110 .97 .97 1.79 110 .96 .96 2.04
60-69 220 .95 .95 2.24 110 .95 .95 2.14 110 .94 .94 2.49
70+ 220 .95 .95 2.24 94 .95 .95 2.19 126 .95 .95 2.27
ADHD Hyperactive/​Impulsive Symptoms 12 18-24 110 .94 .94 2.48 55 .91 .91 2.95 55 .96 .96 2.09
25-29 110 .95 .95 2.19 55 .94 .94 2.36 55 .85 .87 3.67
30-39 220 .95 .95 2.14 110 .95 .95 2.17 110 .96 .96 2.10
40-49 220 .95 .95 2.25 110 .95 .95 2.18 110 .94 .94 2.41
50-59 220 .94 .94 2.44 110 .94 .94 2.43 110 .94 .94 2.37
60-69 220 .93 .93 2.57 110 .93 .93 2.64 110 .93 .93 2.58
70+ 220 .93 .94 2.50 94 .92 .92 2.82 126 .94 .95 2.34
Total ADHD Symptoms 23 18-24 110 .96 .97 1.85 55 .95 .96 2.07 55 .97 .97 1.66
25-29 110 .97 .97 1.68 55 .97 .97 1.72 55 .89 .90 3.19
30-39 220 .98 .98 1.56 110 .98 .98 1.50 110 .97 .97 1.62
40-49 220 .97 .97 1.65 110 .97 .97 1.61 110 .97 .97 1.71
50-59 220 .97 .97 1.75 110 .97 .97 1.68 110 .97 .97 1.78
60-69 220 .96 .96 1.90 110 .96 .96 1.90 110 .96 .96 2.00
70+ 220 .96 .96 1.97 94 .96 .96 2.08 126 .96 .96 1.90
Note. α = alpha; ω = omega; SEM = standard error of measurement.
Click to expand
Click to expand
Click to expand
Click to expand

Table 8.6. Test-Retest Reliability: CAARS 2 Observer

Scale Obtained r Corrected r Time 1 Time 2 Cohen’s d
M Mdn SD M Mdn SD
Content Scales Inattention/​Executive Dysfunction .87 .90 49.7 48 9.1 49.1 48 9.2 -0.07
Hyperactivity .88 .84 48.9 45 10.6 49.0 44 11.1 0.02
Impulsivity .79 .83 49.3 47 9.3 49.1 47 9.2 -0.03
Emotional Dysregulation .81 .82 49.5 48 10.0 48.8 47 9.7 -0.07
Negative Self-Concept .86 .84 49.6 47 10.4 49.9 48 10.7 0.02
DSM Symptom Scales ADHD Inattentive Symptoms .87 .91 49.8 47 9.0 49.5 47 9.0 -0.04
ADHD Hyperactive/​Impulsive Symptoms .87 .84 48.9 45 10.5 49.1 45 10.9 0.02
Total ADHD Symptoms .89 .90 49.2 46 9.9 49.1 47 9.8 0.00
Note. N = 61. Time between administrations = 2 to 4 weeks (14 to 30 days). All correlations significant, p < .001. Guidelines for interpreting |r|: very weak < .20, weak = .20 to .39, moderate = .40 to .59, strong = .60 to .79, very strong ≥ .80. Guidelines for interpreting Cohen’s |d|: negligible effect size < 0.20; small effect size = 0.20 to 0.49; medium effect size = 0.50 to 0.79; large effect size ≥ 0.80. Positive d-ratio values indicate higher scores at Time 2 than Time 1.
Click to expand

Table 8.7. Inter-Rater Reliability Study 1 (Two Observers, Same Rater Type): CAARS 2

Scale Obtained r Corrected r p Rater 1 Rater 2 Cohen’s d
M Mdn SD M Mdn SD
Content Scales Inattention/​Executive Dysfunction .70 .70 < .001 59.9 60 10.2 61.0 61 9.8 0.11
Hyperactivity .59 .45 .019 55.1 53 12.0 58.2 57 12.2 0.26
Impulsivity .55 .40 .039 56.1 55 12.5 54.8 51 12.1 -0.11
Emotional Dysregulation .84 .64 < .001 57.7 57 13.3 56.9 53 13.8 -0.06
Negative Self-Concept .76 .59 .001 60.3 61 13.3 61.3 61 12.2 0.08
DSM Symptom Scales ADHD Inattentive Symptoms .62 .59 .001 59.5 59 10.6 60.3 60 10.1 0.07
ADHD Hyperactive/​Impulsive Symptoms .53 .40 .039 55.1 52 11.7 57.0 55 12.2 0.16
Total ADHD Symptoms .61 .49 .010 57.9 54 10.5 59.3 56 10.7 0.13
Note. N = 29. Reported p-values are for corrected r. Guidelines for interpreting |r|: very weak < .20, weak = .20 to .39, moderate = .40 to .59, strong = .60 to .79, very strong ≥ .80. Guidelines for interpreting Cohen’s |d|: negligible effect size < 0.20; small effect size = 0.20 to 0.49; medium effect size = 0.50 to 0.79; large effect size ≥ 0.80.
Click to expand

Table 8.8. Inter-Rater Reliability Study 2 (Different Rater Types: Self-Report and Observer): CAARS 2

Scale Obtained r Corrected r Self-Report Observer Cohen’s d
M Mdn SD M Mdn SD
Content Scales Inattention/​Executive Dysfunction .59 .46 65.5 67 11.8 62.8 62 11.7 -0.23
Hyperactivity .54 .37 61.5 61 12.8 57.8 56 12.5 -0.29
Impulsivity .53 .39 61.8 62 12.4 56.0 55 11.8 -0.47
Emotional Dysregulation .54 .44 59.4 61 11.6 57.5 57 11.3 -0.17
Negative Self-Concept .56 .45 60.3 61 10.5 63.2 63 12.7 0.26
DSM Symptom Scales ADHD Inattentive Symptoms .57 .44 64.8 65 11.7 62.7 63 12 -0.18
ADHD Hyperactive/​Impulsive Symptoms .55 .37 62.3 63 13.3 57.4 55 12.1 -0.38
Total ADHD Symptoms .57 .45 64.4 65 12.1 60.7 61 11.3 -0.31
Note. N = 211. All correlations significant at p < .001. Guidelines for interpreting |r|: very weak < .20, weak = .20 to .39, moderate = .40 to .59, strong = .60 to .79, very strong ≥ .80. Guidelines for interpreting Cohen’s |d|: negligible effect size < 0.20; small effect size = 0.20 to 0.49; medium effect size = 0.50 to 0.79; large effect size ≥ 0.80. Positive d-ratio values indicate higher scores for the Observer than Self-Report.
Click to expand

Table 8.9. Inter-Rater Reliability Study 2 (Different Rater Types: Two Types of Observers): CAARS 2

Scale Obtained r Corrected r p Observer 1 Observer 2 Cohen’s d
M Mdn SD M Mdn SD
Content Scales Inattention/​Executive Dysfunction .69 .58 < .001 58.9 59 11.9 61.2 60 11.3 0.20
Hyperactivity .43 .26 .080 56.5 54 12.7 59.3 56 13.6 0.21
Impulsivity .51 .38 .011 55.4 53 11.5 57.1 54 12.6 0.14
Emotional Dysregulation .64 .46 .002 57.2 55 12.3 60.9 59 13.1 0.29
Negative Self-Concept .63 .49 < .001 58.5 57 11.7 60.1 59 12.3 0.13
DSM Symptom Scales ADHD Inattentive Symptoms .62 .50 < .001 58.6 56 12.0 61.2 61 11.3 0.22
ADHD Hyperactive/​Impulsive Symptoms .44 .29 .054 56.3 52 12.7 58.4 55 12.7 0.17
Total ADHD Symptoms .53 .44 .003 57.9 57 11.6 60.5 61 11.1 0.23
Note. N = 47. All obtained correlations significant at p < .01; p-values in table above refer to the corrected correlation coefficients. Guidelines for interpreting |r|: very weak < .20, weak = .20 to .39, moderate = .40 to .59, strong = .60 to .79, very strong ≥ .80. Guidelines for interpreting Cohen’s |d|: negligible effect size < 0.20; small effect size = 0.20 to 0.49; medium effect size = 0.50 to 0.79; large effect size ≥ 0.80. Positive d-ratio values indicate higher scores for the Observer 2 than Observer 1.