Manual

CAARS 2 Manual

Chapter 3: Scoring and Report Options

Scoring and Report Options

view all chapter tables | print this section

All CAARS 2 forms are scored online using the MHS Online Assessment Center+. This scoring process is accurate (including data verification options [i.e., double-entry option] for paper forms) and efficient (including the automated scoring of reports and management of missing data). It is also quick, including immediate results for online administration and just minutes to enter ratings from paper forms (typically 5 minutes for the full-length CAARS 2, 2 to 3 minutes for the CAARS 2–Short, and less than 1 minute for the CAARS 2–ADHD Index). Online scoring is accessible from any internet-enabled device that meets the technical requirements for the MHS Online Assessment Center+. Users can enable/disable optional features to customize reports. Text from each CAARS 2 report can be saved in PDF or Word format, and relevant sections can be exported into the examiner’s full evaluation report. Once generated, each CAARS 2 report is available to the examiner for up to 7 days for printing or downloading to a secure storage location. The data used to generate CAARS 2 reports are stored for future access, and reports can be regenerated as needed at no cost.

Omitted Responses

Omissions occur when the rater skips or does not provide a response to an item. Omissions can occur deliberately (e.g., the rater decides not to respond to the item) or unintentionally (e.g., the rater missed the item). Unintentional omissions are less likely for online administrations compared to paper administrations because the rater is provided with a pop-up prompt for each item they skip. In the prompt, they are reminded that they have not responded to the item and asked to select a response; however, if they choose not to respond, they can move to the next item. In paper administrations, there may be unclear responses provided by the rater that cannot be scored and therefore are entered as omitted items (e.g., more than one response marked per item, text explanation in place of numeric response, or created an “in-between” response like 2.5).

There is a maximum number of items that can be omitted for each of the CAARS 2 scales. Scores with missing items are prorated when the maximum number of allowable omissions is not exceeded. If the maximum allowable number of omitted responses is exceeded for a given scale, score tables will include a “?” to indicate that the scale could be scored due to too many omitted items. Appendix B provides further information about omitted responses, including the maximum number of allowable omissions per scale. For information on how to handle omitted responses in the interpretation of results, see Step 1: Examine the Response Style section in chapter 4, Interpretation.

Reports

Each usage of the CAARS 2 is accompanied by a Single-Rater Report. This report provides information about the scores of the individual being evaluated, how they compare to other individuals of a similar age (and gender if requested), an option to compare scores to individuals with a confirmed diagnosis of ADHD, and which scores (if any) are elevated compared to the reference sample.

Additional reports will be introduced over the product lifecycle to ensure that client needs are consistently met.

Scoring Options

Examiners can choose from the following scoring options to produce data to suit their individual needs.

Confidence Intervals. The examiner can choose either 90% (default) or 95% confidence intervals to aid in the interpretation of T-scores based on their selected Normative Sample (see appendix C for the relevant confidence intervals for the CAARS 2 ADHD Reference Sample; for guidance on which confidence interval level to select, see appendix E).

Reference Samples. The examiner can choose which reference samples are used for computing an individual’s T-scores, including one Principal Reference Sample (chosen from the three Normative Samples) and up to two Additional Reference Samples (chosen from the two remaining Normative Samples and the three ADHD Samples) to be displayed on the Overview section of the report (see list below; see also chapter 7, Standardization, for a description of the Normative and ADHD Reference Samples).

(a) Normative Samples. The examiner can choose to compare the rated individual’s scores to the following normative groups:
  • Normative Sample–Combined Gender (default)

  • Normative Sample Gender Specific–Males

  • Normative Sample Gender Specific–Females

(b) ADHD Reference Samples (default off). When enabled, the examiner may choose to compare the rated individual’s scores to the following groups of adults with a diagnosis of ADHD:
  • ADHD Reference Sample–Combined Gender

  • ADHD Reference Sample Gender Specific–Males

  • ADHD Reference Sample Gender Specific–Females

Report Options

CAARS 2 users can customize reports by including or excluding various report elements as described below. Tables 3.2, 3.3, and 3.4 describe the various report elements across forms, highlighting which elements are standard (i.e. core elements in every report) and which elements the examiner can choose to include or exclude.

It is essential to note that all CAARS 2 reports contain copyrighted/trade secret information that must not be disclosed to anyone other than qualified users. This Items by Scale section is available in the reports to facilitate interpretation by qualified users. Disclosure of the Items by Scale section is prohibited by law. If disclosure of the report becomes necessary or is required by law, this section must be removed before any such disclosure.

Click to expand

Table 3.2. CAARS 2 (Full-Length) Report Elements

Report Section Content Report Options
Disclosable Report Sections
Cover Sheet

Provides demographic information about the person being evaluated, as well as the rater (in the case of the CAARS 2 Observer). Includes administration details, the selected Reference Sample(s), a cautionary out-of-age range warning (if applicable), a brief description of the report, and a legal disclaimer.

Standard
Overview

Presents all CAARS 2 results, including Response Style Analysis, Associated Clinical Concern Items, CAARS 2 Scales (i.e., Content Scales and DSM Symptom Scales), T-score graph (includes Symptom Counts for the DSM Symptom Scales), ADHD Index probability score graph, Impairment & Functional Outcome Items, and responses to the Additional Questions.

Standard
CAARS 2 Scales

Tables contain raw scores, T-scores with confidence intervals (90% or 95%), percentiles, and guidelines for all CAARS 2 Scales, as well as the number of elevated items for Content Scales, Symptom Counts for the DSM Symptom Scales, and the probability score for the CAARS 2–ADHD Index.

Option to Exclude
Item Responses

Lists all item responses, in order, on a single page. This page, when accompanied by the Cover Sheet, is an acceptable way to comply with requests to provide test data without violating copyright law.

Option to Include
Glossary

Describes the CAARS 2 Scales and scores, as well as the Response Style Analysis, Associated Clinical Concern Items, Impairment & Functional Outcome Items, and Interpretation that provides interpretive guidelines for each score.

Option to Include
Non-Disclosable Report Section
Items by Scale

Provides full item text and item scores, grouped by CAARS 2 scales. For the Content Scales, elevated items are indicated in the Elevation column. For the DSM Symptom Scales, criterion status is indicated by checkmarks.


This section contains test items which are copyrighted/trade secret material. Disclosure of these materials is prohibited by law. In the event that disclosure of the report becomes necessary or is required by law, this section must be removed before any such disclosure.

Option to Exclude
Note. Standard = the section is always part of the report; Option to Exclude = user can choose to omit this element (default = included); Option to Include = user can choose to add this element (default = excluded).
Click to expand

Table 3.3. CAARS 2–Short Report Elements

Report Section Content Report Options
Disclosable Report Sections
Cover Sheet

Provides demographic information about the person being evaluated, as well as the rater (in the case of the CAARS 2 Observer). Includes administration details, the selected Reference Sample(s), a cautionary out-of-age range warning (if applicable), a brief description of the report, and a legal disclaimer.

Standard
Overview

Presents all CAARS 2─Short results, including Response Style Analysis, CAARS 2 Scales (i.e., Content Scales) T-score graph, ADHD Index probability score graph, and responses to the Additional Questions.

Standard
CAARS 2 Scales

Tables contain raw scores; T-scores with confidence intervals, percentiles, and guidelines for all CAARS 2–Short Scales; and the probability score for the CAARS 2–ADHD Index.

Option to Exclude
Item Responses

Lists all item responses, in order, on a single page. This page, when accompanied by the Cover Sheet, is an acceptable way to comply with requests to provide test data without violating copyright law.

Option to Include
Glossary

Describes the CAARS 2–Short scales and scores, as well as the Response Style Analysis and Interpretation that provides interpretive guidelines for each score.

Option to Include
Non-Disclosable Report Section
Items by Scale

Provides full item text and item scores, grouped by CAARS 2–Short scales. Elevated items are indicated in the Elevation column.


This section contains test items which are copyrighted/trade secret material. Disclosure of these materials is prohibited by law. In the event that disclosure of the report becomes necessary or is required by law, this section must be removed before any such disclosure.

Option to Exclude
Note. Standard = the section is always part of the report; Option to Exclude = user can choose to omit this element (default = included); Option to Include = user can choose to add this element (default = excluded).
Click to expand

Table 3.4 CAARS 2–ADHD Index Report Elements

Report Section Content Report Options
Disclosable Report Sections
Cover Sheet

Provides demographic information about the person being evaluated, as well as the rater (in the case of the CAARS 2 Observer). Includes administration details, the selected Reference Sample(s), a cautionary out-of-age range warning (if applicable), a brief description of the report, and a legal disclaimer.

Standard
Overview

Presents the ADHD Index probability score graph and a table that includes the CAARS 2 ADHD Index raw score, probability score, and guidelines for interpreting the ADHD Index score, as well as a table that outlines the different ADHD Index probability score ranges along with the guidelines for interpreting each score range.

Standard
Item Responses

Lists all item responses, in order, on a single page. This page, when accompanied by the Cover Sheet, is an acceptable way to comply with requests to provide test data without violating copyright law.

Option to Include
Non-Disclosable Report Section
Items by Scale

Provides a table that includes full item text and the item score, as well as the rater’s response to each item.


This section contains test items which are copyrighted/trade secret material. Disclosure of these materials is prohibited by law. In the event that disclosure of the report becomes necessary or is required by law, this section must be removed before any such disclosure.

Option to Exclude
Note. Standard = the section is always part of the report; Option to Exclude = user can choose to omit this element (default = included); Option to Include = user can choose to add this element (default = excluded).
< Back Next >