273347 Future of Mental Health Measurement

Monday, October 29, 2012 : 4:30 PM - 4:50 PM

Robert Gibbons, PhD , Center for Health Statistics, University of Chicago, Chicago, IL
Mental health measurement is based primarily on subjective judgment and classical test theory. Typically, impairment level is determined by a total score, requiring that all respondents be administered the same items. An alternative to full scale administration is adaptive testing in which different individuals may receive different scale items that are targeted to their specific impairment level. This approach to testing is referred to as computerized adaptive testing (CAT) and is immediately applicable to mental health measurement problems. The net result is that an individual is administered a small, optimal number of items from a much larger “bank” of items, without loss of measurement precision. Rather than fixing the number of items and allowing measurement precision to vary, we fix measurement precision and allow the items to vary. The statistical contribution is the development of CAT based on multidimensional item response theory (IRT), which is necessary to incorporate the multidimensionality of mental health constructs. The methodology is illustrated using the recently developed CAT-Depression Inventory (CAT-DI) which requires an average of 12 items but maintains a correlation of r=0.95 with the entire 400 “item bank” score. Sensitivity of 0.92 and specificity of 0.88 are obtained for predicting a clinician-based DSM diagnosis of major depressive disorder. Applications in the areas of screening depression in primary care, child psychiatry, global health, randomized controlled trials, molecular genetics, and psychiatric epidemiology are described.

Learning Areas:
Social and behavioral sciences

Learning Objectives:
1. Describe item response theory and the bi-factor model 2. Describe computerized adaptive testing 3. Discuss improved mental health measurement

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I have studied biostatistics, environmental statistics, and psychometrics over 30 years. Over the years, my interests have included non-linear mixed-effects models, item response theory, environmental regulatory statistics, laboratory calibration, and statistical issues in health services research.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.