VALIDATION DATA

MEASUREMENT PROPERTIES
Limitations English only
Observations
1. RELIABILITY
A. Internal Consistency Not Tested
Cronbach's (Describe)
B. Reliability intraobserver or test-retest Tested
Continuous scores: intraclass
correlation coefficient (ICC)
Dichotomus: Cohen kappa (Describe)

Kendall’s tau – three different recall periods:

2 weeks 0.66

3 months 0.75

12 months 0.72

C. Reliability interobserver or Measurement error Not Tested
Standard error of measurement (SEM),
smallest detectable change (SDC) or
Limits of agreement (LoA) (Describe)
2. VALIDITY
A. Content validity: face validity Tested
Expert opinion (relevance and
comprehensiveness) (Describe)

Pretest at large company

Includes 15 conditions based on informal consultations with employers, physician, and brief literature review

 

Prevalence and cost-ranking compared to the NHIS provides good evidence for its content validity

B. Construct Validity:
Structural validity
Not Tested
Hypotheses-testing Not Tested
Cross-cultural validity Not Tested
Brief Description
C. Criterion validity Tested
Comparison with a 'gold standard' Continuous scores:
correlations, ROC curves Dichotomus:
Sensitivity & Specificity (Describe)

Association with Medical Claims data and short-term disability program data: 0.58 (limited power – small sample size)

 

Challenge: no gold standard exists