| MEASUREMENT PROPERTIES | |
| Limitations | English only |
| Observations |
The final analysis included 424 participants for structural validity (response rate of 55%) (T0). The test-retest and SDD analyses included 156 participants, who completed the questionnaires at both T0 and T1. |
| 1. RELIABILITY | |
| A. Internal Consistency | Tested |
| Cronbach's (Describe) |
Internal consistency was assessed by calculation of Cronbach’s α of items included in each factor in the Exploratory Factor Analysis (EFA). Alpha values were considered adequate when >0.70 and < 0.95. The EFA yielded two factors. Cronbach’s α coefficients for the two factors were 0.78 and 0.63. Removal of items number 1, 4 and 26 resulted in Cronbach’s α 0.78 and 0.71. The overall internal reliability was Cronbach’s α 0.80 |
| B. Reliability intraobserver or test-retest | Tested |
| Continuous scores: intraclass correlation coefficient (ICC) Dichotomus: Cohen kappa (Describe) |
The person reliability was α 0.82 (modest), and the item reliability was α 0.99 (strong). |
| C. Reliability interobserver or Measurement error | Not Tested |
| Standard error of measurement (SEM), smallest detectable change (SDC) or Limits of agreement (LoA) (Describe) |
|
| 2. VALIDITY | |
| A. Content validity: face validity | Tested |
| Expert opinion (relevance and comprehensiveness) (Describe) |
Four steps were taken for developing KNAP to develop its content validity, including face validity. |
| B. Construct Validity: Structural validity |
Tested |
| Hypotheses-testing | Tested |
| Cross-cultural validity | Not Tested |
| Brief Description |
Structural validity was analysed using Exploratory Factor Analysis (EFA) to guide future hypotheses, reveal patterns within the data set, and to identify a candidate set of items for Rasch analysis. The Kaiser–Meyer–Olkin measure verified the sampling adequacy for the analysis KMO = 0.80, including all 34 items. Item 1 (F1: 0.196, F2: 0.224), item 4 (F1: 0.050, F2: 0.234) and item 26 (F1: 0.128, F2: 0.251) were removed, resulting in a KMO of 0.857. |
| C. Criterion validity | Not Tested |
| Comparison with a 'gold standard' Continuous scores: correlations, ROC curves Dichotomus: Sensitivity & Specificity (Describe) |
|