RESUMO

OBJECTIVE: To identify challenges to the use of Patient-Reported Outcomes Measurement Information System (PROMIS) Pediatric measures in the ambulatory pediatric setting and possible solutions to these challenges. STUDY DESIGN: Eighteen semistructured telephone interviews of health system leaders, measurement implementers, and ambulatory pediatric clinicians were conducted. Five coders used applied thematic analysis to iteratively identify and refine themes in interview data. RESULTS: Most interviewees had roles in leadership or the implementation of patient-centered outcomes; 39% were clinicians. Some had experience using PROMIS clinically (44%) and 6% were considering this use. Analyses yielded 6 themes: (1) selection of PROMIS measures, (2) method of administration, (3) use of PROMIS Parent Proxy measures, (4) privacy and confidentiality of PROMIS responses, (5) interpretation of PROMIS scores, and (6) using PROMIS scores clinically. Within the themes, interviewees illuminated specific unique considerations for using PROMIS with children, including care transitions and privacy. CONCLUSIONS: Real-world challenges continue to hamper PROMIS use. Ongoing efforts to disseminate information about the integration of PROMIS measures in clinical care is critical to impacting the health of children.

Assuntos

RESUMO

The Balance Error Scoring System (BESS) is a human-scored, field-based balance test used in cases of suspected concussion. Recently developed instrumented alternatives to human scoring carry substantial advantages over traditional testing, but thus far report relatively abstract outcomes which may not be useful to clinicians or coaches. In contrast, the Automated Assessment of Postural Stability (AAPS) is a computerized system that tabulates error events in accordance with the original description of the BESS. This study compared AAPS and human-based BESS scores. Twenty-five healthy adults performed the modified BESS. Tests were scored twice each by human raters (3) and the computerized system. Interrater (between-human) and inter-method (AAPS vs. human) agreement (ICC(2,1)) were calculated alongside Bland-Altman limits of agreement (LOA). Interrater analyses were significant (p<0.005) and demonstrated good to excellent agreement. Inter-method agreement analyses were significant (p<0.005), with agreement ranging from poor to excellent. Computerized scores were equivalent across rating occasions. LOA ranges for AAPS vs. the Human Average exceeded the average LOA ranges between human raters. Coaches and clinicians may consider a system such as AAPS to automate balance testing while maintaining the familiarity of human-based scoring, although scores should not yet be considered interchangeable with those of a human rater.

RESUMO

OBJECTIVE: The purpose of this study is to describe the psychometric evaluation and item response theory calibration of the PROMIS Pediatric Positive Affect item bank, child-report and parent-proxy editions. METHODS: The initial item pool comprising 53 items, previously developed using qualitative methods, was administered to 1,874 children 8-17 years old and 909 parents of children 5-17 years old. Analyses included descriptive statistics, reliability, factor analysis, differential item functioning, and construct validity. A total of 14 items were deleted, because of poor psychometric performance, and an 8-item short form constructed from the remaining 39 items was administered to a national sample of 1,004 children 8-17 years old, and 1,306 parents of children 5-17 years old. The combined sample was used in item response theory (IRT) calibration analyses. RESULTS: The final item bank appeared unidimensional, the items appeared locally independent, and the items were free from differential item functioning. The scales showed excellent reliability and convergent and discriminant validity. Positive affect decreased with children's age and was lower for those with a special health care need. After IRT calibration, we found that 4 and 8 item short forms had a high degree of precision (reliability) across a wide range of the latent trait (>4 SD units). CONCLUSION: The PROMIS Pediatric Positive Affect item bank and its short forms provide an efficient, precise, and valid assessment of positive affect in children and youth.

RESUMO

OBJECTIVE: To evaluate the content and construct validity of the existing PROMIS Pediatric Parent-Proxy Peer Relationships Measure in 5- to 12-year-old children with autism spectrum disorder (ASD). METHOD: Parents of 121 children aged 5 to 12 years who met DSM-IV criteria for ASD completed the Peer Relationships Measure using computerized adaptive testing (CAT). Parents also completed the Social Responsiveness Scale, Second Edition (SRS-2) and a demographic form. Intelligence quotient test results were extracted from clinical or research records. Five parents participated in semi-structured interviews about their child's peer relationships and the item content on the Peer Relationships Measure. RESULTS: The children in the sample were primarily male (87%). The sample was racially and ethnically diverse, and parents were predominantly highly educated. The mean T-score (SD) on the Peer Relationships Measure was 36 (8), with a range from 15 to 62. For 98% of subjects, the CAT required administration of 5 items to reach a standard error of measurement of less than 4 T-score units. The Peer Relationships Measure demonstrated a large correlation with the SRS-2 (r = -0.60, p < .0001). In semi-structured interviews, parents reported that the items on the Peer Relationships Measure were relevant to the peer relationships of their child with ASD, but they reported a few challenges related to variability in their children's peer relationships over time and to somewhat limited knowledge of relationships in school. CONCLUSION: The PROMIS Pediatric Parent-Proxy Peer Relationships Measure may be an efficient, precise, and valid measure of peer relationships for 5- to 12-year-old children with ASD.

Assuntos