Posts Tagged Reliability
[Abstract] Development of the modified simple test for evaluating hand function (modified STEF): Construct, reliability, validity, and responsiveness
[Abstract] Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool
Purpose: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice.
Materials and methods: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson’s r correlations with a reference standard, the Health Care Climate Questionnaire.
Results: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7–0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement.
Conclusion: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool.
- Implications for Rehabilitation
Promoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy.
This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings.
This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase.
The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.
via Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool: Disability and Rehabilitation: Vol 0, No 0
[ARTICLE] Development and validation of a novel questionnaire for self-determination of the range of motion of wrist and elbow – Full Text
The aim of this study was to develop and validate a novel self-administered questionnaire for assessing the patient’s own range of motion (ROM) of the wrist and the elbow.
In a prospective clinical study from January 2015 to June 2015, 101 consecutive patients were evaluated with a novel, self-administered, diagram-based, wrist motion assessment score (W-MAS) and elbow motion assessment score (E-MAS). The questionnaire was statistically evaluated for test-retest reliability, patient-physician agreement, comparison with healthy population, and influence of covariates (age, gender, affected side and involvement in workers’ compensation cases).
Assessment of patient-physician agreement demonstrated almost perfect agreement (k > 0.80) with regard to six out of eight items. There was substantial agreement with regard to two items: elbow extension (k = 0.76) and pronation (k = 0.75). The assessment of the test-retest reliability revealed at least substantial agreement (k = 0.70). The questionnaire revealed a high discriminative power when comparing the healthy population with the study group (p = 0.007 or lower for every item). Age, gender, affected side and involvement in workers’ compensation cases did not in general significantly influence the patient-physician agreement for the questionnaire.
The W-MAS and E-MAS are valid and reliable self-administered questionnaires that provide a high level of patient-physician agreement for the assessments of wrist and elbow ROM.
Level of evidence: Diagnostic study, Level II
Assessing the patient’s outcome and satisfaction is important in modern orthopedic practice [1, 2, 3]. Using questionnaires to evaluate patients with wrist and elbow disorders is widespread and has been shown to be valid and reproducible [4, 5, 6, 7, 8, 9]. Self-reported outcome measures allow outcomes to be assessed from the patient’s perspective and do not require time in clinic or medical staff for data collection.
Common self-administered questionnaires for the determination of hand- and upper limp specific results of the wrist (e.g. patient-rated wrist evaluation, PRWE ) and of the elbow (e.g. The American Shoulder and Elbow Surgeons-Elbow, ASES-E ) enable the patient to assess the functional impairment of the joint, but they do not formally assess the range of motion, and patients have to attend clinic for this to be measured . Therefore important data regarding the ROM would be lost in patients who are unable or unwilling to come to the outpatient clinic at the regular follow-up or for clinical research.
To our knowledge no validated self-assessment questionnaire for the ROM of the wrist or the elbow exists, which compares the agreement of the patient’s outcome with the examination by a physician.
Therefore, the aim of the current study was to develop a self-administered, diagram-based wrist motion assessment score (W-MAS) and elbow motion assessment score (E-MAS) to enable the patients to assess their own ROM of the wrist and the elbow. We further evaluated validity and reliability of this novel questionnaire with respect to the accuracy of self-determination of the wrist and elbow ROM.