Glossary Term
Inter-Method Reliability
An OMERACT measurement property that assesses the consistency of an instrument’s scores across important sources of variability in the measurement method, such as different raters, machines, technicians, or other measurement-affecting factors. It evaluates whether the same construct is measured consistently when these aspects of the measurement process differ.
Assessment of inter-method reliability helps identify whether a source of variability introduces random measurement error or systematic bias that could affect the instrument’s measurement performance. Relevant sources of variability depend on the instrument and its intended context of use and should be identified and evaluated by the working group.
Relationship to Reliability: Reliability is the broader concept describing the extent to which measurements are consistent and sufficiently free from measurement error. Inter-method reliability focuses specifically on consistency across relevant sources of variability at the same time point or cross-sectionally. This distinguishes it from test-retest reliability, which evaluates the consistency of scores over time when the construct being measured is expected to remain stable.
Examples
An imaging instrument is used to assess the same patients using two different ultrasound machines. If the instrument produces consistent scores regardless of which machine is used, it demonstrates good inter-machine reliability, a form of inter-method reliability. Similarly, if different trained technicians using the instrument obtain consistent scores for the same patients, this provides evidence of inter-rater reliability.