Technology assessment
Technology assessment
This domain tests whether you can judge athlete-monitoring and performance technology by its measurement properties and fit for purpose. The exam favors evidence over manufacturer claims.
Core rules
- Validity: criterion validity against a reference (e.g., timing gates, force plate), convergent validity across devices, and construct validity for the intended construct.
- Reliability: test-retest, intra- and inter-rater reliability; report typical error and coefficient of variation (CV).
- Sensitivity: can the metric detect a real, worthwhile change? Compare typical error with the smallest worthwhile change (SWC).
- Specificity and practicality: does the metric reflect the sport demand, and can it be collected consistently?
Worked example
A team wants 10 Hz GPS to flag high-speed running changes. You first compare against timing gates over a flying 20 m; a strong relationship supports validity. Next, repeated trials on the same players yield a CV of 8% for high-speed distance. If the coach's SWC is 5%, the noise exceeds the signal, so do not interpret small week-to-week changes; increase exposure, standardize collection, or use a more reliable metric.
Traps
- Accepting device output as truth without validation.
- Using a metric whose typical error exceeds the decision threshold.
- Mixing epochs, units, or satellite conditions across sessions.