Statistical Analysis (POCT MT-RNR1)
Scoring
The report shows the individual device scores for each sample, along with an average score across the 3 samples per survey, and an overall average score across different surveys. The scoring system used broadly reflects the clinical significance of the results obtained:
-
- A correct result is given a score of 0.
-
- A sliding scale score between 1 and 6 is assigned for incorrectly identified results, where 6 represents a gross misclassification of the result.
-
- A test failure is given a score of 1, 2 or 4, depending on the sample’s cell load.
-
- A negative result for a positive sample is given a score of 6.
-
- A positive result for a negative sample is given a score of 5.
In general, a missed positive sample receives a larger penalty than a misclassified negative sample, as it could lead to an inappropriate treatment decision.
Table: Scoring matrix
| Expected Results | Submitted Results | Assigned Score | Adjusted Score* |
| Detected | Detected | 0 | 0 |
| Not Detected | Not Detected | 0 | 0 |
| Not Detected | Detected | 5 | 2.5 |
| Detected | Not Detected | 6 | 3 |
| Detected or Not Detected |
Test failed | 1, 2 or 4 | 0.5, 1 or 2 |
| Detected or Not Detected |
Not submitted | 3 | 3 |
*Adjusted scores are assigned when <80% (50+ total submissions) or < 90% (30+ total submissions) of participants record the correct result. Adjusted scores are not applied for a total submission less than 30.
Survey performance calculation
The overall individual device performer status is determined by the average score across the 3 samples per survey, based on the following conditions:
Table: Performance status
| Average score condition (AvgS) | Performer status |
| 0 ≤ AvgS < 1 | Good |
| 1 ≤ AvgS < 2 | Acceptable |
| AvgS ≥ 2 | Poor |
For more information about report statistics please download EMQN Participant’s Manual.