Statistical Analysis (POCT MT-RNR1)

Scoring

The report shows the individual device scores for each sample, along with an average score across the 3 samples per survey, and an overall average score across different surveys. The scoring system used broadly reflects the clinical significance of the results obtained:

      • A correct result is given a score of 0.

      • A sliding scale score between 1 and 6 is assigned for incorrectly identified results, where 6 represents a gross misclassification of the result.

      • A test failure is given a score of 1, 2 or 4, depending on the sample’s cell load.

      • A negative result for a positive sample is given a score of 6.

      • A positive result for a negative sample is given a score of 5.

    In general, a missed positive sample receives a larger penalty than a misclassified negative sample, as it could lead to an inappropriate treatment decision.

    Table: Scoring matrix

    Expected results Your results Assigned Score Adjusted score*
    Detected Detected 0 0
    Not Detected Not Detected 0 0
    Not Detected Detected 5 2.5
    Detected Not Detected 6 3
    Detected or
    Not Detected
    Test failed 1, 2 or 4 0.5, 1 or 2
    Detected or
    Not Detected
    Not submitted 3 3

    *Adjusted scores are assigned when <80% (50+ total submissions) or < 90% (30+ total submissions) of participants record the correct result. Adjusted scores are not applied for a total submission less than 30.

    Survey performance calculation

    The overall individual device performer status is determined by the average score across the 3 samples per survey, based on the following conditions:

    Table: Performance status

    Average score condition (AvgS) Performer status
    0 ≤ AvgS < 1 Good
    1 ≤ AvgS < 2 Acceptable
    AvgS ≥ 2 Poor

    For more information about report statistics please download EMQN Participant’s Manual.