Results


The tables below present results for the Single Device Track and the Multiple Device Track. For each track, results are presented in two sets of tables: Ranking A - where teams are not allowed to modify the baseline LM; Ranking B - where the LM is unconstrained. Ranking B also includes end-to-end systems without a separate explicit LM.

Note, the official Baseline is a Single Device Ranking A system but its scores are repeated in all tables for the sake of comparison.

Single Device Track, Ranking A (constrained LM)

Rank Team Paper Dev Eval
USTC-iFlytek [paper] 50.64 46.42
Hitachi-JHU [paper] 56.40 50.36
STC [paper] 56.62 55.52
Toshiba [paper] 60.75 56.54
NWPU [paper] 65.16 57.85
ASUS [paper] 70.02 61.31
CAS [paper] 71.77 62.01
RWTH-Paderborn [paper] 63.76 62.72
SHNU [paper] 64.44 64.45
IISC [paper] 73.37 66.11
Sheffield-Oldenburg [paper] 74.78 66.72
NDSC [paper] 75.12 67.31
Paderborn [paper] 71.43 69.60
Baseline [paper] 81.14 73.27
Lenovo [paper] 90.52 84.81
IIT Bombay-TCS [paper] 95.56 97.36
TCS-IIT Bombay [paper] 95.52 104.67

[TOP]



Single Device Track, Ranking B (unconstrained LM)

Rank Team Paper Dev Eval
USTC-iFlytek [paper] 50.20 46.11
Hitachi-JHU [paper] 55.15 48.20
NWPU [paper] 63.53 56.09
CAS [paper] 71.15 61.33
NWPU-Mobvoi [paper] 69.57 68.71
CMU [paper] 82.08 71.82
Baseline [paper] 81.14 73.27
AnTech [paper] 78.28 73.50

[TOP]



Multiple Device Track, Ranking A (constrained LM)

Rank Team Paper Dev Eval
USTC-iFlytek [paper] 45.65 46.63
Hitachi-JHU [paper] 54.00 50.59
RWTH-Paderborn [paper] 54.56 55.26
STC [paper] 53.49 55.59
CAS [paper] 71.95 61.77
Sheffield-Oldenburg [paper] 72.37 67.22
Paderborn [paper] 61.73 68.98
Baseline [paper] 81.14 73.27
Lenovo [paper] 91.00 85.01

[TOP]



Multiple Device Track, Ranking B (unconstrained LM)

Rank Team Paper Dev Eval
USTC-iFlytek [paper] 45.05 46.14
Hitachi-JHU [paper] 52.38 48.24
CAS [paper] 71.02 61.01
Baseline [paper] 81.14 73.27
DAIICT-IIITV [paper] 81.42 76.42

[TOP]