 |
Results
Show: Test set | Custom selection| Lumen | Stenosis |
| Averages measures and ranks | Averages measures and ranks |
| Ranks per stenosis category |
Ranks per stenosis category |
| Ranks per research center | Ranks per research center |
Average lumen measures
| Method | Automatic | Total | dice | msd | Hausdorff | Total | |||
|---|---|---|---|---|---|---|---|---|---|
| name | success | % | rank | mm | rank | mm | rank | rank | |
| Reference |
41 | 100.0 | 1.00 | 0.01 | 1.51 | 0.06 | 1.51 | 1.34 | |
| ObserverA |
41 | 95.1 | 2.61 | 0.10 | 3.20 | 0.65 | 3.24 | 3.02 | |
| ObserverB |
41 | 94.6 | 3.34 | 0.11 | 3.88 | 0.83 | 3.59 | 3.60 | |
| ObserverC |
41 | 94.4 | 3.46 | 0.12 | 3.83 | 0.97 | 4.37 | 3.89 | |
| SCR_Gulsun_Tek Gülsün and Tek |
41 | 91.8 | 6.10 | 0.18 | 6.20 | 1.52 | 5.80 | 6.03 | |
| Hui Tang | Invalid submission, please contact organisers. | ||||||||
| GIMET Krissian and García |
41 | 87.3 | 6.17 | 0.54 | 7.59 | 4.42 | 7.46 | 7.07 | |
| Medisys Cuisenaire |
X | 33 | 89.6 | 8.46 | 0.17 | 7.59 | 1.71 | 7.66 | 7.90 |
| TubularAnisotropy Mille et al. |
41 | 83.5 | 9.05 | 0.74 | 9.63 | 10.10 | 9.88 | 9.52 | |
| HUJI-CASMIP Freiman et al. |
41 | 82.9 | 9.29 | 0.75 | 10.00 | 9.15 | 9.88 | 9.72 | |
| media Wong et al. |
41 | 77.5 | 9.78 | 1.10 | 10.71 | 10.66 | 10.05 | 10.18 | |
| MARACAS Zuluaga et al. |
41 | 80.9 | 10.07 | 0.82 | 10.63 | 10.30 | 10.05 | 10.25 | |
| RGC Valencia et al. |
37 | 53.6 | 11.61 | 3.39 | 11.90 | 12.35 | 11.20 | 11.57 | |
Average lumen ranks per stenosis category.
| Method | Automatic | None | 0-30 | 30-50 | 50-70 | 70-100 |
|---|---|---|---|---|---|---|
| name | ||||||
| Reference |
1.42 | 1.33 | 1.19 | 1.33 | 1.42 | |
| ObserverA |
3.00 | 3.07 | 2.76 | 2.83 | 3.38 | |
| ObserverB |
4.00 | 3.63 | 3.62 | 3.46 | 3.29 | |
| ObserverC |
4.04 | 3.97 | 3.38 | 4.21 | 3.75 | |
| SCR_Gulsun_Tek Gülsün and Tek |
6.58 | 6.37 | 5.29 | 6.00 | 5.75 | |
| Hui Tang | Invalid submission, please contact organisers. | |||||
| GIMET Krissian and García |
8.00 | 6.53 | 6.67 | 6.71 | 7.54 | |
| Medisys Cuisenaire |
X | 7.92 | 7.00 | 7.00 | 9.17 | 8.54 |
| TubularAnisotropy Mille et al. |
9.42 | 9.30 | 10.57 | 9.17 | 9.33 | |
| HUJI-CASMIP Freiman et al. |
9.17 | 9.70 | 9.71 | 9.83 | 10.21 | |
| media Wong et al. |
10.29 | 11.00 | 10.29 | 9.58 | 9.54 | |
| MARACAS Zuluaga et al. |
9.42 | 10.67 | 10.33 | 10.21 | 10.54 | |
| RGC Valencia et al. |
11.54 | 11.57 | 12.29 | 11.46 | 11.08 | |
Average lumen ranks per research center
| Method | Automatic | ErasmusMC | Hadassah | LP |
|---|---|---|---|---|
| name | ||||
| Reference |
1.17 | 1.67 | 1.67 | |
| ObserverA |
3.02 | 2.95 | 3.05 | |
| ObserverB |
3.22 | 4.24 | 4.43 | |
| ObserverC |
3.43 | 5.48 | 4.05 | |
| SCR_Gulsun_Tek Gülsün and Tek |
5.56 | 7.14 | 6.76 | |
| Hui Tang | Invalid submission, please contact organisers. | |||
| GIMET Krissian and García |
6.64 | 7.62 | 8.19 | |
| Medisys Cuisenaire |
X | 7.89 | 7.71 | 8.14 |
| TubularAnisotropy Mille et al. |
9.63 | 8.38 | 10.24 | |
| HUJI-CASMIP Freiman et al. |
10.09 | 9.33 | 8.71 | |
| media Wong et al. |
10.56 | 9.57 | 9.33 | |
| MARACAS Zuluaga et al. |
10.33 | 10.52 | 9.67 | |
| RGC Valencia et al. |
11.58 | 11.48 | 11.62 | |
Stenosis measures
| Method | Automatic | Total | diam | area | Baseline | Total | ||||
|---|---|---|---|---|---|---|---|---|---|---|
| name | success | % | rank | % | rank | diam* | area* | lumens* | rank | |
| Reference |
41 | 0 | 1.00 | 0 | 1.00 | 6.6 | 8.0 | 41 | 1.00 | |
| ObserverA |
41 | 3.4 | 2.15 | 2.9 | 2.02 | 6.7 | 8.2 | 41 | 2.09 | |
| ObserverB |
41 | 5.4 | 2.51 | 4.3 | 2.32 | 9.0 | 8.7 | 41 | 2.41 | |
| ObserverC |
41 | 5.7 | 2.66 | 5.0 | 2.68 | 11.2 | 10.3 | 41 | 2.67 | |
| SCR_Gulsun_Tek Gülsün and Tek |
41 | -- | -- | -- | -- | 9.7 | 12.8 | 41 | -- | |
| Hui Tang | Invalid submission, please contact organisers. | |||||||||
| GIMET Krissian and García |
41 | -- | -- | -- | -- | 14.3 | 19.8 | 41 | -- | |
| Medisys Cuisenaire |
X | 41 | -- | -- | -- | -- | 16.7 | 16.5 | 33 | -- |
| TubularAnisotropy Mille et al. |
41 | -- | -- | -- | -- | 31.2 | 35.7 | 41 | -- | |
| HUJI-CASMIP Freiman et al. |
41 | -- | -- | -- | -- | 24.5 | 29.4 | 41 | -- | |
| media Wong et al. |
41 | 31.4 | 4.20 | 25.2 | 4.17 | 27.8 | 27.5 | 41 | 4.18 | |
| MARACAS Zuluaga et al. |
41 | 17.0 | 3.56 | 16.9 | 3.71 | 30.0 | 31.4 | 41 | 3.63 | |
| RGC Valencia et al. |
41 | 43.3 | 4.73 | 37.0 | 4.39 | 36.2 | 39.7 | 37 | 4.56 | |
Average stenosis ranks per stenosis category
| Method | Automatic | None | 0-30 | 30-50 | 50-70 | 70-100 |
|---|---|---|---|---|---|---|
| name | ||||||
| Reference |
1.00 | 1.00 | 1.00 | 1.00 | 1.00 | |
| ObserverA |
1.00 | 2.35 | 2.21 | 3.00 | 1.81 | |
| ObserverB |
1.00 | 2.65 | 3.14 | 2.88 | 2.44 | |
| ObserverC |
1.00 | 3.25 | 2.86 | 3.13 | 3.00 | |
| SCR_Gulsun_Tek Gülsün and Tek |
-- | -- | -- | -- | -- | |
| Hui Tang | Invalid submission, please contact organisers. | |||||
| GIMET Krissian and García |
-- | -- | -- | -- | -- | |
| Medisys Cuisenaire |
X | -- | -- | -- | -- | -- |
| TubularAnisotropy Mille et al. |
-- | -- | -- | -- | -- | |
| HUJI-CASMIP Freiman et al. |
-- | -- | -- | -- | -- | |
| media Wong et al. |
1.25 | 4.75 | 4.93 | 5.00 | 4.94 | |
| MARACAS Zuluaga et al. |
1.25 | 4.40 | 4.64 | 4.81 | 3.00 | |
| RGC Valencia et al. |
1.63 | 4.80 | 5.50 | 5.56 | 5.38 | |
Average stenosis ranks per research center
| Method | Automatic | ErasmusMC | Hadassah | LP |
|---|---|---|---|---|
| name | ||||
| Reference |
1.00 | 1.00 | 1.00 | |
| ObserverA |
2.19 | 2.07 | 1.71 | |
| ObserverB |
2.57 | 2.00 | 2.21 | |
| ObserverC |
2.78 | 2.57 | 2.36 | |
| SCR_Gulsun_Tek Gülsün and Tek |
-- | -- | -- | |
| Hui Tang | Invalid submission, please contact organisers. | |||
| GIMET Krissian and García |
-- | -- | -- | |
| Medisys Cuisenaire |
X | -- | -- | -- |
| TubularAnisotropy Mille et al. |
-- | -- | -- | |
| HUJI-CASMIP Freiman et al. |
-- | -- | -- | |
| media Wong et al. |
4.30 | 3.79 | 4.14 | |
| MARACAS Zuluaga et al. |
3.72 | 3.43 | 3.50 | |
| RGC Valencia et al. |
4.93 | 3.50 | 4.21 | |
| * The measures indicated with an asterix (*) or in italics are not determined by the participants, but are the result of applying a standardized algorithm by the framework. These measures are not used in the calculation of the ranks. |