Evaluation & Results | MICCAI Grand Challenge on 6-month Infant Brain MRI Segmentation from Multiple Sites

The evaluation will be performed using T1/T2-weighted MR images with manual segmentations of WM, GM and CSF. Automatic segmentations will be evaluated against this manual set – a reference standard, by using various measurements, such as Dice Coefficient (DC), Modified Hausdorff Distance (MHD) and Average Surface Distance (ASD).

Besides these overall measurements (DC, MHD and ASD), we will also have local measurements based on major sulci and gyri.

We will only provide a rank list for each metric. We will not provide an overall rank list since we think “Everyone is a winner.”

—== Validation Results ==—

TEAM	SUBMISSION DATE	DSC [CSF]	MHD [CSF]	ASD [CSF]	DSC [GM]	MHD [GM]	ASD [GM]	DSC [WM]	MHD [WM]	ASD [WM]
SmartDSP	15/08/2019	0.938	10.303	0.174	0.89	6.272	0.443	0.867	7.571	0.526
xflz	29/08/2019	0.958	8.81	0.115	0.927	5.826	0.307	0.909	6.414	0.3481
BIG	06/08/2019	0.951	10.6	0.139	0.909	8.275	0.383	0.89	6.795	0.47
MA_SmartDSP	06/08/2019	0.958	8.913	0.117	0.924	6.176	0.32	0.905	6.659	0.37
MASI(baseline)	29/08/2019	0.671	14.405	0.912	0.536	30.831	1.310	0.645	14.695	1.561
long	12/08/2019	0.898	10.369	0.290	0.849	7.595	0.548	0.817	8.335	0.636
tiantian	02/09/2019	0.912	10.760	0.237	0.854	10.698	0.530	0.825	9.414	0.628
RB	01/09/2019	0.957	9.201	0.119	0.919	5.694	0.329	0.903	6.778	0.389
PerceptionComputingLab_HIT	02/09/2019	0.959	9.023	0.114	0.925	5.639	0.314	0.906	6.511	0.363
nic_vicorob	14/09/2019	0.940	10.404	0.167	0.906	5.935	0.385	0.887	8.090	0.429
Tao_SMU	05/09/2019	0.957	9.286	0.120	0.926	12.527	0.315	0.903	11.068	0.357
OxfordIBME	11/09/2019	0.960	8.560	0.112	0.927	5.495	0.307	0.907	6.759	0.353
Brain_Tech	05/09/2019	0.961	8.873	0.108	0.928	5.724	0.300	0.911	7.114	0.347
lyh	05/09/2019	0.922	12.477	0.211	0.867	22.807	0.501	0.8413	11.666	0.583
VIPSL	08/09/2019	0.957	9.234	0.121	0.917	9.345	0.340	0.895	7.048	0.397
UBC001	08/09/2019	0.877	9.370	0.333	0.868	9.736	0.547	0.819	8.964	0.689
CU_SIAT	09/09/2019	0.954	9.191	0.125	0.924	6.400	0.324	0.904	6.847	0.367
Climb_Mountains	09/09/2019	0.927	10.117	0.201	0.866	7.736	0.510	0.833	7.836	0.659
FightAutism	07/09/2019	0.960	9.233	0.110	0.929	5.678	0.300	0.911	6.678	0.341
SJTU-IMR	10/09/2019	0.956	8.995	0.123	0.922	6.318	0.328	0.902	6.925	0.381
SLHC_MICCAI	15/09/2019	0.945	9.666	0.154	0.903	6.601	0.387	0.881	7.215	0.456
WorldSeg	13/09/2019	0.894	9.204	0.341	0.884	7.521	0.442	0.856	7.231	0.517
Road	12/09/2019	0.958	9.078	0.114	0.924	5.890	0.318	0.904	6.745	0.370
QL111111	12/09/2019	0.959	9.484	0.114	0.926	5.601	0.307	0.908	7.028	0.353
WYF2019DUT	13/09/2019	0.955	9.439	0.1253	0.924	20.9326	0.3215	0.901	7.728	0.365
Guardian620	15/09/2019	0.959	9.071	0.112	0.918	6.166	0.335	0.894	6.978	0.397
brain_gen	15/09/2019	0.956	8.973	0.120	0.924	5.995	0.318	0.905	6.918	0.371
trung	15/09/2019	0.952	9.261	0.133	0.914	5.960	0.343	0.897	6.611	0.392
XMU-smartdsp	24/09/2019	0.956	9.262	0.120	0.924	6.805	0.319	0.905	7.035	0.365
Legand	16/05/2020	0.902	9.463	0.263	0.869	6.339	0.509	0.848	7.111	0.576

—== The 1st Round Testing Results ==—

TEAM	SUBMISSION DATE	DSC [CSF]	MHD [CSF]	ASD [CSF]	DSC [GM]	MHD [GM]	ASD [GM]	DSC [WM]	MHD [WM]	ASD [WM]
MA_SmartDSP	15/08/2019	0.823	11.205	0.546	0.795	8.462	0.604	0.830	8.178	0.640	Details
long	15/08/2019	0.788	9.503	0.565	0.735	9.140	0.663	0.762	9.653	0.828	Details
BIG	22/08/2019	0.810	12.810	0.648	0.790	7.723	0.588	0.843	8.621	0.630	Details
xflz	30/08/2019	0.826	12.127	0.556	0.825	8.130	0.558	0.861	7.308	0.522	Details
RB	02/09/2019	0.791	48.684	0.853	0.808	7.771	0.570	0.865	8.503	0.531	Details
MASI(baseline)	05/09/2019	0.67	18.013	1.332	0.607	20.375	1.0333	0.681	10.153	1.308	Details
nic_vicorob	05/09/2019	0.777	13.604	0.790	0.751	8.523	0.791	0.749	10.507	1.038	Details
lyh	05/09/2019	0.792	62.194	0.632	0.705	18.795	0.775	0.699	13.660	1.110	Details
tiantian	07/09/2019	0.796	101.137	0.862	0.713	20.358	0.802	0.642	16.117	1.288	Details
PerceptionComputingLab_HIT	08/09/2019	0.810	12.644	0.630	0.814	8.326	0.605	0.844	8.825	0.607	Details
SmartDSP	09/09/2019	0.813	11.509	0.575	0.788	8.284	0.639	0.815	8.536	0.682	Details
Tao_SMU	10/09/2019	0.835	11.920	0.526	0.830	13.051	0.543	0.860	8.173	0.514	Details
UBC001	11/09/2019	0.699	9.806	0.838	0.660	9.886	0.961	0.635	13.865	1.693	Details
OxfordIBME	11/09/2019	0.806	12.158	0.614	0.778	8.694	0.621	0.828	9.525	0.644	Details
CU_SIAT	14/09/2019	0.824	13.601	0.624	0.816	7.824	0.573	0.856	8.270	0.584	Details
FightAutism	12/09/2019	0.826	12.760	0.571	0.829	7.306	0.561	0.863	8.109	0.523	Details
QL111111	14/09/2019	0.834	12.309	0.553	0.835	7.819	0.512	0.877	8.022	0.474	Details
SJTU-IMT	13/09/2019	0.821	11.678	0.552	0.812	7.870	0.582	0.842	9.293	0.6184	Details
Road	14/09/2019	0.803	12.722	0.658	0.801	8.296	0.659	0.826	9.131	0.653	Details
brain_gen	14/09/2019	0.823	12.451	0.575	0.800	7.860	0.597	0.841	8.337	0.624	Details
WYF2019DUT	14/09/2019	0.829	14.792	0.546	0.826	17.002	0.568	0.850	8.652	0.547	Details
SLHC_MICCAI	15/09/2019	0.820	12.738	0.607	0.771	8.911	0.622	0.816	9.315	0.728	Details
Brain_Tech	15/09/2019	0.795	11.421	0.626	0.694	9.516	0.735	0.780	9.237	0.886	Details
WorldSeg	15/09/2019	0.802	13.697	0.701	0.821	8.346	0.589	0.854	7.549	0.540	Details
Climb_Mountains	15/09/2019	0.807	12.614	0.618	0.748	8.188	0.695	0.767	9.843	0.904	Details
Guardian620	17/09/2019	0.814	11.557	0.587	0.778	8.759	0.6716	0.783	8.692	0.7019	Details
VIPSL	20/09/2019	0.818	11.155	0.559	0.802	8.274	0.599	0.833	7.674	0.594	Details

—== The 2nd Round Testing Results ==—

TEAM	SUBMISSION DATE	DSC [CSF]	MHD [CSF]	ASD [CSF]	DSC [GM]	MHD [GM]	ASD [GM]	DSC [WM]	MHD [WM]	ASD [WM]
BIG	22/08/2019	0.810	12.806	0.648	0.790	7.723	0.588	0.843	8.621	0.630	Details
brain_gen	14/09/2019	0.823	12.451	0.575	0.800	7.860	0.597	0.841	8.337	0.624	Details
Brain_Tech	10/11/2019	0.815	12.900	0.618	0.804	8.331	0.602	0.843	8.503	0.603	Details
Climb_Mountains	15/09/2019	0.807	12.614	0.618	0.748	8.188	0.695	0.767	9.843	0.904	Details
CU_SIAT	15/11/2019	0.829	13.679	0.610	0.826	7.535	0.566	0.855	8.639	0.561	Details
emc_Brain	18/11/2019	0.765	12.558	0.754	0.724	8.450	0.908	0.643	14.367	1.568	Details
FightAutism	12/09/2019	0.826	12.760	0.571	0.829	7.306	0.561	0.863	8.109	0.523	Details
Guardian620	17/09/2019	0.814	11.557	0.587	0.778	8.759	0.672	0.783	8.692	0.702	Details
IR2	07/08/2020	0.775	11.883	0.696	0.749	8.358	0.704	0.767	8.755	0.804	Details
Legand	07/07/2020	0.798	11.627	0.611	0.779	8.131	0.655	0.806	8.752	0.736	Details
long	15/08/2019	0.788	9.503	0.565	0.735	9.140	0.663	0.762	9.653	0.828	Details
lyh	05/09/2019	0.792	62.194	0.632	0.705	18.795	0.775	0.699	13.660	1.110	Details
MA_SmartDSP	15/08/2019	0.823	11.205	0.546	0.795	8.462	0.604	0.830	8.178	0.640	Details
MASI(baseline)	14/11/2019	0.713	13.177	0.797	0.709	8.307	0.767	0.720	9.802	1.093	Details
nic_vicorob	05/09/2019	0.777	13.604	0.790	0.751	8.523	0.791	0.749	10.507	1.038	Details
OxfordIBME	11/09/2019	0.806	12.158	0.614	0.778	8.694	0.621	0.828	9.525	0.644	Details
PerceptionComputingLab_HIT	08/09/2019	0.810	12.644	0.630	0.814	8.326	0.605	0.844	8.825	0.607	Details
QL111111	14/09/2019	0.834	12.309	0.553	0.835	7.819	0.512	0.877	8.022	0.474	Details
RB	07/11/2019	0.807	13.728	0.699	0.814	7.834	0.571	0.860	8.500	0.553	Details
Road	14/09/2019	0.803	12.722	0.658	0.801	8.297	0.659	0.826	9.131	0.653	Details
SISE	15/11/2019	0.823	11.541	0.522	0.813	8.577	0.569	0.843	8.578	0.564	Details
SJTU-IMT	13/09/2019	0.821	11.678	0.552	0.812	7.870	0.582	0.842	9.293	0.618	Details
SLHC_MICCAI	15/09/2019	0.820	12.738	0.607	0.771	8.911	0.622	0.816	9.315	0.728	Details
SmartDSP	15/11/2019	0.829	12.387	0.559	0.831	7.898	0.554	0.864	8.915	0.522	Details
Tao_SMU	15/11/2019	0.834	12.197	0.540	0.832	8.143	0.544	0.864	8.598	0.508	Details
tiantian	07/09/2019	0.796	101.137	0.862	0.713	20.358	0.802	0.642	16.117	1.288	Details
trung	15/11/2019	0.807	13.483	0.684	0.823	7.599	0.571	0.860	8.466	0.533	Details
UBC001	11/09/2019	0.699	9.806	0.838	0.660	9.886	0.961	0.635	13.865	1.693	Details
VIPSL	20/09/2019	0.818	11.155	0.559	0.802	8.274	0.599	0.832	7.674	0.594	Details
WorldSeg	15/09/2019	0.802	13.697	0.701	0.821	8.346	0.589	0.854	7.549	0.540	Details
WYF2019DUT	14/09/2019	0.829	14.792	0.546	0.826	17.002	0.568	0.850	8.652	0.547	Details
xflz	30/08/2019	0.826	12.127	0.556	0.825	8.130	0.558	0.861	7.308	0.522	Details