Objective Evaluation of Multiple Sclerosis Lesion Segmentation using a Data Management and Processing Infrastructure
Olivier Commowick
(1)
,
Audrey Istace
(2)
,
Michael Kain
(1)
,
Baptiste Laurent
(3)
,
Florent Leray
(1)
,
Mathieu Simon
(1)
,
Sorina Camarasu Pop
(4)
,
Pascal Girard
(4)
,
Roxana Ameli
(2)
,
Jean-Christophe Ferré
(5, 1)
,
Anne Kerbrat
(6, 1)
,
Thomas Tourdias
(7)
,
Frédéric Cervenansky
(4)
,
Tristan Glatard
(8)
,
Jeremy Beaumont
(1)
,
Senan Doyle
(9)
,
Florence Forbes
(10)
,
Jesse Knight
(11)
,
April Khademi
(12)
,
Amirreza Mahbod
(13)
,
Chunliang Wang
(13)
,
Richard Mckinley
(14)
,
Franca Wagner
(14)
,
John Muschelli
(15)
,
Elizabeth Sweeney
(15)
,
Eloy Roura
(16)
,
Xavier Lladó
(16)
,
Michel M Santos
(17)
,
Wellington P Santos
(17)
,
Abel G Silva-Filho
(17)
,
Xavier Tomas-Fernandez
(18)
,
Hélène Urien
(19)
,
Isabelle Bloch
(19)
,
Sergi Valverde
(16)
,
Mariano Cabezas
(16)
,
Francisco Javier Vera-Olmos
(20)
,
Norberto Malpica
(20)
,
Charles Guttmann
(21)
,
Sandra Vukusic
(2)
,
Gilles Edan
(1, 22)
,
Michel Dojat
(23)
,
Martin Styner
(24)
,
Simon K Warfield
(18)
,
François Cotton
(2)
,
Christian Barillot
(1)
1
VisAGeS -
Vision, Action et Gestion d'informations en Santé
2 CHLS - Centre Hospitalier Lyon Sud [CHU - HCL]
3 LaTIM - Laboratoire de Traitement de l'Information Medicale
4 CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
5 Service de neurochirurgie [Rennes] = Neurosurgery [Rennes]
6 Service de neurologie [Rennes]
7 Neuroinflammation: imagerie et thérapie de la sclérose en plaques
8 Concordia University [Montreal]
9 Pixyl Medical [Grenoble]
10 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
11 University of Guelph
12 ECE - Department of Electrical and Computer Engineering [University of Toronto]
13 KTH - KTH Royal Institute of Technology [Stockholm]
14 UNIBE - Universität Bern = University of Bern = Université de Berne
15 Johns Hopkins Bloomberg School of Public Health [Baltimore]
16 VICOROB - Research institute of Computer Vision and Robotics [Girona]
17 UFPE - Universidade Federal de Pernambuco [Recife]
18 CRL - Computational Radiology Laboratory [Boston]
19 LTCI - Laboratoire Traitement et Communication de l'Information
20 URJC - Universidad Rey Juan Carlos = Rey Juan Carlos University
21 Brigham and Women's Hospital [Boston]
22 Service de Neurologie [CHU Rennes]
23 GIN - Grenoble Institut des Neurosciences
24 North Carolina State University - Computer Science
2 CHLS - Centre Hospitalier Lyon Sud [CHU - HCL]
3 LaTIM - Laboratoire de Traitement de l'Information Medicale
4 CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
5 Service de neurochirurgie [Rennes] = Neurosurgery [Rennes]
6 Service de neurologie [Rennes]
7 Neuroinflammation: imagerie et thérapie de la sclérose en plaques
8 Concordia University [Montreal]
9 Pixyl Medical [Grenoble]
10 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
11 University of Guelph
12 ECE - Department of Electrical and Computer Engineering [University of Toronto]
13 KTH - KTH Royal Institute of Technology [Stockholm]
14 UNIBE - Universität Bern = University of Bern = Université de Berne
15 Johns Hopkins Bloomberg School of Public Health [Baltimore]
16 VICOROB - Research institute of Computer Vision and Robotics [Girona]
17 UFPE - Universidade Federal de Pernambuco [Recife]
18 CRL - Computational Radiology Laboratory [Boston]
19 LTCI - Laboratoire Traitement et Communication de l'Information
20 URJC - Universidad Rey Juan Carlos = Rey Juan Carlos University
21 Brigham and Women's Hospital [Boston]
22 Service de Neurologie [CHU Rennes]
23 GIN - Grenoble Institut des Neurosciences
24 North Carolina State University - Computer Science
Olivier Commowick
- Fonction : Auteur
- PersonId : 14904
- IdHAL : olivier-commowick
- ORCID : 0000-0001-7345-6752
- IdRef : 113377983
Sorina Camarasu Pop
- Fonction : Auteur
- PersonId : 19719
- IdHAL : camarasu
- ORCID : 0000-0002-7923-5069
- IdRef : 178745596
Pascal Girard
- Fonction : Auteur
- PersonId : 754677
- IdHAL : paul-girard
- ORCID : 0000-0001-9332-3308
Jean-Christophe Ferré
- Fonction : Auteur
- PersonId : 14483
- IdHAL : jean-christopheferre
- ORCID : 0000-0003-3911-1800
- IdRef : 086442937
Thomas Tourdias
- Fonction : Auteur
- PersonId : 914201
Frédéric Cervenansky
- Fonction : Auteur
- PersonId : 19446
- IdHAL : frederic-cervenansky
- IdRef : 278760546
Florence Forbes
- Fonction : Auteur
- PersonId : 16305
- IdHAL : florence-forbes
- ORCID : 0000-0003-3639-0226
- IdRef : 12469781X
Isabelle Bloch
- Fonction : Auteur
- PersonId : 175825
- IdHAL : isabelle-bloch
- ORCID : 0000-0002-6984-1532
- IdRef : 031277861
Sergi Valverde
- Fonction : Auteur
- PersonId : 1159804
- ORCID : 0000-0002-2150-9610
Michel Dojat
- Fonction : Auteur
- PersonId : 1720
- IdHAL : michel-dojat
- ORCID : 0000-0003-2747-6845
- IdRef : 075440202
François Cotton
- Fonction : Auteur
- PersonId : 170687
- IdHAL : francois-cotton
- ORCID : 0000-0003-0046-2478
- IdRef : 070732035
Christian Barillot
- Fonction : Auteur
- PersonId : 1245
- IdHAL : cbarillot
- ORCID : 0000-0002-1589-7696
- IdRef : 074123637
Résumé
We present a study of multiple sclerosis segmentation algorithms conducted at the international MICCAI 2016 challenge. This challenge was operated using a new open-science computing infrastructure. This allowed for the automatic and independent evaluation of a large range of algorithms in a fair and completely automatic manner. This computing infrastructure was used to evaluate thirteen methods of MS lesions segmentation, exploring a broad range of state-of-the-art algorithms, against a high-quality database of 53 MS cases coming from four centers following a common definition of the acquisition protocol. Each case was annotated manually by an unprecedented number of seven different experts. Results of the challenge highlighted that automatic algorithms, including the recent machine learning methods (random forests, deep learning,...), are still trailing human expertise on both detection and delineation criteria. In addition, we demonstrate that computing a statistically robust consensus of the algorithms performs closer to human expertise on one score (segmentation) although still trailing on detection scores.
| Origine | Publication financée par une institution |
|---|
Loading...