Real-time analysis of cataract surgery videos using statistical models - Inserm - Institut national de la santé et de la recherche médicale Access content directly
Journal Articles Multimedia Tools and Applications Year : 2017

Real-time analysis of cataract surgery videos using statistical models


The automatic analysis of the surgical process, from videos recorded during surgeries, could be very useful to surgeons, both for training and for acquiring new techniques. The training process could be optimized by automatically providing some targeted recommendations or warnings, similar to the expert surgeon’s guidance. In this paper, we propose to reuse videos recorded and stored during cataract surgeries to perform the analysis. The proposed system allows to automatically recognize, in real time, what the surgeon is doing: what surgical phase or, more precisely, what surgical step he or she is performing. This recognition relies on the inference of a multilevel statistical model which uses 1) the conditional relations between levels of description (steps and phases) and 2) the temporal relations among steps and among phases. The model accepts two types of inputs: 1) the presence of surgical tools, manually provided by the surgeons, or 2) motion in videos, automatically analyzed through the Content Based Video retrieval (CBVR) paradigm. Different data-driven statistical models are evaluated in this paper. For this project, a dataset of 30 cataract surgery videos was collected at Brest University hospital. The system was evaluated in terms of area under the ROC curve. Promising results were obtained using either the presence of surgical tools (Az = 0.983) or motion analysis (Az = 0.759). The generality of the method allows to adapt it to other kinds of surgeries. The proposed solution could be used in a computer assisted surgery tool to support surgeons during the surgery. © 2017, Springer Science+Business Media New York.
Fichier principal
Vignette du fichier
1610.05465.pdf (533.1 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04160155 , version 1 (05-02-2024)



Katia Charriere, Gwénolé Quellec, Mathieu Lamard, David Martiano, Guy Cazuguel, et al.. Real-time analysis of cataract surgery videos using statistical models. Multimedia Tools and Applications, 2017, 76 (21), pp.22473-22491. ⟨10.1007/s11042-017-4793-8⟩. ⟨hal-04160155⟩
8 View
0 Download



Gmail Facebook X LinkedIn More