LABELS 2017

 Important dates

  • April 2017 – Submission website open
  • 12 June 2017 – Deadline for submissions
  • 10 July 2017 – Notification to authors
  • 17 July 2017 – Camera-ready papers
  • 14 September 2017, AM – Workshop day

Invited speakers

Danna Gurari – Mixing Crowds, Computers, and Experts for Scalable Annotation of Biomedical Images

Abstract

Biomedical researchers are running image-based studies to systematically study fundamental biological processes. The larger goal of this effort is to contribute to discoveries and innovations that, for example, address society’s health care problems or lead to new bio-inspired technology. However, the key bottlenecks for extracting the desired information from images lie in unreliable annotation from algorithms and costly annotation by experts, especially at scale. Given the rise of crowdsourcing, I will discuss how we can utilize online crowds to better annotate biomedical images. I will present research on demarcating objects in images (segmentation), a critical and time-consuming precursor to many downstream applications. I will begin the talk with a detailed analysis of the relative strengths and weaknesses of three different image segmentation approaches: by experts, by crowd workers, and by algorithms. Then, I will describe a hybrid system design for intelligently distributing segmentation efforts between algorithms and crowds. Results show how to efficiently leverage crowd and algorithm efforts in order to optimize cost/quality trade-offs as well as how to produce segmentations comparable to those created by experts.

Slides

Bio

Danna Gurari is currently an Assistant Professor at University of Texas at Austin School of Information. She completed a postdoctoral fellowship in the University of Texas at Austin Computer Science department under the supervision of Dr. Kristen Grauman and her PhD at Boston University in the Image and Video Computing group under the supervision of Dr. Margrit Betke. Her research interests span computer vision, human computation/crowdsourcing, medical/biomedical image analysis, and applied machine learning. In 2007-2010, Danna worked at Boulder Imaging building custom, high performance, multi-camera recording and analysis systems for military, industrial, and academic applications. From 2005-2007, she worked at Raytheon developing software for satellite systems. Danna earned her BS in Biomedical Engineering and MS in Computer Science from Washington University in St. Louis in 2005, with her thesis on ultrasound imaging. Danna was awarded the 2017 Honorable Mention Award at CHI, 2015 Researcher Excellence Award from the Boston University computer science department, 2014 Best Paper Award for Innovative Idea at MICCAI IMIC, and 2013 Best Paper Award at WACV.

Tanveer Syeda-Mahmood – Challenges of large-scale data annotations for building cognitive medical assistants

Dr. Tanveer Syeda-Mahmood is an IBM Fellow and Chief Scientist/overall lead for the Medical Sieve Radiology Grand Challenge project in IBM Research, Almaden. Medical Sieve is an exploratory research project with global participation from many IBM Research Labs around the world including Almaden Labs in San Jose, CA, Haifa Research Labs in Israel and Melbourne Research Lab in Australia. The goal of this project is to develop automated radiology and cardiology assistants of the future that help clinicians in their decision making.

Dr. Syeda-Mahmood graduated from the MIT AI Lab in 1993 with a Ph.D in Computer Science. Prior to IBM, she worked as a Research Staff Member at Xerox Webster Research Center, Webster, NY. She joined IBM Almaden Research Center in 1998.  Prior to coming to IBM, Dr. Syeda-Mahmood led the image indexing program at Xerox Research and was one of the early originators of the field of content-based image and video retrieval. Currently, she is working on applications of content-based retrieval in healthcare and medical imaging. Over the past 30 years, her research interests have been in a variety of areas relating to artificial intelligence including computer vision, image and video databases, medical image analysis, bioinformatics, signal processing, document analysis, and distributed computing frameworks. 

 

Emanuele Trucco – Navigating the perilous waters of validation: the case of retinal image analysis

 Abstract

The explosion of algorithms to process medical images should draw increasing attention to validation methodologies, i.e. how to declare that a software tool actually works. In medical image analysis validation is complicated by several issues linked to the nature of the data, acquisition protocols, operators and devices, availability of annotated data, characteristics of the annotations (e.g. protocols, type of annotation) and others. Although frameworks for validation have been proposed (but not universally adopted), substantial questions remain open, including the overarching one:  how much can measurements (taken in a general sense) be trusted for subsequent decision making, be it statistical analysis, diagnosis etc? This talk attempts to capture the main issues behind validation, based on the 10+ years of interdisciplinary experience of the VAMPIRE group on retinal biomarkers, including crowdsourcing. The talk also aims to raise attention and interest on this crucial field of medical and healthcare data processing.

Slides – for more information, please contact Emanuele Trucco, VAMPIRE Project Director (Dundee), University of Dundee, e.trucco@dundee.ac.uk

Bio

Emanuele (Manuel) Trucco, MSc, PhD, FRSA, FIAPR, is the NRP Chair of Computational Vision in Computing, School of Science and Engineering, at the University of Dundee, and an Honorary Clinical Researcher of NHS Tayside. He has been active since 1984 in computer vision, and since 2002 in medical image analysis. He has published more than 250 refereed papers and 2 textbooks (one of which an international standard with 2,793 citations, Google Scholar 25 Oct 2016). He is director of VAMPIRE (Vessel Assessment and Measurement Platform for Images of the Retina), an international research initiative led by the Universities of Dundee and Edinburgh (T MacGillivray, tech director). VAMPIRE develops software tools for efficient data and image analysis, especially multi-modal retinal images. VAMPIRE has been used in biomarker studies on cardiovascular risk, stroke, dementia, cognitive performance, neurodegenerative diseases, genetics and more, and has grown strong collaborations with clinical departments around the world. International collaborators include UCLA, Harvard, Tufts, A*STAR Singapore, the Chinese Academy of Science (Ningbo), INRIA, Charite’ Berlin, Univ of Padova and many more. Further, recent projects have focused on robotic hydrocolonoscopy and whole-body MR angiographic data. Current industrial collaborations include Toshiba Medical, OPTOS plc, and Epipole retinal cameras. Manuel is particularly interested in validation, the reliability of retinal measurements, and its consequences for statistical inference.

Program

8:00 Opening

  • Veronika Cheplygina – Welcome

8:15-9:00  Invited talk

  • Emanuele Trucco – Navigating the perilous waters of validation: the case of retinal image analysis Slides

9:00-9:45  Invited talk

  •  Danna Gurari – Mixing Crowds, Computers, and Experts for Scalable Annotation of Biomedical Images. Slides

9:45 -11:15 Posters (Poster spotlights at 9:45, coffee at 10:00)

  • All accepted papers and abstracts

11:15-11:45 Contributed talks 

  • Chuanhai Zhang et al – Real Data Augmentation for Medical Image Classification
  • Alison Q. O’Neil et al – Crowdsourcing labels for pathological patterns in CT lung scans: Can non-experts contribute expert-quality ground truth?

11:45-12:30 Invited talk

  • Tanveer Syeda-Mahmood – Challenges of large-scale data annotations for building cognitive medical assistants

 

Accepted papers

 

Real Data Augmentation for Medical Image Classification PDF
Chuanhai Zhang, Wallapak Tavanapong, Johnny Wong, Piet C. de Groen, JungHwan Oh

Crowdsourcing labels for pathological patterns in CT lung scans: Can non-experts contribute expert-quality ground truth? PDF
Alison Q. O’Neil, John T. Murchison, Edwin J. R. van Beek, Keith A. Goatman

Exploring the similarity of medical imaging classification problems PDF
Veronika Cheplygina, Pim Moeskops, Mitko Veta, Behdad Dashtbozorg, Josien Pluim

Detecting and Classifying Nuclei on a Budget PDF
Joseph G. Jacobs, Gabriel J. Brostow, Alex Freeman, Daniel C. Alexander, Eleftheria Panagiotaki

Towards An Efficient Way of Building Annotated Medical Image Collections for Big Data Studies PDF
Yaniv Gur, Mehdi Moradi, Hakan Bulu, Yufan Guo, Colin Compas, Tanveer Syeda-Mahmood

Expected exponential loss for gaze-based video and volume ground truth annotation PDF
Laurent Lejeune, Mario Christoudias, Raphael Sznitman

SwifTree: Interactive Extraction of 3D Trees Supporting Gaming and Crowdsourcing PDF
Ghassan Hamarneh and Mian L Huang

Crowdsourced emphysema assessment PDF
Silas N Ørting, Veronika Cheplygina, Jens Petersen, Laura Thomsen, Mathilde Winkler, Marleen de Bruijne

A Web-based Platform for Distributed Annotation of Computerized Tomography Scans PDF
Nicholas Heller, Panagiotis Stanitsas, Vassilios Morellas, Nikolaos Papanikolopoulos

Training Deep Convolutional Neural Networks with Active Learning for Exudate Classi cation in Eye Fundus Images PDF
Juan S Otálora Montenegro, Oscar J Perdomo, Henning Müller, Fabio A. Gonzalez

Uncertainty Driven Fully Convolutional Networks for Histopathology Image Segmentation PDF
Aicha BenTaieb, Ghassan Hamarneh

 

Accepted abstracts

10 Years of Grand MICCAI Challenges – Curse and Blessing 
Matthias Eisenmann, Patrick Scholz, Marko Stankovic, Annika Reinke, Sinan Onogur, Pierre Jannin, Christian Stock, Lena Maier-Hein

How many radiologists does it take to reliably delineate a tumor? A large-scale clinical study of observer variability PDF
D. Cohen, L. Joskowicz, N. Caplan, J. Sosna

A Fiji Tool for Automatic Fusion of Segmentation and Tracking Labels PDF
Vladimír Ulman, Martin Maska, David Svoboda, Michal Kozubek

How to Create the Largest In-Vivo Endoscopic Dataset PDF
Veith Roethlingshoefer, Sebastian Bittel, Hannes Kenngott, Martin Wagner, Sebastian Bodenstedt, Tobias Ross, Stefanie Speidel, Lena Maier-Hein

 

 

 

Organizers

 

Advisory board

  • Marco Loog, Delft University of Technology (TU Delft), The Netherlands

 

Program Committee

Adrian Barbu – Florida State University, USA
Danna Gurari – University of Texas at Austin, USA
Dinggang Shen – UNC Chapel Hill, USA
Filipe Condessa – Instituto Superior Tecnico, Portugal
Jaime Cardoso – Universidade do Porto, Portugal
Joao Papa – Sao Paulo State University, Brazil
Ksenia Konyushova – EPFL, Switzerland
Le Lu – NIH, USA
Loic Peter – University College London, UK
Marco Pedersoli – École de technologie supérieure, Canada
Michael Goetz – German Cancer Research Center (DKFZ), Germany
Neeraj Dhungel – The University of Adelaide, Australia
Raphael Sznitman – University of Bern, Switzerland
Roger Tam – The University of British Columbia, Canada
Shadi Albarqouni – Technische Universität München, Germany
Silas Ørting – University of Copenhagen, Denmark
Weidong Cai – University of Sydney

 

Special thanks

  • Carolin Feldmann, German Cancer Research Cener (DKFZ) – Logo design

Sponsor