Deep learning workflow in radiology: how to get started

In the past decade, deep learning architectures, which essentially consist of neural networks with numerous layers, have emerged as a dominant class of machine learning algorithms. Owing to the availability of larger datasets in radiology and access to high-performance graphical processing units, deep learning has provided state-of-the-art performance for various computer vision tasks such as lesion detection, segmentation, classification, monitoring, and prediction of treatment response.

Because of the open access to deep neural network architectures and the numerous clinical use scenarios already reported in the radiology literature, we anticipate that deep learning will be highly prevalent in machine learning publications in the near future. However, to any radiologist who would like to start a deep learning project ‘from scratch’ by exploiting institutional data, the path may be unclear and rugged.

In this paper, we provide a roadmap for radiologists or teams eager to undertake a deep learning-based project. For educational purposes, we describe a prototypical workflow for liver lesion detection, segmentation, classification, monitoring, and prediction of tumor recurrence and patient survival. For convenience, we included a structured checklist. We also discussed challenges, including ethical considerations, cohorting, data collection, anonymization, and availability of expert annotations. This practical guidance may be adapted to any project that requires automated medical image analysis.

Key points

  • Deep learning provides state-of-the-art performance for detection, segmentation, classification, and prediction.
  • A multi-disciplinary team with clinical, imaging, and technical expertise is recommended.
  • Data collection and curation constitute the most time-consuming steps.
  • Several open-source deep learning frameworks with permissive licenses are available.
  • Cloud computing leverages third-party hardware, storage, and technical resources.

Article: Deep learning workflow in radiology: a primer 

Authors: Emmanuel Montagnon, Milena Cerny, Alexandre Cadrin-Chênevert, Vincent Hamilton, Thomas Derennes, André Ilinca, Franck Vandenbroucke-Menu, Simon Turcotte, Samuel Kadoury & An Tang

WRITTEN BY

  • An Tang

    Associate Professor, Radiology Department, University of Montreal, Montreal, Canada

Latest posts

Become A Member Today!

You will have access to a wide range of benefits that can help you advance your career and stay up-to-date with the latest developments in the field of radiology. These benefits include access to educational resources, networking opportunities with other professionals in the field, opportunities to participate in research projects and clinical trials, and access to the latest technologies and techniques. 

Check out our different membership options.

If you don’t find a fitting membership send us an email here.

Membership

for radiologists, radiology residents, professionals of allied sciences (including radiographers/radiological technologists, nuclear medicine physicians, medical physicists, and data scientists) & professionals of allied sciences in training residing within the boundaries of Europe

  • Reduced registration fees for ECR 1
  • Reduced fees for the European School of Radiology (ESOR) 2
  • Exclusive option to participate in the European Diploma. 3
  • Free electronic access to the journal European Radiology 4
  • Content e-mails for all ESR journals
  • Updates on offers & events through our newsletters
  • Exclusive access to the ESR feed in Juisci

€ 11 /year

Yes! That is less than €1 per month.

Free membership

for radiologists, radiology residents or professionals of allied sciences engaged in practice, teaching or research residing outside Europe as well as individual qualified professionals with an interest in radiology and medical imaging who do not fulfil individual or all requirements for any other ESR membership category & former full members who have retired from all clinical practice
  • Reduced registration fees for ECR 1
  • Free electronic access to the journal European Radiology
  • Content e-mails for all 3 ESR journals 4
  • Updates on offers & events through our newsletters
  • Exclusive access to the ESR feed in Juisci

€ 0

The best things in life are free.

ESR Friends

For students, company representatives or hospital managers etc.

  • Content e-mails for all 3 ESR journals 4
  • Updates on offers & events through our newsletters

€ 0

Friendship doesn’t cost a thing.

The membership type best fitting for you will be selected automatically during the application process.

Footnotes:

01

Reduced registration fees for ECR 2024:
Provided that ESR 2023 membership is activated and approved by August 31, 2023.

Reduced registration fees for ECR 2025:
Provided that ESR 2024 membership is activated and approved by August 31, 2024.

02
Not all activities included
03
Examination based on the ESR European Training Curriculum (radiologists or radiology residents).
04
European Radiology, Insights into Imaging, European Radiology Experimental.