« Clinical Applications of Medical Image Analyses

Tomohisa Okada

Advances in medical imaging modalities have given us enormous databases of medical images. There is much information to learn from them, but extracting information with bare eyes only is by no means an easy task. However, with wide-spread application of functional MRI, analysis methods of brain images that borrow from machine learning have also dramatically improved. I would like to present some examples of their clinical applications, to draw the interest of the audience and possibility encourage further work in the field of medical image processing.

Scroll with j/k | | | Size

Slide: Clinical applications of medical image analyses
Tomohisa Okada, MD, PhD
Diagnostic Imaging and Nuclear Medicine Kyoto University Hospital

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Clinical applications of medical image analyses
Tomohisa Okada, MD, PhD
Diagnostic Imaging and Nuclear Medicine Kyoto University Hospital

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

1

Slide: Aim
facilitate you to find a way in medial image analyses

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Aim
facilitate you to find a way in medial image analyses

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

2

Slide: Movements in Medical Imaging
Different Needs in Different Regions Your 5-Minute Shots at ISMRM2012



1 min! Google map
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Movements in Medical Imaging
Different Needs in Different Regions Your 5-Minute Shots at ISMRM2012

1 min! Google map
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

3

Slide: What clinicians need?

Diagnostic HELP!
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

What clinicians need?

Diagnostic HELP!
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

4

Slide: Kyoto Univ Hospital
Out patient clinic

Research Bldgs Wards Clinical MRIs In Patinets

Research MRIs

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Kyoto Univ Hospital
Out patient clinic

Research Bldgs Wards Clinical MRIs In Patinets

Research MRIs

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

5

Slide: MRI imaging is flexible

Up to your programing capability!

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

MRI imaging is flexible

Up to your programing capability!

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

6

Slide: Tetsugaku no Michi (Philosopher's Walk)
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Tetsugaku no Michi (Philosopher's Walk)
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

7

Slide: Unthinkable: the Alzheimers Epidemic.
The disease of the 21st century as an estimated 5.4 million people have been diagnosed with Alzheimers. It is the sixth-leading cause of death across all ages in the United States, but many Americans still do not know much about this illness.
Source: http://edition.cnn.com/SPECIALS/2011/larryking/

CNN: Larry King special

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Unthinkable: the Alzheimers Epidemic.
The disease of the 21st century as an estimated 5.4 million people have been diagnosed with Alzheimers. It is the sixth-leading cause of death across all ages in the United States, but many Americans still do not know much about this illness.
Source: http://edition.cnn.com/SPECIALS/2011/larryking/

CNN: Larry King special

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

8

Slide: The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

9

Slide: Epilepsy

T2WI

FLAIR

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Epilepsy

T2WI

FLAIR

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

10

Slide: Evidence-based medicine was proposed in 1992!

How to diagnose?

Objective methods are required!!
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Evidence-based medicine was proposed in 1992!

How to diagnose?

Objective methods are required!!
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

11

Slide: Temporal lobe epilepsy (TLE)

T2WI

FLAIR

Morimoto et al., Eur Radiol, 2012
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

DIR

Temporal lobe epilepsy (TLE)

T2WI

FLAIR

Morimoto et al., Eur Radiol, 2012
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

DIR

12

Slide: TL EpilepsyLt or Rt?
SVM analysis for
1) volume & 2) shape (spectrum) at 83 areas (structures) in 28 TLE pts vs.80 normals.

Some correlations in atrophy

PLoS One 7:e33096
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

TL EpilepsyLt or Rt?
SVM analysis for
1) volume & 2) shape (spectrum) at 83 areas (structures) in 28 TLE pts vs.80 normals.

Some correlations in atrophy

PLoS One 7:e33096
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

13

Slide: How to get hidden information?
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

How to get hidden information?
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

14

Slide: Image Processing
each individual, image contrast, distortion, artifact, etc.  Brain Normalization: non-linear warping ex. DCT  Extraction of information
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Confounding differences in

Image Processing
each individual, image contrast, distortion, artifact, etc. Brain Normalization: non-linear warping ex. DCT Extraction of information
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Confounding differences in

15

Slide: Anatomical Normalization Talairach Atlas  Segmentation  Smoothing

 Statistics
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Anatomical Normalization Talairach Atlas Segmentation Smoothing

Statistics
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

16

Slide: 54 subjects (19  73 y.o.), P < 0.005

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

54 subjects (19 73 y.o.), P < 0.005

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

17

Slide: Chronic Fatigue Syndrome

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Chronic Fatigue Syndrome

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

18

Slide: Neural Correlates to Fatigue

BMC Neurology 4:14

More sophisticated analyses  Better understanding of illness
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Neural Correlates to Fatigue

BMC Neurology 4:14

More sophisticated analyses Better understanding of illness
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

19

Slide: http://editthis.info/psy3242/Hippocampus

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

http://editthis.info/psy3242/Hippocampus

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

20

Slide: Sensitivity & specificity > 80%

OBrien et al., 1997

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Sensitivity & specificity > 80%

OBrien et al., 1997

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

21

Slide: Thompson PM et al., 2003, JNS 23:994
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Thompson PM et al., 2003, JNS 23:994
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

22

Slide: A 36 y.o. female with family history of AD. Fox et al., 2001
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

A 36 y.o. female with family history of AD. Fox et al., 2001
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

23

Slide: ADNI: Alzheimers Disease Neuroimaging Initiative
AD(red):164, Norm(blue):203, Norm->AD(Cyan):2. Entorhinal Radiology 2011, 259: 834

Hippocampus

http://inunekomonogatari.seesaa .net/category/4768766-1.html

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

ADNI: Alzheimers Disease Neuroimaging Initiative
AD(red):164, Norm(blue):203, Norm->AD(Cyan):2. Entorhinal Radiology 2011, 259: 834

Hippocampus

http://inunekomonogatari.seesaa .net/category/4768766-1.html

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

24

Slide: Volumetry in clinical practice!
Stand alone PC analysis in 10 min

Atrophic areas in epileptic pt.

FDG-PET

Matsuda et al., AJNR 2012

Sensitivity of AD 91.6 - 98.2%
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Volumetry in clinical practice!
Stand alone PC analysis in 10 min

Atrophic areas in epileptic pt.

FDG-PET

Matsuda et al., AJNR 2012

Sensitivity of AD 91.6 - 98.2%
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

25

Slide: Gion Shirakawa

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Gion Shirakawa

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

26

Slide: Functional MRI (fMRI)

2011
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Functional MRI (fMRI)

2011
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

27

Slide: Modeling in functional MRI
Task 30 s 30 s Control Control Control Task

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Modeling in functional MRI
Task 30 s 30 s Control Control Control Task

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

28

Slide: Exploratory fMRI analysis: ICA
Observed signals
IC map Activation Time

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Exploratory fMRI analysis: ICA
Observed signals
IC map Activation Time

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

29

Slide: Learning complex finger movements

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Learning complex finger movements

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

30

Slide: ICA as a noise filter
CSF (#1) Slow movement (#14)

Time course Reference

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

ICA as a noise filter
CSF (#1) Slow movement (#14)

Time course Reference

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

31

Slide: http://flowingdata.com/2008/03/12/ 17-ways-to-visualize-the-twitter-universe/

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

http://flowingdata.com/2008/03/12/ 17-ways-to-visualize-the-twitter-universe/

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

32

Slide: Resting & Acting Brain Networks

Rest

Attention Memory

Fox,  & Raichle, PNAS 2005; 102: 9673.

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Resting & Acting Brain Networks

Rest

Attention Memory

Fox, & Raichle, PNAS 2005; 102: 9673.

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

33

Slide: RS-fMRI Connectivity Networks for MCI
116: Automated Anatomical Labeling 0.864

Filtered (0.025  f  0.100 Hz) into 5 freq bands

Univ NC, Duke: 3T, 4*4*4 mm, TR 2s, TE 32ms, 34 slices
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

RS-fMRI Connectivity Networks for MCI
116: Automated Anatomical Labeling 0.864

Filtered (0.025 f 0.100 Hz) into 5 freq bands

Univ NC, Duke: 3T, 4*4*4 mm, TR 2s, TE 32ms, 34 slices
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

34

Slide: Network analysis of resting-state fMRI
26 benign Rolandic epilepsy pts & 16 controls: EEG-fMRI
RS-fMRI: 5min.

PageRank algorithm for node centrality

ISMRM2012:0372
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Network analysis of resting-state fMRI
26 benign Rolandic epilepsy pts & 16 controls: EEG-fMRI
RS-fMRI: 5min.

PageRank algorithm for node centrality

ISMRM2012:0372
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

35

Slide: http://www.graphicshunt.com/images/ bouquet_of_flowers-3271.htm

http://www.biomed.ee.ethz.ch/research/ bioimaging/brain/diffusion_fiber_tracking

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

http://www.graphicshunt.com/images/ bouquet_of_flowers-3271.htm

http://www.biomed.ee.ethz.ch/research/ bioimaging/brain/diffusion_fiber_tracking

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

36

Slide: Water diffusion is restricted in the brain

isotropic

anisotropic

http://www.cse.msstate.edu/ Tractography ~szhang/brain.htm Still under development!

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Water diffusion is restricted in the brain

isotropic

anisotropic

http://www.cse.msstate.edu/ Tractography ~szhang/brain.htm Still under development!

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

37

Slide: Make it simple!

Poincar conjecture, Wikipedia

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Make it simple!

Poincar conjecture, Wikipedia

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

38

Slide: Dale et al., HBM 9: 179, 1999
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Dale et al., HBM 9: 179, 1999
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

39

Slide: Tootell et al., PNAS95:811, 1998
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Tootell et al., PNAS95:811, 1998
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

40

Slide: Talairach Atlas

Words: new vs. old
Fischl et al., HBM 8:272, 1999

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Talairach Atlas

Words: new vs. old
Fischl et al., HBM 8:272, 1999

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

41

Slide: Having fun?

http://inunekomonogatari.seesaa.net/category/4768766-1.html

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Having fun?

http://inunekomonogatari.seesaa.net/category/4768766-1.html

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

42

Slide: Fourier transform in MRI

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Fourier transform in MRI

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

43

Slide: MR image reconstruction
Data 20%

zero filling

Compressed Sensing (Matlab)

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

MR image reconstruction
Data 20%

zero filling

Compressed Sensing (Matlab)

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

44

Slide: MRI reconstruction with HYPR
HighlY constrained back PRojection
FBP

HYPR

Expectation Maximization
MRM 55:30
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

MRI reconstruction with HYPR
HighlY constrained back PRojection
FBP

HYPR

Expectation Maximization
MRM 55:30
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

45

Slide: Small artery, big impact!

Excised Brain
BRAIN 129:2189

Lenticulostriate artery
Gotoh et al., JMRI 2009

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Small artery, big impact!

Excised Brain
BRAIN 129:2189

Lenticulostriate artery
Gotoh et al., JMRI 2009

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

46

Slide: Changes by hypertension

Normal

Hypertensive
Gotoh et al., BJR 2012

The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Changes by hypertension

Normal

Hypertensive
Gotoh et al., BJR 2012

The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

47

Slide: Reconstructions CS vs. ZF
Very high resolution0.2 x 0.2 x 0.5 mm CS: compressed sensing vs. ZF: central sampling with zero-filling

Abstract 362, ISMRM2011
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Reconstructions CS vs. ZF
Very high resolution0.2 x 0.2 x 0.5 mm CS: compressed sensing vs. ZF: central sampling with zero-filling

Abstract 362, ISMRM2011
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

48

Slide: Roles in Medical Image Analyses

will expand HUGE!
The Machine Learning Summer School in Kyoto 2012 at 17:30  18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

Roles in Medical Image Analyses

will expand HUGE!
The Machine Learning Summer School in Kyoto 2012 at 17:30 18:15 on August 31 at Clock Tower Hall, Kyoto Univ.

49