January 3, 2018

Making the Most of Brain MRI: Machine Learning Integrated with Image Post-Processing

Shapshots from our applications in MS and epilepsy

18-NEU-508-Nakamura-MRI-650×450

By Kunio Nakamura, PhD, and Z. Irene Wang, PhD

Advertisement

Cleveland Clinic is a non-profit academic medical center. Advertising on our site helps support our mission. We do not endorse non-Cleveland Clinic products or services. Policy

The advent of artificial intelligence and machine learning is revolutionizing the way large volumes of patient data are interpreted. Scientists in Cleveland Clinic’s Neurological Institute are devoting substantial efforts to using machine-learning algorithms to inform the way pathological substrates are being detected and delineated in imaging studies. This post briefly profiles our work in this area in two major neurological diseases — multiple sclerosis (MS) and epilepsy.

Multiple sclerosis

One innovative application of machine learning is for quantification of MS lesion loads from clinical imaging studies. Researchers with Cleveland Clinic’s Lerner Research Institute and Mellen Center for Multiple Sclerosis Treatment and Research have analyzed MRIs acquired on clinical scanners using a Random Forest algorithm, which improves overall segmentation accuracy over other methods when compared with consensus segmentation from multiple reviewers (Figure 1).

Figure 1. Top: Box plots of Dice similarity measures from various MS lesion segmentation methods. The Dice ranges from 0 to 1, with 0 being no overlap and 1 being perfect overlap. Our proposed machine-learning method (second plot from the right) showed the highest mean Dice measure. Although far from achieving perfect overlap, our method is approaching the range of inter-reviewer variability (rightmost plot). Bottom: Example of visual comparison of lesion segmentation methods.

Notably, the algorithm is able to analyze MRIs from various clinical protocols and from different MRI models, including field strengths of 1T, 1.5T and 3T, as well as from various scanner manufacturers (Figure 2).

Figure 2. T2 lesion segmentation from eight different scanner models showing the applicability in various clinical MS protocols.

When compared with clinical reads by neuroradiologists, the automatic lesion volumes showed good associations between severity categories and visually confirmed the lesion probability maps based on the categories (Figure 3). These findings highlight the usefulness of machine-learning techniques and suggest a potential to change routine practice.

Advertisement

Figure 3. Left: Box plots of normalized T2 MS lesion volume according to clinical reads. Right: Average lesion probability map overlaid on average fluid-attenuated inversion recovery (FLAIR) images for each clinical category. The images show increasing lesion probability in periventricular and subcortical areas. Concurrently, an enlargement of the ventricles is seen as clinical severity intensifies from mild to severe.

Epilepsy

Equipped with a large surgical volume, MRI data and pathological confirmation of resected tissue, the research group in Cleveland Clinic’s Epilepsy Center is investigating machine-learning strategies designed to directly correlate MRI with pathological findings.

Figure 4 shows an automated multivariate surface-based morphometry analysis methodology combined with machine learning for automated detection of focal cortical dysplasia (FCD). The analysis was based on measures such as cortical thickness, gray-white matter blurring, sulcal depth and curvature, and cortical shape deformation. Additionally, asymmetry maps were generated to account for inherent left-right differences in each individual brain.

These features were used as input to a machine-learning algorithm realized by a nonlinear neural network classifier for automated lesion detection, yielding output of clusters with a high likelihood of abnormality. The current method already showed robust performance on 3T data from different scanners. Figure 4 presents findings from an example patient whose subtle MRI lesion was successfully and automatically recognized by the current method.

Figure 4. Images illustrating a multivariate surface-based morphometry approach for automated focal cortical dysplasia (FCD) detection. (A) 3T T1w MRI from a patient with histopathologically confirmed type I FCD in the left basal temporal area (circles). (B) Various cortical features generated from the surface-based morphometry approach, which were used as input to a nonlinear neural network classifier. The output cluster with the highest mean probability value (as yielded by the classifier) was considered the final cluster (C). Success of detection was defined by overlap between the final cluster and manual labeling (informed by noninvasive test, SEEG, postoperative MRI and histopathology) (D).

Eventually, machine-learning techniques will enable the construction of a well-trained computer algorithm based on retrospectively validated data derived from a large number of patients. Such an algorithm could be used as an independent “consultant” to inform clinical recommendations on a case-by-case basis.

Advertisement

This strategy will have lasting impact across the country by markedly improving epilepsy seizure outcomes and increasing the number of patients who can be deemed favorable candidates for potentially curative surgery.

Dr. Wang (wangi2@ccf.org) is a staff scientist in Cleveland Clinic’s Epilepsy Center and joint staff in the Department of Biomedical Engineering, Cleveland Clinic Lerner Research Institute.

Dr. Nakamura (nakamuk@ccf.org) is a project scientist in the Department of Biomedical Engineering.

Related Articles

21-NEU-2225280_omnidirectional-treadmill_650x450
July 28, 2021
New VR Platform Fuses Physical and Virtual Worlds in Parkinson’s Disease and Beyond

Taking virtual reality-integrated technology from silver screen to clinical laboratory

20-NEU-1990658 NeuroDesign Innovation fellowship_CQD_650x450_896358708
December 29, 2020
‘NeuroDesign’ Fellowship Aims to Shape Next Generation of Neurosurgery Entrepreneurs

Novel collaboration is underway to foster innovation – and a real-world invention

19-NEU-5568-Artificial-Intelligence-Epilepsy-Seizure-Detection
December 6, 2019
Deep Learning Models for Automatic Seizure Detection in Epilepsy

Strong performance from early models heralds eventual reshaping of care

brain mapping in epilepsy
December 5, 2019
Integrating MRI Post-Processing with Artificial Intelligence in Epilepsy

Novel approach is improving presurgical evaluation

nine-hole peg test on an ipad
December 4, 2019
Realizing Next-Generation Motor Assessment Through Massive Tech-Enabled Data Capture

Important progress toward predictive analytics in MS and PD

19-NEU-6003_650x450-CQD-Image
October 24, 2019
Cerebrovascular Roundup: Breakthroughs in Treating Brain Aneurysms

A quick review of 3D-printed models, intrasaccular flow disruption and flow diverter stenting

AMI-Tuck-1642295     06-25-19
July 11, 2019
Therapeutic Arts Program Aims to Make Patients Resilient in the Face of Multiple Sclerosis

Early results with ‘HeRe We Arts’ spur testing in a randomized trial

19-NEU-517-3D-Printed-Aneurysm-650×450
June 5, 2019
3D-Printed Replica of Brain Aneurysm Helps Guide Surgical Repair

One of first reported uses of the technology for a cerebrovascular malformation

Ad