Brain Lesion Segmentation

We are developing deep learning algorithms to perform lesion segmentation from multi-sequence MRI for various diseases including glioma, brain metastases, adrenoleukodystrophy and stroke.

Project links: Latest publication ● DeepNeuro

Radiogenomics

Identification of tumor mutation status can improve prognostication and guide patient management, but requires a highly invasive biopsy. We are developing a “virtual biopsy” technique based on deep learning that may be applied to multi-sequence MRI to accurately predict isocitrate dehydrogenase (IDH) mutations and 1p19q co-deletions in glioma.

Project links: Latest publication ● GitHub

Retinopathy of Prematurity

Retinopathy of prematurity (ROP) is a disease that affects the retinal vasculature of preterm and low birthweight infants. We are developing algorithms for retinal vessel segmentation and automated diagnosis from fundus photographs based on deep learning, as well as risk models to predict treatment-requiring disease.

Project links: Latest publication ● deeprop.io

Open-Source Imaging Software

Our goal is to provide readily-usable software applications for the clinical and research community in neuroimaging. We develop software for 3D Slicer, an open-source analysis and visualization platform for medical images, and develop user-friendly Python packages for machine learning algorithms. Most recently, we are developing DeepNeuro, a deep learning neuroimaging package that uses Docker containers to ensure easy, repeatable implementation of neural network architectures.

Project links: DeepNeuro ● 3D Slicer ● Segmentation wizard (3D Slicer) ● QTIM Tools

Distributed Learning

Training deep neural networks typically requires centrally-hosted data, which presents challenges for multi-institutional collaborations both in terms of logistics and HIPAA compliance. We are developing a platform that allows distribution of neural network models that serves as an effective alternative to sharing patient data.

Project links: Latest publication

Therapeutic Clinical Trials

Using advanced MRI or PET acquisition and analysis approaches, we are focused on better understanding why (or why not) novel drugs are working in patients with primary or metastatic brain tumors. These noninvasive tools are critical to improving care for patients with these challenging diseases by understanding drug mechanism of action and the biological impact of new drugs on the tumor.

Project links: Recent publication ● Clinical trial

Dynamic MRI Analysis

We are developing novel methods for analyzing dynamic MRI, including dynamic susceptibility (DSC) MRI and dynamic contrast-enhanced MRI (DCE). We evaluate the accuracy and repeatability of common dynamic MRI modeling schemes under clinically-relevant scanning conditions, and create digital reference objects and noise correction algorithms to address errors in these schemes. Recently, we have been applying recurrent neural networks to dynamic MR data to predict patient outcomes and tease out relationships with other imaging modalities, such as PET imaging.

Project links: Latest publication ● Recent publication ● QTIM DCE ● QTIM Phantoms

Image Visualization

We develop interactive data visualizations for medical imaging data, and research novel algorithms for practically visualizing features generated by machine learning algorithms. Using generative adversarial networks and filter activation visualizations, we isolate and characterize the most informative features in both 2D and 3D neural networks. We collaborate with researchers at the Harvard-Smithsonian Center for Astrophysics to develop Glue, an open-source data visualization platform.

Project links: Glue ● DeepNeuro

Other Projects

We also work on applications of machine learning for other medical applications, such as diagnosis of osteoarthritis from knee radiographs, predicting success of success of breast reconstruction from CT angiography, and automatic assessment of white matter changes due to proton therapy.

Project links: KneeDeep ● DeepNeuro