Yufan He

Contact: heyufan1995@gmail.com

I am currently a senior applied research scientist at NVidia, and I'm working on Project MONAI and Isaac for Healthcare. My research interests are in medical image analysis, vision-language models, robotics and world models.

Before that, I received my M.S. and Ph.D. from the Johns Hopkins University and my B.S. from Tsinghua University.

[View my Resume]

Education

Johns Hopkins University

Master of Science
Doctor of Philosophy
Electrical and Computer Engineering
2016 - 2021

Tsinghua University

Bachelor Degree
Electronic Engineering
Economics and Management (Second Degree)
2012 - 2016

Publications

This section contains part of projects that I have participated. Visit my Google Scholar for a full list of papers

VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imaging. (CVPR 2025)

A 3D foundation model that supports a full segmentation workflow. [code] [paper].

VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledge. (CVPR 2025)

A medical VLM that utilizes domain knowledge via expert models. [code] [paper].

SwinUNETR-V2: Stronger Swin Transformers with Stagewise Convolutions for 3D Medical Image Segmentation. (MICCAI 2023)

Upgraded SwinUNETR with convolutions. [code] [paper].

HyperSegNAS: Bridging One-Shot Neural Architecture Search With 3D Medical Image Segmentation Using HyperNet. (CVPR 2022)

A hypernet for one-shot neural archtecture search for 3D medical image segmentation. [paper].

Efficient Population Based Hyperparameter Scheduling for Medical Image Segmentation. (MICCAI 2022)

Efficient hyperparameter search. [code] [paper].

DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentation. (CVPR 2021 oral)

A differentiable neural archtecture search method for 3D medical image segmentation. It contains a new search space and a novel multi-path relaxation scheme for differentiable search. [code] [paper].

TransMorph: Transformer for unsupervised medical image registration. (Medical Image Analysis)

A state-of-the-art unsupervised 3D medical image registration package using swin transformer. [code] [paper].

An ealier conference version "ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration", MIDL 2021, is available [code] [paper].

Self domain adapted network. (MICCAI 2020 oral)

A test-time self domain adaptation method is proposed. It uses auto-encoders' reconstruction loss as a source-target alignment measurement. A set of adaptors are trained and used for domain adaptation in test-time. [code] [paper].

The journal version "Autoencoder based self-supervised test-time adaptation for medical image analysis", Medical Image Analysis 2021, is available [paper].

Fully Convolutional Boundary Regression for Retina OCT Segmentation. (MICCAI 2019 oral)

A novel fully convolutional boundary regression method is proposed for efficient, end-to-end, and topology guaranteed surface segmentation. [code] [paper].

The journal version "Structured layer surface segmentation for retina OCT using fully convolutional regression networks", Medical Image Analysis 2020, is also available [paper].

Experience

Research Assistant

IACL, Johns Hopkins University, Sep.2016 - Nov.2021

PICSL, University of Pennsylvania, June 2015 - Sep 2015

Teaching Assistant

Compressed Sensing, Spring 2018 & 2019, Johns Hopkins University

Random Signal Analysis, Fall 2017, Johns Hopkins University

Internship

AutoML in Medical Imaging, June 2020 - Sep 2020

Autonomous Driving, July 2018 - Sep 2018

Research services

Reviewer for ICCV, CVPR, MICCAI, IEEE TMI, Medical Image Analysis, etc.

Program committee member, SPIE Medical Imaging 2025.

MICCAI Industrial Talk: Open-source Foundation Models for 3D Medical Image Segmentation and Generation. [link]

Awards

MICCAI 2019 Young Scientist Award

1st place on Brats2023, Kits2023, INSTANCE2023 segmentation challenges

The 2018 George M.L. Sommerman Engineering Graduate Teaching Assistant Award

IEEE TMI Distinguished Reviewer

MICCAI 2020 Student Travel Award

MICCAI 2019 Student Travel Award

4th MICCAI Workshop on Ophthalmic Medical Image Analysis 2017, Best Oral Paper Award

Miscellaneous

My lovely dog Kunkka