Chen Wei

I am a final-year Computer Science Ph.D. student at Johns Hopkins University, where I am fortunate to be advised by Bloomberg Distinguished Professor Alan L. Yuille. I received my B.S. with honors from Peking University. I spent great time at Google DeepMind, FAIR @ Meta.

weichen3012 [at] gmail [dot] com  /  Google Scholar  /  Twitter

profile photo
Research Interest
My research lies at the intersection of machine learning and computer vision, driven by the goal of developing flexible and general-purpose intelligent systems. My research has primarily focused on two critical steps toward this goal, (1) to encode enormously complex raw visual signals to structured representations that are easier to understand and process for machine, and (2) to connect visual representations to higher-order cognition and commonsense reasoning about the world. To address these challenges, I have been working on:
I am on the job market for 2024! Would love to chat more if you are interested. I am also happy to give talks on my research in related seminars.
[11/01/2023] Check out the cool examples from De-Diffusion Makes Text a Strong Cross-Modal Interface!
[10/31/2023] Gave a talk at MIT Visual Computing Seminar.
[10/27/2023] Gave a talk at The Computational Vision and Learning Lab @ UCLA.
[08/29/2023] I have been selected as one of the EECS Rising Stars 2023.
[07/16/2023] DiffMAE and SMAUG accepted to ICCV 2023.
[04/23/2023] Hiera accepted to ICML 2023 as oral presentation.
[04/06/2023] Excited to release our new work on reformulating Diffusion Models as Masked Autoencoders.
[10/19/2022] Proud to be an ECCV 2022 outstanding reviewer.
[09/07/2022] Passed my Graduate Board Oral exam and now a PhD candidate :)
De-Diffusion Makes Text a Strong Cross-Modal Interface
Chen Wei, Chenxi Liu, Siyuan Qiao, Zhishuai Zhang, Alan Yuille, Jiahui Yu
arXiv , 2023
arXiv / project page
Diffusion Models as Masked Autoencoders
Chen Wei, Karttikeya Mangalam, Po-Yao Huang, Yanghao Li, Haoqi Fan, Hu Xu, Huiyu Wang, Cihang Xie, Alan Yuille, Christoph Feichtenhofer
ICCV , 2023
arXiv / project page / Marktechpost
SMAUG: Sparse Masked Autoencoder for Efficient Video-Language Pre-Training
Yuanze Lin, Chen Wei, Huiyu Wang, Alan Yuille, Cihang Xie
ICCV , 2023
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles
Chaitanya Ryali*, Yuan-Ting Hu*, Daniel Bolya*, Chen Wei, Haoqi Fan, Po-Yao Huang, Vaibhav Aggarwal, Arkabandhu Chowdhury, Omid Poursaeed, Judy Hoffman, Jitendra Malik, Yanghao Li*, Christoph Feichtenhofer*
ICML , 2023 Oral
arXiv / code
Masked Autoencoders Enable Efficient Knowledge Distillers
Yutong Bai, Zeyu Wang, Junfei Xiao, Chen Wei, Huiyu Wang, Alan Yuille, Yuyin Zhou, Cihang Xie
CVPR , 2023
arXiv / code
CP2: Copy-Paste Contrastive Pretraining for Semantic Segmentation
Feng Wang, Huiyu Wang, Chen Wei, Alan Yuille, Wei Shen
ECCV , 2022
arXiv / code
In Defense of Image Pre-Training for Spatiotemporal Recognition
Xianhang Li, Huiyu Wang, Chen Wei, Jieru Mei, Alan Yuille, Yuyin Zhou, Cihang Xie
ECCV , 2022
arXiv / code

Masked Feature Prediction for Self-Supervised Visual Pre-Training
Chen Wei*, Haoqi Fan, Saining Xie, Chao-Yuan Wu, Alan Yuille, Christoph Feichtenhofer*
CVPR , 2022
arXiv / code at pySlowFast

Most Influential CVPR Papers (2023-04)
iBOT: Image BERT Pre-Training with Online Tokenizer
Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong
ICLR , 2022
arXiv / code / press

CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learning
Chen Wei, Kihyuk Sohn, Clayton Mellina, Alan Yuille, Fan Yang
CVPR , 2021
arXiv / code / poster / video

CO2: Consistent Contrast for Unsupervised Visual Representation Learning
Chen Wei, Huiyu Wang, Wei Shen, Alan Yuille
ICLR , 2021
arXiv / Open Review / video

Iterative Reorganization with Weak Spatial Constraints:
Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learning

Chen Wei, Lingxi Xie, Xutong Ren, Yingda Xia, Chi Su, Jiaying Liu, Qi Tian, Alan Yuille
CVPR, 2019
arXiv / code

Deep Retinex Decomposition for Low-Light Enhancement
Chen Wei*, Wenjing Wang*, Wenhan Yang, Jiaying Liu
BMVC, 2018 Oral arXiv / code / project page & dataset

Most Cited BMVC Papers Over the Last Five Years No.2

GLADNet: Low-Light Enhancement Network with Global Awareness
Wenjing Wang*, Chen Wei*, Wenhan Yang, Jiaying Liu
FG Workshop, 2018
PDF / code / project page

  • Student Researcher, Google DeepMind, Summer 2023
  • Research Intern, Facebook AI Research (Meta AI), Summer 2022
  • Research Intern, Facebook AI Research, Summer 2021
  • Research Intern, Google Cloud AI, Summer 2020
  • Research Intern, Johns Hopkins University, Summer 2018
  • Engineering Practium Intern, Google, Summer 2017
  • Research Intern, STRUCT Lab, Peking University, 2017 - 2019

Last update: Nov. 2023      Template