Chen-Yu Lee

Chen-Yu Lee










About Me

I am currently a research scientist at Google, working on machine learning and its applications to computer vision and natural language processing. I completed my PhD in deep learning, advised by Professors Zhuowen Tu and Pamela Cosman at UC San Diego.

Publications

FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extraction

Chen-Yu Lee, Chun-Liang Li, Timothy Dozat, Vincent Perot, Guolong Su, Nan Hua, Joshua Ainslie, Renshen Wang, Yasuhisa Fujii, and Tomas Pfister
ACL 2022 / Paper / Google AI Blog

Learning to Prompt for Continual Learning

Zifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang, Ruoxi Sun, Xiaoqi Ren, Guolong Su, Vincent Perot, Jennifer Dy, and Tomas Pfister
CVPR 2022 / Paper / Google AI Blog

Learning from Weakly-labeled Web Videos via Exploring Sub-Concepts

Kunpeng Li, Zizhao Zhang, Guanhang Wu, Xuehan Xiong, Chen-Yu Lee, Zhichao Lu, Yun Fu, and Tomas Pfister
AAAI 2022 / Paper / Google AI Blog

ROPE: Reading Order Equivariant Positional Encoding for Graph-based Document Information Extraction

Chen-Yu Lee, Chun-Liang Li, Chu Wang, Renshen Wang, Yasuhisa Fujii, Siyang Qin, Ashok Popat, and Tomas Pfister
ACL 2021 / Paper (Oral Presentation)

Learning to Branch for Multi-Task Learning

Pengsheng Guo, Chen-Yu Lee, and Daniel Ulbricht
ICML 2020 / Paper

Sliced Wasserstein Discrepancy for Unsupervised Domain Adaptation

Chen-Yu Lee, Tanmay Batra, Mohammad Haris Baig, and Daniel Ulbricht
CVPR 2019 / Paper / Code /  ML Journal

GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks

Zhao Chen, Vijay Badrinarayanan, Chen-Yu Lee, and Andrew Rabinovich
ICML 2018 / Paper

RoomNet: End-to-End Room Layout Estimation

Chen-Yu Lee, Vijay Badrinarayanan, Tomasz Malisiewicz, and Andrew Rabinovich
ICCV 2017 / Paper

Generalizing Pooling Functions in CNNs: Mixed, Gated, and Tree

Chen-Yu Lee, Patrick Gallagher, and Zhuowen Tu
TPAMI 2017 / Paper

Recursive Recurrent Nets with Attention Modeling for OCR in the Wild

Chen-Yu Lee and Simon Osindero
CVPR 2016 / Paper

Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Tree

Chen-Yu Lee, Patrick Gallagher, and Zhuowen Tu
AISTATS 2016 / Paper / Code

Deeply-Supervised Nets

Chen-Yu Lee*, Saining Xie*, Patrick Gallagher, Zhengyou Zhang, and Zhuowen Tu (*equal contribution)
AISTATS 2015 / Paper / Code
NIPS 2014 Workshop / Paper (Oral Presentation)

Region-based Discriminative Feature Pooling for Scene Text Recognition

Chen-Yu Lee, Anurag Bhardwaj, Wei Di, Vignesh Jagadeesh, and Robinson Piramuthu
CVPR 2014 / Paper

Tracking Epithelial Cell Junctions in C. elegans Embryogenesis with Active Contours Guided by SIFT Flow

Sukryool Kang, Chen-Yu Lee, Monira Goncalves, Andrew Chisholm, and Pamela Cosman
TBME 2014 / Paper

Automated Cell Junction Tracking with Modified Active Contours Guided by SIFT Flow

Chen-Yu Lee, Sukryool Kang, Andrew Chisholm, and Pamela Cosman
ISBI 2014 / Paper / Demo

Smoke Detection Using Spatial and Temporal Analyses

Chen-Yu Lee, Chin-Teng Lin, Chao-Ting Hong, and Miin-Tsair Su
IJICIC 2012 / Paper

Spatio‐temporal Analysis in Smoke Detection

Chen-Yu Lee, Chin‐Teng Lin, and Chao‐Ting Hong
ICSIPA 2009 / Paper / Project Page

Tech Report

Training Deeper Convolutional Networks with Deep Supervision

Liwei Wang, Chen-Yu Lee, Zhuowen Tu, and Svetlana Lazebnik
arXiv 2015 / Paper / Code / Leaderboard of MIT Place205

Patents

Meta-Learning for Multi-Task Learning for Neural Networks

Andrew Rabinovich, Vijay Badrinarayanan, Srivignesh Rajendran, and Chen-Yu Lee
US Patent 11048978 (2021/6/29)

Room Layout Estimation Methods and Techniques

Chen-Yu Lee, Vijay Badrinarayanan, Tomasz Malisiewicz, and Andrew Rabinovich
US Patent 10657376 (2020/5/19)

System and Method for Scene Text Recognition

Anurag Bhardwaj, Chen-Yu Lee, Robinson Piramuthu, Vignesh Jagadeesh, and Wei Di
US Patent 9245191 (2016/1/26)

Academic Services

Reviewer

CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, BMVC, PAMI, IJCV, JMLR, TIP, TNNLS

Outstanding Reviewer

CVPR 2019, BMVC 2019

Program Committee Member

Computer Vision for AR/VR Workshop at CVPR 2020