Lei Ke

Ph.D. Student at CSE, HKUST

I am a Ph.D. student in the CSE Department at HKUST, supervised by Chi-Keung Tang and Yu-Wing Tai. I am now visiting the Computer Vision Lab at ETH Zürich, working with Fisher Yu and Martin Danelljan. I focus on image/video instance segmentation and object tracking, and am interested in its relevant applications. Prior to that, I received my B.E. degree in Software Engineering from Wuhan University.

More info: [Email],[Resume],[Google Scholar], [GitHub].


Highlight Videos

Recent Publications

Video Mask Transfiner for High-Quality Video Instance Segmentation
ECCV 2022
Lei Ke, Henghui Ding, Martin Danelljan, Yu-Wing Tai, Chi-Keung Tang, Fisher Yu
A new HQ-YTVIS benchmark and transformer-based method for highly accurate VIS.
Mask Transfiner for High-Quality Instance Segmentation
CVPR 2022
Lei Ke, Martin Danelljan, Xia Li, Yu-Wing Tai, Chi-Keung Tang, Fisher Yu
An efficient transformer-based method for highly accurate instance segmentation.
Transfiner receives 300+ Github stars in 3 months.
Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation
NeurIPS 2021
Lei Ke, Xia Li, Martin Danelljan, Yu-Wing Tai, Chi-Keung Tang, Fisher Yu
Efficient cross-attention on space-time memory for video instance segmentation.
Spotlight (3% acceptance rate). PCAN receives 200+ Github stars in one month.
Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers
CVPR 2021
Lei Ke, Yu-Wing Tai, Chi-Keung Tang
Instance segmentation with bilayer decoupling structure for occluder & occludee.
BCNet receives 300+ Github stars in 6 months.
Occlusion-Aware Video Object Inpainting
ICCV 2021
Lei Ke, Yu-Wing Tai, Chi-Keung Tang
Commonality-Parsing Network across Shape and Appearance for Partially Supervised Instance Segmentation
ECCV 2020
Qi Fan*, Lei Ke*, Wenjie Pei, Chi-Keung Tang, Yu-Wing Tai
(* denotes equal contribution)
GSNet: Joint Vehicle Pose and Shape Reconstruction with Geometrical and Scene-aware Supervision
ECCV 2020
Lei Ke, Shichao Li, Yanan Sun, Yu-Wing Tai, Chi-Keung Tang
Cascaded Deep Monocular 3D Human Pose Estimation with Evolutionary Training Data
CVPR 2020
Shichao Li, Lei Ke, Kevin Pratama, Yu-Wing Tai, Chi-Keung Tang, Kwang-Ting Cheng
Oral Presentation, 5.03% acceptance rate
Reflective Decoding Network for Image Captioning
ICCV 2019
Lei Ke, Wenjie Pei, Ruiyu Li, Xiaoyong Shen, Yu-Wing Tai
Memory-Attended Recurrent Network for Video Captioning
CVPR 2019
Wenjie Pei, Jiyuan Zhang, Xiangrong Wang, Lei Ke, Xiaoyong Shen and Yu-Wing Tai
[Paper] [arXiv]


2021.01—Future: Visiting PhD student at CVL, ETHz

2019.05—Future: HKUST Computer Vision Research Assistant

2017.11—2019.11: Tencent Youtu X-lab Computer Vision Research Intern, worked closely with Wenjie Pei.

2017.05—2017.10: Alibaba Engineering Intern

2016.05—2017.02: Undergraduate Research Assistant at Wuhan University


2022, Most Popular Speakers in TechBeat
2022, Research Travel Grant, ETH Zürich
2019, Research Travel Grant, HKUST
2019 - Present, Postgraduate Studentship, HKUST
2017, COMAP's Mathematical Contest in Modeling, Honorable prize
2015 - 2017, Excellent Student Scholarship, Wuhan University
2016, National Software Design Competition, Second Prize
2016, National Inspirational Scholarship, Wuhan University
2015, National College Students' Mathematics Competition, Third Prize

Professional Activities