Zhengkai JIANG

GenAI Researcher
Email / Google Scholar / GitHub / LinkedIn

I work as a researcher on the frontier of generative AI at HKUST campus. My research interests cover content generation and cross-modality representation learning, especially for image, video and audio synthesis.

I was a senior researcher at Tencent since 2020. I obtained the master's degree from Institute of Automation, Chinese Academy of Sciences. Before that, I received the bachelor's degree from Northeastern University with honors in 2017.

Publications

Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement
Zhennan Chen, Yajie Li, Haofan Wang, Zhibo Chen, Zhengkai Jiang, Jun Li, Qian Wang, Jian Yang, Ying Tai
Arxiv 2024 / Paper
Foundation Cures Personalization: Recovering Facial Personalized Models' Prompt Consistency
Yiyang Cai, Zhengkai Jiang, Yulong Liu, Chunyang Jiang, Wei Xue, Wenhan Luo, Yike Guo
Arxiv 2024 / Paper
OSV: One Step is Enough for High-Quality Image to Video Generation
Xiaofeng Mao*, Zhengkai Jiang*, Fuyun Wang*, Wenbing Zhu, Jiangning Zhang, Hao Chen, Mingmin Chi, Yabiao Wang
Arxiv 2024 / Paper
VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation
Qilin Wang*, Zhengkai Jiang*, Chengming Xu, Jiangning Zhang, Yabiao Wang, Xinyi Zhang, Yun Cao, Weijian Cao, Chengjie Wang, Yanwei Fu
Arxiv 2024 / Paper / Code
NoiseBoost: Alleviating Hallucination with Noise Perturbation for Multimodal Large Language Models
Kai Wu, Boyuan Jiang, Zhengkai Jiang, Qingdong He, Donghao Luo, Shengzhi Wang, Chengjie Wang, Qingwen Liu
Arxiv 2024 / Paper
Personalize Segment Anything Model with One Shot
Renrui Zhang, Zhengkai Jiang, Ziyu Guo, Shilin Yan, Junting Pan, Hao Dong, Yu Qiao, Peng Gao, Hongsheng Li
ICLR 2024 / Paper / Code
MDT-A2G: Exploring Masked Diffusion Transformers for Co-Speech Gesture Generation
Xiaofeng Mao*, Zhengkai Jiang*, Qilin Wang, Chencan Fu, Jiangning Zhang, Jiafu Wu, Yabiao Wang, Chengjie Wang, Wei Li, Mingnin Chi
ACM MM 2024 / Paper
Learning Unified Reference Representation for Unsupervised Multi-class Anomaly Detection
Liren He*, Zhengkai Jiang*, Jinlong Peng, Liang Liu, Qiangang Du, Xiaobin Hu, Wenbing Zhu, Mingmin Chi, Yabiao Wang, Chengjie Wang
ECCV 2024 / Paper
Density Matters: Improved Core-set for Active Domain Adaptive Segmentation
Shizhan Liu*, Zhengkai Jiang*, Yuxi Li, Jinlong Peng, Yabiao Wang, Weiyao Lin
AAAI 2024 / Paper
Prototypical Contrast Adaptation for Domain Adaptive Segmentation
Zhengkai Jiang, Yuxi Li, Ceyuan Yang, Peng Gao, Yabiao Wang, Ying Tai, Chengjie Wang
ECCV 2022 / Paper / Code
DIRL: Domain-invariant Representation Learning for Generalizable Semantic Segmentation
Qi Xu, Liang Yao, Zhengkai Jiang, Guannan Jiang, Wenqing Chu, Wei Zhang, Chengjie Wang, Ying Tai
AAAI 2022 / Paper
Rethinking Counting and Localization in Crowds: A Purely Point-based Framework
Qingyu Song, Changan Wang, Zhengkai Jiang, Yabiao Wang, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang, Yang Wu
ICCV 2021 / Paper
SiamRCR: Reciprocal Classification and Regression for Visual Object Tracking
Jinlong Peng*, Zhengkai Jiang*, Yueyang Gu, Yang Wu, Yabiao Wang, Ying Tai, Chengjie Wang, Weiyao Lin
IJCAI 2021 / Paper
Learning Where to Focus for Efficient Video Object Detection
Zhengkai Jiang, Yu Liu, Ceyuan Yang, Jihao Liu, Peng Gao, Qian Zhang, Shiming Xiang, Chunhong Pan
ECCV 2020 / Project Page / Paper / Code
Fine-grained Dynamic Routing for Object Detection
Lin Song, Yanwei Li, Zhengkai Jiang, Zeming Li, Hongbin Sun, Jian Sun, Nanning Zheng
NeurIPS 2020 / Paper / Code
Rethinking Learnable Tree Filter for Generic Feature Transform
Lin Song, Yanwei Li, Zhengkai Jiang, Zeming Li, Xiangyu Zhang, Hongbin Sun, Jian Sun, Nanning Zheng
NeurIPS 2020 / Paper / Code
Dynamic Fusion with Intra-and Inter-Modality Attention Flow for Visual Question Answering
Peng Gao, Zhengkai Jiang, Haoxuan You, Pan Lu, Steven CH Hoi, Xiaogang Wang, Hongsheng Li
CVPR 2019 / Paper
Video Object Detection with Locally-Weightd Deformable Neighboors
Zhengkai Jiang, Peng Gao, Chaoxu Guo, Qian Zhang, Shiming Xiang, Chunhong Pan
AAAI 2019 / Paper

Honors and Awards

  • Outstanding Staff Award at Tencent, 2021, 2022, 2023
  • Tencent Technology Breakthrough Award, 2020, 2022
  • 1st of the Objects 365 Challenge, 2020
  • 1st of the NuScenes 3D Detection of CVPR WAD workshop, 2019
  • 1st of the Chinese Mathematics Competitions (1/6000+ in Liaoning Province), 2015, 2016
  • National Scholarship (Top 0.2% students in China), 2014, 2015, 2016

    • Contact

    You are very welcome to contact me. My email is kaikaijiang.jzk [at] gmail .com or zkjiang [at] ust .hk