Ziyun Zeng

Department of Electrical & Computer Engineering, National University of Singapore
image

I am a first-year PhD student at Show Lab, National University of Singapore (NUS), advised by Asst Prof. Mike Zheng Shou. Previously, I received my MEng degree at Tsinghua University (THU), under the supervision of Prof. Shu-Tao Xia. And I received my BEng degree at Sichuan University (SCU). My current research interests include Video Understanding, Multi-modal Large Language Model, Multi-modal Representation Learning, etc. Beyond these topics, I also published several papers regarding multimedia retrieval and visual hashing.

News

  • [2024.08] Join Show Lab @ NUS as a PhD candidate!
  • [2024.01] One paper is accepted to ICLR 2024.
  • [2024.01] One paper is accepted to IJCV.
  • [2023.12] One paper is accepted to Pattern Recognition Letters.
  • [2023.12] One paper is accepted to AAAI 2024.
  • [2023.07] One paper is accepted to ACM MM 2023.
  • [2023.03] One paper is accepted to ICME 2023 as an Oral presentation.
  • [2023.02] One paper is accepted to CVPR 2023.
  • [2022.11] One paper is accepted to AAAI 2023.
  • [2022.10] Two papers are accepted to BMVC 2022 with one Oral presentation.
  • [2022.01] One paper is accepted to WWW 2022.
  • [2021.12] One paper is accepted to AAAI 2022 as an Oral presentation.
  • [2021.10] One paper is accepted to BMVC 2021.

Publications [Google Scholar]

✱ Equal Contribution      ✉ Corresponding Author

2024:
  • Making LLaMA SEE and Draw with SEED Tokenizer (SEED-2)
    Yuying Ge✱, Sijie Zhao✱, Ziyun Zeng, Yixiao Ge✉, Chen Li, Xintao Wang, Ying Shan
    ICLR, 2024 [Paper][Code] GitHub stars
  • Hugs Bring Double Benefits: Unsupervised Cross-Modal Hashing with Multi-granularity Aligned Transformers
    Jinpeng Wang, Ziyun Zeng, Bin Chen✉, Yuting Wang, Dongliang Liao, Gongfu Li, Yiru Wang, Shu-Tao Xia
    IJCV [Paper]
  • Pyramid Hybrid Pooling Quantization for Efficient Fine-Grained Image Retrieval
    Ziyun Zeng✱, Jinpeng Wang✱, Bin Chen✉, Tao Dai, Shu-Tao Xia, Zhi Wang
    Pattern Recognition Letters [Paper]
  • GMMFormer: Gaussian-Mixture-Model based Transformer for Efficient Partially Relevant Video Retrieval
    Yuting Wang, Jinpeng Wang, Bin Chen✉, Ziyun Zeng, Shu-Tao Xia
    AAAI, 2024 [Paper]
2023:
  • Planting a SEED of Vision in Large Language Model (SEED-1)
    Yuying Ge✱, Yixiao Ge✱ ✉, Ziyun Zeng, Xintao Wang, Ying Shan
    Technical Report, 2023 [Paper] [Code] GitHub stars
  • MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation
    Jinpeng Wang, Ziyun Zeng, Yunxiao Wang, Yuting Wang, Xingyu Lu, Tianxiang Li, Jun Yuan, Rui Zhang, Hai-Tao Zheng, Shu-Tao Xia
    ACM MM, 2023 [Paper][Code] GitHub stars
  • TVTSv2: Learning Out-of-the-box Spatiotemporal Visual Representations at Scale
    Ziyun Zeng, Yixiao Ge, Zhan Tong, Xihui Liu, Shu-Tao Xia, Ying Shan
    Technical Report, 2023 [Paper] [Code] GitHub stars
  • ConCAP: Contrastive Context-Aware Prompt for Resource-hungry Action Recognition
    Hailun Zhang, Ziyun Zeng, Qijun Zhao✉, Zhen Zhai
    ICME, 2023 (Oral) [Paper]
  • Learning Transferable Spatiotemporal Representations from Natural Script Knowledge
    Ziyun Zeng✱, Yuying Ge✱, Xihui Liu, Bin Chen✉, Ping Luo, Shu-Tao Xia, Yixiao Ge✉
    CVPR, 2023 [Paper] [Code] GitHub stars
  • Contrastive Masked Autoencoders for Self-Supervised Video Hashing
    Yuting Wang✱, Jinpeng Wang✱, Bin Chen✉, Ziyun Zeng, Shu-Tao Xia
    AAAI, 2023 [Paper] [Code] GitHub stars
2022:
  • Motion-Aware Graph Reasoning Hashing for Self-supervised Video Retrieval
    Ziyun Zeng, Jinpeng Wang, Bin Chen✉, Yuting Wang, Shu-Tao Xia
    BMVC, 2022 [Paper]
  • Hugs Are Better Than Handshakes: Unsupervised Cross-Modal Transformer Hashing with Multi-granularity Alignment
    Jinpeng Wang, Ziyun Zeng, Bin Chen✉, Yuting Wang, Dongliang Liao✉, Gongfu Li, Yiru Wang, Shu-Tao Xia
    BMVC, 2022 (Oral) [Paper]
  • Hybrid Contrastive Quantization for Efficient Cross-View Video Retrieval
    Jinpeng Wang, Bin Chen✉, Dongliang Liao✉, Ziyun Zeng, Gongfu Li, Shu-Tao Xia, Jin Xu
    WWW, 2022 [Paper] [Code] GitHub stars
  • Contrastive Quantization with Code Memory for Unsupervised Image Retrieval
    Jinpeng Wang, Ziyun Zeng, Bin Chen✉, Tao Dai, Shu-Tao Xia
    AAAI, 2022 (Oral) [Paper] [Code] GitHub stars
2021:
  • SwinFGHash: Fine-grained Image Retrieval via Transformer-based Hashing Network
    Di Lu, Jinpeng Wang, Ziyun Zeng, Bin Chen✉, Shudeng Wu, Shu-Tao Xia
    BMVC, 2021 [Paper]
蜀ICP备2021016490号-1