Chuanguang Yang (杨传广)
Institute of Computing Technology, Chinese Academy of Sciences (ICT, CAS)
Address: No.6 Kexueyuan South Road Zhongguancun,Haidian District Beijing,China
Email: yangchuanguang@ict.ac.cn
Blog
GitHub
Google Scholar

About Me

I obtained my PhD degree from Institute of Computing Technology (ICT), Chinese Academy of Sciences, supervised by Prof. Zhulin An and Prof. Yongjun Xu. I am an assistant professor at ICT.
My recent works are mainly on Knowledge Distillation, Multi-Modal Representation Learning, Semantic Segmentation, and Image Classification, etc.
If you are interesting in our works and would like to join us as a Research Intern, please send me your resume by email!

Publications [Details]

  • Chuanguang Yang, Zhulin An, Libo Huang, Junyu Bi, Xinqiang Yu, Han Yang, Boyu Diao, Yongjun Xu.
    CLIP-KD: An Empirical Study of CLIP Model Distillation.
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR-2024) [CCF-A]
  • Chuanguang Yang , Luming Chen, Erhu Zhao, Zhulin An, Yongjun Xu.
    Graph-based Representation Knowledge Distillation for Image Classification. (基于图表征知识蒸馏的图像分类方法)
    Acta Electronica Sinica (电子学报) [CCF-A]
  • Libo Huang, Yan Zeng, Chuanguang Yang, Zhulin An, Boyu Diao, Yongjun Xu.
    eTag: Class-Incremental Learning with Embedding Distillation and Task-Oriented Generation.
    AAAI Conference on Artificial Intelligence (AAAI-2024) [CCF-A]
  • Junyu Bi, Daixuan Cheng, Ping Yao, Bochen Pang, Yuefeng Zhan, Chuanguang Yang et al.
    VL-Match: Enhancing Vision-Language Pretraining with Token-Level and Instance-Level Matching.
    IEEE/CVF International Conference on Computer Vision (ICCV-2023) [CCF-A]
  • Chuanguang Yang, Xinqiang Yu, Zhulin An, Yongjun Xu.
    Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation.
    Advancements in Knowledge Distillation: Towards New Horizons of Intelligent Systems (Springer Book Chapter)
  • Chuanguang Yang, Zhulin An, Helong Zhou, Fuzhen Zhuang, Yongjun Xu, Qian Zhang.
    Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognition.
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI-2023) [CCF-A]
  • Chuanguang Yang, Zhulin An, Helong Zhou, Linhang Cai, Xiang Zhi, Jiwen Wu, Yongjun Xu, Qian Zhang.
    MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition.
    European Conference on Computer Vision (ECCV-2022) [CCF-B]
  • Chuanguang Yang, Zhulin An, Linhang Cai, Yongjun Xu.
    Knowledge Distillation Using Hierarchical Self-Supervision Augmented Distribution.
    IEEE Transactions on Neural Networks and Learning Systems (TNNLS-2022)[CCF-B, IF:14.255]
  • Chuanguang Yang, Zhulin An, Yongjun Xu.
    Localizing Semantic Patches for Accelerating Image Classification.
    IEEE International Conference on Multimedia and Expo (ICME-2022) [CCF-B]
  • Chuanguang Yang, Helong Zhou, Zhulin An, Xue Jiang, Yongjun Xu, Qian Zhang.
    Cross-Image Relational Knowledge Distillation for Semantic Segmentation.
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR-2022) [CCF-A]
  • Chuanguang Yang, Zhulin An, Linhang Cai, Yongjun Xu.
    Mutual Contrastive Learning for Visual Representation Learning.
    AAAI Conference on Artificial Intelligence (AAAI-2022) [CCF-A]
  • Linhang Cai, Zhulin An, Chuanguang Yang, Yanchun Yang, Yongjun Xu.
    Prior Gradient Mask Guided Pruning-aware Fine-tuning.
    AAAI Conference on Artificial Intelligence (AAAI-2022) [CCF-A]
  • Chuanguang Yang, Zhulin An, Linhang Cai, Yongjun Xu.
    Hierarchical Self-supervised Augmented Knowledge Distillation.
    International Joint Conference on Artificial Intelligence (IJCAI-2021) [CCF-A]
  • Chuanguang Yang, Zhulin An, Yongjun Xu.
    Multi-View Contrastive Learning for Online Knowledge Distillation.
    IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP-2021) [CCF-B]
  • Linhang Cai, Zhulin An, Chuanguang Yang, Yongjun Xu.
    Soft and Hard Filter Pruning via Dimension Reduction.
    International Joint Conference on Neural Networks (IJCNN-2021) [CCF-C]
  • Linhang Cai, Zhulin An, Chuanguang Yang, Yongjun Xu.
    Softer Pruning, Incremental Regularization.
    International Conference on Pattern Recognition (ICPR-2020) [CCF-C]
  • Hui Zhu, Zhulin An, Chuanguang Yang, Xiaolong Hu, Kaiqiang Xu, Yongjun Xu.
    Efficient Search for the Number of Channels for Convolutional Neural Networks.
    International Joint Conference on Neural Networks (IJCNN-2020) [CCF-C]
  • Xiaolong Hu, Zhulin An, Chuanguang Yang, Hui Zhu, Kaiqaing Xu, Yongjun Xu.
    DRNet: Dissect and Reconstruct the Convolutional Neural Network via Interpretable Manners.
    European Conference on Artificial Intelligence (ECAI-2020) [CCF-B]
  • Chuanguang Yang, Zhulin An, Hui Zhu, Xiaolong Hu, Kun Zhang, Kaiqiang Xu, Chao Li, Yongjun Xu.
    Gated Convolutional Networks with Hybrid Connectivity for Image Classification.
    AAAI Conference on Artificial Intelligence (AAAI-2020) [CCF-A]
  • Hui Zhu, Zhulin An, Chuanguang Yang, Kaiqiang Xu, Erhu Zhao, Yongjun Xu.
    EENA: Efficient Evolution of Neural Architecture.
    International Conference on Computer Vision Workshops (ICCVW-2019) [CCF-A Workshops]
  • Chuanguang Yang, Zhulin An, Chao Li, Boyu Diao, Yongjun Xu.
    Multi-objective Pruning for CNNs using Genetic Algorithm.
    International Conference on Artificial Neural Networks (ICANN-2019) [CCF-C]

Activities

  • 2022.12.7 Invited talk of "VL-Match: Enhancing Vision-Language Pretraining with Token-Level and Instance-Level Matching" at Microsoft Bing
  • 2022.11.15 Invited talk of "Multi-Modal Knowledge Distillation: Survey and Outlook" at MSRA
  • 2022.7.22 Served as a session chair of ICME-2022 Oral 36 Semantic Segmentation IV.
  • 2022.4.14 Invited talk of "Knowledge Distillation: Survey and Outlook" at Gaoling School of Artificial Intelligence, Renmin University of China
  • 2022.3.11 Invited talk of our CVPR-2022 paper "Cross-image Relational Knowledge Distillation for Semantic Segmentation" at Horizon Robotics
  • 2022.1.21 Invited talk about "Self-supervised Contrastive Learning" at Horizon Robotics
  • 2021.9.16 Invited talk of our IJCAI-2021 paper "Hierarchical Self-supervised Augmented Knowledge Distillation" by AI Drive and Paper weekly
  • 2020.6.21 Invited talk of our AAAI-2020 paper "Gated Convolutional Networks with Hybrid Connectivity for Image Classification" by Student Forum on Frontiers of Artificial Intelligence (SFFAI)

Research Experience

  • Microsoft Research Asia, Beijing, China. Oct.2022-Jan.2023
    • Research Intern in Visual Group, mentored by Zheng Zhang
    • Multi-Modal Knowledge Distillation, Contrastive Language-Image Pretraining
  • Horizon Robotics, Beijing, China. Aug.2021-Sep.2022
    • Research Intern in Basic Algorithm Platform Department, mentored by Qian Zhang
    • Knowledge Distillation, Semantic Segmentation
  • Megvii, Beijing, China. Nov.2019-Apr.2020
    • Research Intern in Foundation Model Group, mentored by Xiangyu Zhang
    • Knowledge Distillation, Efficient Model Design

Honor

  • Top One Hundred New Star of ICT (中科院计算所新百星), 2024
  • Class A of Specific Research Assistant (特别研究助理A类), 2024
  • Chinese Academy of Sciences Specific Research Assistant Funding Program (中国科学院特别研究助理资助项目), 2023年度共6项
  • Special Prize of President Scholarship, Chinese Academy of Sciences (中国科学院院长特别奖), 2023年度仅1项
  • National Scholarship (研究生国家奖学金), 2020
  • President's Scholarship of ICT (中科院计算所所长奖学金), 2020
  • National Scholarship for Undergraduate Student (本科生国家奖学金), 2017
  • First Prize of National Mathematical Contest in Modeling (本科生数学建模国家一等奖), 2016
  • Bronze Medal of ACM-ICPC Asia Regional Contest (ACM-ICPC亚洲区域赛铜奖), 2016

Review Services

Conference: ACM MM-2021~2022, AAAI-2022~2024, CVPR-2022~2024, ECCV-2022.2024, ICCV-2023, IJCAI-2023~2024, ACCV-2024
Journal: IEEE Transactions on Neural Networks and Learning Systems, Applied Artificial Intelligence