Ning Ding

.
Beijing Weather Icon

Bio

I am a postdoc researcher at the Department of Electronic Engineering, Tsinghua University, collaborating with Prof. Bowen Zhou. I received my Ph.D. at the Department of Computer Science and Technology, Tsinghua Univeristy in 2023, advised by Prof. Hai-Tao Zheng and also co-advised by Prof. Zhiyuan Liu.

Research

My research spans the areas of natural language processing and machine learning. At the current stage, I am particularly interested advanced stimulation of language models. My research aims to develop theory, tools, and algorithms to effectively and efficiently drive language models (especially the large ones), and also establish a deeper understanding by observing the behaviors of models.

  • New Research on Exploration-based Method for Advanced Reasoning Released
    January 2025

    We recently released Implicit Process Reward Modeling (ImplicitPRM) and Process Reinforcement through Implicit Rewards (PRIME) , scalable solutions for using (nearly) pure reinforcement learning to advance the reasoning capability of language models. We basically focus on two problems: (1) how to efficiently generate reliable dense rewards and (2) how to effectively use them.

  • Personal Update
    January 2025

    I will be starting as an assistant professor at the EE department of Tsinghua University in 2025.

Selected Papers (Full List on Google Scholar)


  1. Process Reinforcement through Implicit Rewards
    Ganqu Cui, Lifan Yuan, Zefan Wang, Hanbin Wang, Wendi Li, Bingxiang He, Yuchen Fan, Tianyu Yu, Qixin Xu, Weize Chen, Jiarui Yuan, Huayu Chen, Kaiyan Zhang, Xingtai Lv, Shuo Wang, Yuan Yao, Xu Han, Hao Peng, Yu Cheng, Zhiyuan Liu, Maosong Sun, Bowen Zhou, and Ning Ding
    Preprint
  2. Free Process Rewards without Process Labels
    Lifan Yuan, Wendi Li, Huayu Chen, Ganqu Cui, Ning Ding, Kaiyan Zhang, Bowen Zhou, Zhiyuan Liu, and Hao Peng
    Preprint
  3. Parameter-efficient Fine-tuning of Large-scale Pre-trained Language Models
    Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li, and Maosong Sun
    Nature Machine Intelligence
    Cover Article of Nature Machine Intelligenceā€™s March Issue
    World Artificial Intelligence Conference Youth Outstanding Paper Award
  4. OpenPrompt: An Open-source Framework for Prompt-learning
    Ning Ding, Shengding Hu, Weilin Zhao, Yulin Chen, Zhiyuan Liu, Hai-Tao Zheng, and Maosong Sun
    ACL System Demonstration 2022
    Best Demo Paper Award
  5. Enhancing Chat Language Models by Scaling High-quality Instructional Conversations
    Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Shengding Hu, Zhiyuan Liu, Maosong Sun, and Bowen Zhou
    EMNLP 2023
    The Ultra series solutions also contain other works like UltraFeedback (ICML 2024) , UltraInteract (ICLR 2024) , UltraMedical (NeurIPS 2024) , etc.
  6. Sparse Low-rank Adaptation of Pre-trained Language Models
    Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Shengding Hu, Zhiyuan Liu, Maosong Sun, and Bowen Zhou
    EMNLP 2023
  7. Prototypical Representation Learning for Relation Extraction
    Ning Ding, Xiaobin Wang, Yao Fu, Guangwei Xu, Rui Wang, Pengjun Xie, Ying Shen, Fei Huang, Hai-Tao Zheng, and Rui Zhang
    International Conference on Learning Representations,
    ICLR
    2021

Awards

  • Yunfan Award of WAIC, 2024.
  • Young Elite Scientists Sponsorship Program by CAST, 2023.
  • World Artificial Intelligence Conference Youth Outstanding Paper Award, 2023.
  • Shuimu Tsinghua Scholar Program, 2023.
  • Zhang Keqian Scholar Program, 2023.
  • Outstanding Doctoral Dissertation of Tsinghua University, 2023.
  • Outstanding Graduate of DCST, Tsinghua University, 2023.
  • ACL Best System Demonstration Paper Award, 2022.
  • Baidu Ph.D Fellowship (10 recipients worldwide), 2021.
  • National Scholarship for Ph.D student, 2021.
  • National Scholarship for Ph.D student, 2020.
  • Tsingfeng Scholarship, Tsinghua University, 2019.
  • CACS Scholarship, 2019.
  • Excellent Graduate, 2018.
  • National Scholarship for undergraduate student, 2018.
  • First-class Academic Scholarship, 2017.
  • First-class Academic Scholarship, 2016.

Service

  • Nature Machine Intelligence
  • Neural Networks
  • NeurIPS 2020~2024
  • ICML 2021~2024
  • ACL 2020~2024
  • EMNLP 2020~2024
  • COLING 2020, 2022
  • AAAI 2020~2024
  • IJCAI 2020
web counter