Ning Ding

Bio
I am a postdoc researcher at the Department of Electronic Engineering, Tsinghua University, collaborating with Prof. Bowen Zhou. I received my Ph.D. at the Department of Computer Science and Technology, Tsinghua Univeristy in 2023, advised by Prof. Hai-Tao Zheng and also co-advised by Prof. Zhiyuan Liu.
Research
My research spans the areas of natural language processing and machine learning. At the current stage, I am particularly interested advanced stimulation of language models. My research aims to develop theory, tools, and algorithms to effectively and efficiently drive language models (especially the large ones), and also establish a deeper understanding by observing the behaviors of models.
-
New Research on Exploration-based Method for Advanced Reasoning Released
January 2025We recently released Implicit Process Reward Modeling (ImplicitPRM) and Process Reinforcement through Implicit Rewards (PRIME) , scalable solutions for using (nearly) pure reinforcement learning to advance the reasoning capability of language models. We basically focus on two problems: (1) how to efficiently generate reliable dense rewards and (2) how to effectively use them.
-
Personal Update
January 2025I will be starting as an assistant professor at the EE department of Tsinghua University in 2025.
Selected Papers (Full List on Google Scholar)
- Enhancing Chat Language Models by Scaling High-quality Instructional ConversationsEMNLP 2023
The Ultra series solutions also contain other works like UltraFeedback (ICML 2024) , UltraInteract (ICLR 2024) , UltraMedical (NeurIPS 2024) , etc. - Sparse Low-rank Adaptation of Pre-trained Language ModelsEMNLP 2023
Awards
- Yunfan Award of WAIC, 2024.
- Young Elite Scientists Sponsorship Program by CAST, 2023.
- World Artificial Intelligence Conference Youth Outstanding Paper Award, 2023.
- Shuimu Tsinghua Scholar Program, 2023.
- Zhang Keqian Scholar Program, 2023.
- Outstanding Doctoral Dissertation of Tsinghua University, 2023.
- Outstanding Graduate of DCST, Tsinghua University, 2023.
- ACL Best System Demonstration Paper Award, 2022.
- Baidu Ph.D Fellowship (10 recipients worldwide), 2021.
- National Scholarship for Ph.D student, 2021.
- National Scholarship for Ph.D student, 2020.
- Tsingfeng Scholarship, Tsinghua University, 2019.
- CACS Scholarship, 2019.
- Excellent Graduate, 2018.
- National Scholarship for undergraduate student, 2018.
- First-class Academic Scholarship, 2017.
- First-class Academic Scholarship, 2016.
Service
- Nature Machine Intelligence
- Neural Networks
- NeurIPS 2020~2024
- ICML 2021~2024
- ACL 2020~2024
- EMNLP 2020~2024
- COLING 2020, 2022
- AAAI 2020~2024
- IJCAI 2020