My name is Yiding Sun (孙一丁, in Chinese). I am currently a 3rd-year master student (will graduate in 2025.6 in expectation) at Gaoling School of Artificial Intelligence, Renmin University of China. My supervisor is Prof. Jiaxin Mao. Previously, I earned my bachelor degree under supervise of Prof. Ying Zhang and Prof. Gang Wang, in College of Computer Science, Nankai University.

My research interests lie in the pretraining of Large Language Models (LLMs) and Explainable Recommendations. I am searching for a full-time job of machine learning engineer, focusing on LLMs (pretraining, data, and fine-tuning) and recommendations, mainly based in Beijing.

Publications

• BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Competitive Large Language Model Baseline.
  Guosheng Dong*, Da Pan, Yiding Sun, Shusen Zhang, Zheng Liang, Xin Wu, Yanjun Shen, Fan Yang, Haoze Sun, Tianpeng Li, Mingan Lin, Jianhua Xu, Yufan Zhang, Xiaonan Nie, Lei Su, Bingning Wang, Wentao Zhang, Jiaxin Mao, Zenan Zhou*, Weipeng Chen.
  ArXiv Preprint. [paper]

• Aligning Explanations for Recommendation with Rating and Feature via Maximizing Mutual Information.
  Yurou Zhao, Yiding Sun, Ruidong Han, Fei Jiang, Lu Guan, Xiang Li, Wei Lin, Jiaxin Mao.
  The 33rd ACM International Conference on Information and Knowledge Management. (CIKM 2024) [paper]

• An Integrated Data Processing Framework for Pretraining Foundation Models.
  Yiding Sun*, Feng Wang*, Yutao Zhu, Wayne Xin Zhao, Jiaxin Mao. (* Equal contribution)
  The 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. (SIGIR 2024). [Paper]

• YuLan: An Open-source Large Language Model.
  Yutao Zhu, Kun Zhou, Kelong Mao, Wentong Chen, Yiding Sun, Zhipeng Chen, Qian Cao, Yihan Wu, Yushuo Chen, Feng Wang, Lei Zhang, Junyi Li, Xiaolei Wang, Lei Wang, Beichen Zhang, Zican Dong, Xiaoxue Cheng, Yuhan Chen, Xinyu Tang, Yupeng Hou, Qiangqiang Ren, Xincheng Pang, Shufang Xie, Wayne Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ze-Feng Gao, Yueguo Chen, Weizheng Lu, Ji-Rong Wen.
  ArXiv Preprint. [paper]

• Investigating Users’ Preferences for Explanation Tags on Online Delivery Platform.
  Yiding Sun, Yurou Zhao, Ruidong Han, Fei Jiang, Lu Guan, Xiang Li, Wei Lin and Jiaxin Mao.
  1st Workshop on Measuring the Quality of Explanations in Recommender Systems. (QUARE@SIGIR 2022).

• Evaluating the Explanation Tags of Online Food Delivery Recommendation: A Position Paper.
  Yurou Zhao, Ruidong Han, Fei Jiang, Lu Guan, Xiang Li, Wei Lin, Yiding Sun and Jiaxin Mao.
  1st Workshop on Measuring the Quality of Explanations in Recommender Systems. (QUARE@SIGIR 2022).

Education

• 2022.9-present, M.S., Gaoling School of Artificial Intelligence, Renmin University of China.
• 2018.9-2022.6, B.E., College of Computer Science, Nankai University.

News

• 2024.8.28, Our Technical Report of BaichuanSEED has been released on ArXiv.
• 2024.7.17, I will present two posters on SIGIR2024 onsite at Capital Hilton in D.C. .
• 2024.7.16, One paper is accepted by CIKM2024. Congrats for co-author Yurou Zhao!
• 2024.6.28, Our Yulan’s Technical Report “YuLan: An Open-source Large Language Model” has been released! I was served as the lead of data group of pretraining. Weights of the foundation model and the chat model is also released.

Honors and Awards

• 2023, Overall Excellence Scholarship (Second Prize), Renmin University of China. (Top 30%)
• 2022, Overall Excellence Scholarship (Second Prize), Renmin University of China. (Top 30%)
• 2022, Outstanding Graduate of Nankai University. (Top 3%)
• 2021, Gongneng Scholarship (First Prize), Nankai University. (Top 5%)
• 2021, Ninety-five Core Scholarship, Nankai University. (10 Students in Nankai University)
• 2021, Ministry of Education-Huawei Smart Base “Star of the Future” Award. (20 Students in Nankai University)
• 2021, National Second Prize in the Compiled System Design Competition (Huawei Bison Cup).
• 2020, Academic Excellence Scholarship, Innovation Scholarship (Second Prize), Nankai University. (Top 10%)
• 2019, Gongneng Scholarship (First Prize), Nankai University. (Top 5%)