Hello there, my name is Li Yi, currently pursuing a Master’s degree in Computer Science at UIUC. I completed my undergraduate studies at NYU Shanghai, earning a Bachelor of Science degree with double major in Computer Science and Data Science.
Passionate about developing software systems that positively impact society, I possess a diverse skill set in full-stack development, proficient in various languages and frameworks. My research interest lies in artificial intelligence, particularly in the realm of music generation. Previously, I had the privilege of researching music generation algorithms and tools that rival human creativity at Professor Gus Xia‘s Music X Lab.
Beyond academia, I indulge in music composition, and I am an active musician on platforms such as Netease Cloud Music.
Publications
LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentation
Keyang Xuan, Li Yi, Fan Yang, Ruochen Wu, Yi R. Fung, Heng Ji
Under Review, 2024AccoMontage2: A Complete Harmonization and Accompaniment Arrangement System
Li Yi, Haochen Hu, Jingwei Zhao, Gus Xia
In Proceedings of the 23rd International Society for Music Information Retrieval Conference (ISMIR 2022)
Controllable Ancient Chinese Lyrics Generation Based on Phrase Prototype Retrieving
Li Yi
NYU Shanghai Class of 2023 Computer Science & Data Science Capstone
Experience
[Feb 2024 - Now] Doing Software Development Engineer Internship at the startup company Kaizntree. Responsible for the construction and maintenance of both frontend and backend systems, utilizing Vue and Django Framework.
[Feb 2024 - Feb 2024] Our paper LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentation is submitted to ACL 2024, currently under review. [Code] [PDF]
[Sep 2023 - Feb 2024] Researching LVLM’s ability in multimodal misinformation detection, advised by Prof. Heng Ji.
[Sep 2023 - Dec 2023] Complete our project GameUniverse that allows users to check out detailed information about games on the Steam platform. Built with React and Flask. [Code]
[Dec 2022 - Dec 2022] Our paper AccoMontage2: A Complete Harmonization and Accompaniment Arrangement System is published at ISMIR 2022! [Code] [PDF] [Demo] [Video]
[Sep 2022 - Dec 2022] Completed my Computer Science & Data Science Capstone project Controllable Ancient Chinese Lyrics Generation Based on Phrase Prototype Editing, in which I proposed a new phrase editing-based method to generate Song Ci (宋词). The project is supervised by Prof. Wilson Tam. [Code] [PDF]
[Sep 2022 - Dec 2022] Built the NYU Shanghai Internship sharing platform InternSHare that allows student to publish and apply internship positions. Achieved by React/Flask/MySQL. [Code] [PDF]
[Feb 2022 - May 2022] Our course paper On the Progress of Machine Logical Reasoning is completed, in which we proposed a combined method that outperform baselines in the task of machine reading comprehension. [PDF]
[Jun 2022 - Now] Propose to train a VAE model that is sufficient to disentangle chord, voicing, and texture giving a polyphonic music piece. Construct training datasets and execute experiments on the model design. Supervised by Prof. Gus Xia.
[Jun 2022 - Aug 2022] Join the Music-X-Lab led by Prof. Gus Xia. Serves as a Research Assistant at MBZUAI. Execute experiments to evaluate model’s performance, do weekly research reports and give presentations.
[Sep 2021 - Dec 2021] My project POPVIS is completed. The project visualizes the POP909 music dataset with multiple interact methods. Built with React and d3.js. [Code] [PDF]
[Feb 2021 - Aug 2022] Start doing research on AccoMontage2, a system that can generate symbolic chord progressions and piano accompaniment according to a given melody. Execute experiments on the model design and hyperparameter tuning, compare with baseline methods and conduct subject evaluations. Supervised by Prof. Gus Xia.
[Feb 2021 - May 2021] Built Quick Flight, A flight booking system with three types of user identities. Completed with Flask, MySQL and HTML, CSS and JS. [Code]
[Jun 2021 - Aug 2021] Doing Internship at Meituan (美团) with the position of Strategic Product Management. Carry out user search satisfactory evaluation, collect user data to construct personas, help the algorithm engineers to label the training data, and write Python scripts that greatly improve work efficiency.
[Sep 2020 - May 2021] Serve as the treasurer of NYU Shanghai’s Splice Club (Computer Science Focused Club).
[Sep 2020 - Dec 2020] Serve as the Learning Assistant of the course Introduction to Computer Science at NYU Shanghai, join lectures, labs, recitations, and hold weekly Office Hours and Review Sessions, students’ exam grades were improved. Won The Most Appointments prize.