Lu Dong (董璐)

Ph.D. Student

Department of Computer Science and Engineering
University at Buffalo, SUNY (UB)
Davis Hall, Buffalo, New York, U.S.A

Email: dongludeeplearning@gmail.com

About Me

I am a Ph.D. student (2021-Present) at the Department of Computer Science and Engineering (CSE), University at Buffalo-The State University of New York (UB) , working with Prof. Ifeoma Nwogu at the Human Behavior Modeling Lab. Prior to my Ph.D. studies, I obtained a Master's degree in Computer Science and Technology from the School of Computer Science and Technology at Xi'an Jiaotong University (XJTU) in China, where I was advised by Prof. Xinyu Yang at the YLab .

My research interests are Human Pose Estimation, 3D Mesh Reconstruction, Robotics Physics Simulation, Multimodal, Language-driven Motion, Sign Language Translation & Generation, and Video Understanding. My long-term goal is primarily in developing Computer Vision, Natural Language Processing, Reinforcement Learning, Statistic Machine Learning, and Mathematical Modeling to study multimodal human behavior and make generative models more effective in serving human needs. Besides, some of my early works are related to Speech Sentiment Analysis, Music Analysis with Machine Learning and Data Science techniques including Data Crawling, Pattern Mining, Information Retrieval, and Search Engine Optimization. Feel free to reach out to me if you are interested in collaborating. I am also actively looking for research intern positions.

News []

2024.03: Our paper "SignAvatar" has been accepted by FG 2024 .
2023.08: I was invited to give a talk on Internships in the course CSE501, Fall2023, UB.
2023.07: One paper on human motion synthesis has been accepted by ACM MM 2023 .
2023.06: I successfully passed my Oral Qualifying Exam (OQE) and became a PhD candidate at UB.
2023.05: Start my research intern jounrney at InnoPeak Technology (OPPO US Research) in Seattle, WA.(on-site)
2022.11: I was invited to be the judge of the 2022 UB Hacking Competition!
2022.10: I was invited to give a talk in the course CSE501, Fall2022, UB.
2022.05: Start my research intern jounrney at InnoPeak Technology (OPPO US Research) in Palo Alto, CA. (on-site)
2021.08: Start my new Ph.D journey following my advisor at UB, Buffalo, NY.
2021.05: I passed the Ph.D Research Potential Assessment at RIT!
2020.08: Start my new Ph.D journey at RIT, Rochester, NY.

Selected Research

SignAvatar: Sign Language 3D Motion Reconstruction and Generation
Lu Dong, Lipisha Chaudhary, Fei Xu, Xiao Wang, Mason Lary, Ifeoma Nwogu.
The 18th IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2024.
DOI PDF BibTeX Project Webpage

Towards Open Domain Text-Driven Synthesis of Multi-Person Motions
Mengyi Shan, Lu Dong, Yutao Han, Yuan Yao, Tao Liu, Ifeoma Nwogu, Guo-Jun Qi, Mitch Hill.
Under Review.
DOI PDF BibTeX Project Webpage

Language-guided Human Motion Synthesis with Atomic Actions
Yuanhao Zhai, Mingzhen Huang, Tianyu Luan, Lu Dong , Ifeoma Nwogu, Siwei Lyu, David Doermann, Junsong Yuan
ACM Multimedia (MM), 2023.
Please check title link for more details.
DOI PDF BibTeX Project Webpage

Exploring the General Melodic Characteristics of XinTianYou Folk Songs
Juan Li, Lu Dong, Jianhang Ding, Xinyu Yang
12th Sound and Music Computing Conference(SMC)
DOI PDF BibTeX Project Webpage

Selected Project

A smooth 3D Human Pose Estimation pipeline for video in the wild
The majority of current models have been trained on limited close set data, which often results in subpar performance when applied to real-world video data. One of the major challenges in this context is the issue of self-occlusion, which refers to instances where parts of a subject's body obstruct or cover other parts. This results in a less smooth and precise performance. This project aims to tackle this issue.
Please check title link for more details.

A Training ChatBot to facilitate medical knowledge dissemination in underdeveloped regions
This project is undertaken in providing for support for a non-profit organization with the aim of addressing the lack of medical knowledge in underdeveloped regions of India. This shortfall leads to an alarming number of preventable fatalities each year. We have developed a training chatbot to enhance the understanding of medical knowledge and local resources by volunteers and the local population. The chatbot will serve as an educational tool to improve medical literacy and ultimately, save lives.
Please check title link for more details.

A Covid Analysis Search Engine: Dissecting Twitter data to analyze government & public attitude towards Covid and Vaccines
Do authoritative figures have any influence on the trend of COVID-19, what is the attitude of the general public toward COVID-19 and vaccines, whether changes in public attitudes are influenced by authoritative speech? The aim of this project is to design and develop a full-stack search engine that integrates advanced functionalities for retrieval, translation, sentiment analysis, attitude tracking, topic & area statistics, and disinformation detection from multiple dimensions.
Please check title link for more details.

Experience

Research Assitant University at Buaffalo SUNY (UB), Aug 2022- Now.
Research Internship InnoPeak Technology, Seattle, WA, On-Site, June 2023- Aug 2023.
Research Internship InnoPeak Technology, Palo Alto, CA, On-Site, May 2022- Aug 2022.
Research Assitant University at Buaffalo SUNY (UB), Aug 2021- May 2022.
Research Assitant Rochester Institute of Technology(RIT), Aug 2020- May 2021.
Senior Data Analyst Shaanxi Haina Electronic Technology Co.,LT, Sep 2016- Apr 2020.
Research Assitant XI'An Jiaotong University (XJTU), Aug 2013- May 2016.

Selected Awards & Honors

Awards

Outstanding Leadership Award, Shaanxi Haina Electronic Technology Co.,LT. 2018
National Graduate Academic Scholarship , Xi'an Jiaotong University (XJTU), 2013-2016.
Silver Metal for Women's Hurdle at the Intercollegiate Athletic Meet，Xi'an Jiaotong University (XJTU), 2014.
National Encouragement Scholarship, Northeast Electric Power University (NEEPU), 2010.(top 5%)
The Academic Scholarship , Northeast Electric Power University (NEEPU), 2010. (top 10%)
Champion & MVP , Women's Basketball of NEEPU, 2010.

Honors

Excellent Postgraduate Student , XI'an Jiaotong University (XJTU), 2014 & 2015. (top 10%)
Outstanding Leadership among Students, Northeast Electric Power University (NEEPU), 2010. (top 3 out of 120)
Excellent Undergraduate Student ,Northeast Electric Power University (NEEPU).(top 10%)