Nick Nguyen
Computer systems engineering
Hometown: Ho Chi Minh City, Ho Chi Minh, Vietnam
Graduation date: Spring 2026
Additional details: First-generation college student
FURI | Fall 2023
Multimodal Self-Supervised Approach to Text-to-Music Generation
Discrete Music Language Models have the ability to generate musical pieces with various genres in discrete formats such as MIDI and piano roll, which offers more flexibility and customizability. Meanwhile, recent works show that current Discrete Music Language Models have limitations when it comes to the relationship between text and music domains, which raises challenges to step toward text-music generation. Therefore, this research focuses on developing conditioning discrete music ability by proposing a transformer model that merges an encoder text language model and a decoder music language model, with the purpose of capturing the text-music relationship to learn text-music generation.
Mentor: Yezhou Yang
It’s hip to be square.
Students presenting projects at the Fulton Forge Student Research Expo are encouraged to download this personal QR code and include it within your poster. This allows expo attendees to explore more about your project and about you in the future.
Right click the image to save it to your computer.