Real-Time and Audio-Visual Music Transcription

Musical Cue Detection

Score Following and Visualization

Expressive Performance Control

Pianist Motion Data Acquisition and Generation

Neural Voice Processing

Recording Environment Transfer, Singing Voice Separation

General Audio Synthesis

Foley Sound Synthesis

Expressive Sound Synthesis

Expressive Acoustic Guitar Sound Synthesis

AI DJ, Music Structure Analysis

DJ mix Analysis, Automatic Mix Generation, Beat-tracking, Music Structure Analysis

Sample Search

Drum Sample Retrieval

Parameter Estimation for Sound Synthesis

Multimodal Music Retrieval

Multimodal Representation Learning, Joint Embedding, Zero-Shot Learning

Music Tagging and Captioning

Music Tagging, Music Captioning

Acoustic Scene and Event Understanding

Soundscape, DCASE

Singable Music Lyrics Translation

K-pop Lyric Translation, Evaluation Metrics

Symbolic Music Generation

Game BGM Generation, Piano Music Generation and Arrangement

Symbolic Melody Similarity

Symbolic Music Representation, Symbolic Melody Retrieval

Expression Analysis

Haegum Expression Analysis and Notation, Gayagum Vibrato Analysis

CNN Architectures for Music Classification

SampleCNN, Multi-level and Multi-scale Model

Deep Audio Embedding Learning

Disentangled Representation Learning, Representation Learning with Meta Data

Singing Voice Tagging and Identification

Semantic Vocal Tagging, Embedding Learning

Vocal Melody Extraction in Polyphonic Music

Singing Voice Detection and Pitch Estimation

Phoneme-Informed Singing Note Transcription

Piano Music Transcription

Piano Note Transcription, Note Intensity Estimation

Expressive Piano Performance Rendering

VirtuosoNet

End-to-End Neural Singing Voice Synthesis

Singing Expression Transfer