Music and Audio Computing Lab

Main menu: Home | People | Research | Publications |

2019

  • Deep Learning for Audio-based Music Classification and Tagging
    Juhan Nam, Keunwoo Choi, Jongpil Lee, Szu-Yu Chou, and Yi-Hsuan Yang
    IEEE Signal Processing Magazine, 2019 (accepted for publication)

2018

  • VirtuosoNet: A Hierarchical Attention RNN for Generating Expressive Piano Performance from Music Score
    Dasaem Jeong, Taegyun Kwon and Juhan Nam
    Workshop on Machine Learning for Creativity and Design, Neural Information Processing Systems (NIPS), 2018 [pdf]
  • Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction
    Edward Jangwon Lee, Sangeon Yong, Soonbeom Choi, Liwei Chan, Roshan Peiris and Juhan Nam
    Lecture Notes in Computer Science (revised selected papers of CMMR 2017), Vol. 11265, 2018 [pdf]
  • Representation Learning of Music Using Artist Labels
    Jiyoung Park, Jongpil Lee, Jangyeon Park, Jung-Woo Ha and Juhan Nam
    Proceedings of the 19th International Society for Music Information Retrieval Conference (ISMIR), 2018 [pdf]
  • Revisiting Singing Voice Detection: a Quantitative Review and the Future Outlook
    Kyungyun Lee, Keunwoo Choi and Juhan Nam
    Proceedings of the 19th International Society for Music Information Retrieval Conference (ISMIR), 2018 [pdf] [code]
  • A Timbre-based Approach to Estimate Key Velocity from Polyphonic Piano Recordings
    Dasaem Jeong, Taegyun Kwon and Juhan Nam
    Proceedings of the 19th International Society for Music Information Retrieval Conference (ISMIR), 2018 [pdf]
  • NEUROSCAPE: Artificial Soundscape Based on Multimodal Connections of Deep Neural Networks
    Seungsoon Park, Jongpil Lee, and Juhan Nam
    International Computer Music Conference (ICMC), 2018 (installation)
  • A Hybrid of Deep Audio Feature and i-vector for Artist Recognition
    Jiyoung Park, Donghyun Kim, Jongpil Lee, Sangeun Kum and Juhan Nam
    Joint Workshop on Machine Learning for Music, International Conference on Machine Learning (ICML), 2018 [pdf]
  • Singing Expression Transfer from One Voice to Another for a Given Song
    Sangeon Yong and Juhan Nam
    Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018 [pdf]
  • Sample-level CNN Architectures for Music Auto-tagging Using Raw Waveforms
    Taejun Kim, Jongpil Lee, and Juhan Nam
    Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018 [pdf]
  • SampleCNN: End-to-End Deep Convolutional Neural Networks Using Very Small Filters for Music Classification
    Jongpil Lee, Jiyoung Park, Keunhyoung Luke Kim and Juhan Nam
    Applied Sciences, 2018 [pdf]

2017

  • Raw Waveform-based Audio Classification Using Sample-level CNN Architectures
    Jongpil Lee, Taejun Kim, Jiyoung Park and Juhan Nam
    Machine Learning for Audio Signal Processing Workshop, Neural Information Processing Systems (NIPS), 2017 [pdf]
  • Combining Multi-Scale Features Using Sample-level Deep Convolutional Neural Networks for Weakly Supervised Sound Event Detection
    Jongpil Lee, Jiyoung Park, Sangeun Kum, Youngho Jeong and Juhan Nam
    Proceedings of the 2nd Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE), 2017 [pdf]
  • Cross-cultural Transfer Learning Using Sample-level Deep Convolutional Neural Networks
    Jongpil Lee, Jiyoung Park, Chanju Kim, Adrian Kim, Jangyeon Park, Jung-Woo Ha and Juhan Nam
    Music Information Retrieval Evaluation eXchange (MIREX) in the 18th International Society for Musical Information Retrieval Conference (ISMIR), 2017 [pdf]
    *** The 1st place in the four K-POP tasks across all algorithms submitted so far ***
  • Representation Learning Using Artist labels for Audio Classification Tasks
    Jiyoung Park, Jongpil Lee, Jangyeon Park, Jung-Woo Ha and Juhan Nam
    Music Information Retrieval Evaluation eXchange (MIREX) in the 18th International Society for Musical Information Retrieval Conference (ISMIR), 2017 [pdf]
    *** The 1st place in the Music Mood Classification task across all algorithms submitted so far ***
  • PerformScore: Toward Performance Visualization With the Score on the Web Browser
    Dasaem Jeong, Taegyun Kwon, Chaelin Park and Juhan Nam
    Late Breaking Demo in the 18th International Society for Musical Information Retrieval Conference (ISMIR), 2017 [pdf]
  • Music Galaxy Hitchhiter: 3D Web Music Navigation Through Audio Space Trained with Tag and Artist Labels
    Dongwoo Suh, Kyungyun Lee, Jongpil Lee, Jiyoung Park and Juhan Nam
    Late Breaking Demo in the 18th International Society for Musical Information Retrieval Conference (ISMIR), 2017 [pdf]
  • Building K-POP Singing Voice Tag Dataset: A Progress Report
    KeunHyoung Luke Kim, Sangeun Kum, Chae Lin Park, Jongpil Lee, Jiyoung Park and Juhan Nam
    Late Breaking Demo in the 18th International Society for Musical Information Retrieval Conference (ISMIR), 2017 [pdf]
  • Automatic DJ Mix Generation Using Highlight Detection
    Adrian Kim, Soram Park, Jangyeon Park, Jung-Woo Ha, Taegyun Kwon and Juhan Nam
    Late Breaking Demo in the 18th International Society for Musical Information Retrieval Conference (ISMIR), 2017 [pdf]
  • Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction
    Edward Jangwon Lee, Sangeon Yong, Soonbeom Choi, Liwei Chan, Roshan Peiris and Juhan Nam
    Proceedings of the 13th International Symposium on Computer Music Multidisciplinary Research (CMMR), 2017 [pdf] [demo]
  • Multi-Level and Multi-Scale Feature Aggregation Using Sample-level Deep Convolutional Neural Networks for Music Classification
    Jongpil Lee and Juhan Nam
    Machine Learning for Music Discovery Workshop, the 34th International Conference on Machine Learning (ICML), 2017 [pdf]
  • How the Rhythm Is Actually Performed in the First Movement of the Beethoven’s Seventh Symphony
    Dasaem Jeong and Juhan Nam
    Proceedings of the 10th International Conference of Students of Systematic Musicology (SysMus), 2017 [pdf]
  • Sample-level Deep Convolutional Neural Networks for Music Auto-Tagging Using Raw Waveforms
    Jongpil Lee, Jiyoung Park, Keunhyoung Luke Kim and Juhan Nam
    Proceedings of the 14th Sound and Music Computing Conference (SMC), 2017 [pdf]
  • Audio-to-Score Alignment Of Piano Music Using RNN-based Automatic Music Transcription
    Taegyun Kwon, Dasaem Jeong and Juhan Nam
    Proceedings of the 14th Sound and Music Computing Conference (SMC), 2017 [pdf] [demo]
  • Multi-Level and Multi-Scale Feature Aggregation Using Pre-trained Convolutional Neural Networks for Music Auto-Tagging
    Jongpil Lee and Juhan Nam
    IEEE Signal Processing Letters, 2017 [pdf]
  • Note Intensity Estimation of Piano Recordings by Score-informed NMF
    Dasaem Jeong and Juhan Nam
    Proceedings of the Audio Engineering Society Conference on Semantic Audio (AES), 2017 [pdf]
  • ForceClicks: Enabling Efficient Button Interaction with Single Finger Touch
    Sangeon Yong, Edward Jangwon Lee, Roshan Peiris, Liwei Chan and Juhan Nam
    Proceedings of the International Conference on Tangible, Embedded and Embodied Interactions (TEI), 2017 [pdf] [demo]
  • 바이브레이션 리사주 도형을 이용한 노래 창법 시각화
    김태형, 남주한
    한국 HCI 학회, 2017

2016

  • Melody Extraction on Vocal Segments Using Multi-Column Deep Neural Networks
    Sangeun Kum, Changheun Oh and Juhan Nam
    Proceedings of the 17th International Society for Music Information Retrieval Conference (ISMIR), 2016 [pdf] [website]
  • Comparison of Tonality Models in Measuring Chord Sequence Similarity
    Saebyul Park, Jeounghoon Kim and Juhan Nam
    Proceedings of the 14th International Conference on Music Perception and Cognition (ICMPC), 2016 [pdf]
  • Characteristics of Non-linguistic Vocalizations as Auditory Emoticons
    Kyoungsoo Chun, Jinah Kwak and Juhan Nam
    Proceedings of the 14th International Conference on Music Perception and Cognition (ICMPC), 2016 [pdf]
  • Sonic Participation in the Evolving Audio Feedback System
    Seunghun Kim, Changheun Oh, Graham Wakefield and Juhan Nam
    Proceedings of The 22nd International Symposium on Electronic Art (ISEA), 2016 [pdf] [demo]
  • Augmenting Environmental Interaction in Audio Feedback Systems
    Seunghun Kim, Graham Wakefield and Juhan Nam
    Applied Sciences, 2016 [pdf]
  • Sparse Feature Learning for Instrument Identification: Effects of Sampling and Pooling Methods
    Yoonchang Han, Subin Lee, Juhan Nam and Kyogu Lee
    Journal of the Acoustical Society of America (JASA), 2016 [pdf]
  • Visualizing Music in its Entirety using Acoustic Features: Music Flowgram
    Dasaem Jeong and Juhan Nam
    Proceedings of the 2nd International Conference on Technologies for Music Notation and Representation (TENOR), 2016 [pdf]
  • 멜로디 추출 알고리즘으로 살펴보는 음악정보 검색
    금상은, 남주한
    대한전자공학회, 전자공학회지, 2016
  • 한국가요 목소리 태그 검증과 가수 유사도 분석
    이종필, 김태형, 금상은, 김근형, 오창현, 남주한
    한국 음향 학회 춘계 학술 대회, 2016
  • PSOLA 기법을 이용한 실시간 가창 음정 보정 시스템
    김태형, 남주한
    한국 음향 학회 춘계 학술 대회, 2016

2015

  • A Deep Bag-of-Features Model for Music Auto-Tagging
    Juhan Nam, Jorge Herrera, Kyogu Lee
    arXiv preprint arXiv:1508.04999, 2015 [pdf]
  • Melodic and Harmonic Similarity for Music Plagiarism: Comparison between computational analysis and perceptual evaluation
    Saebyul Park, Seunghun Kim, Dasaem Jeong, Juhan Nam and Jeounghoon Kim
    Proceedings of the Society for Music Perception and Cognition (SMPC), 2015
  • Augmenting Room Acoustics and System Interaction for Intentional Control of Audio Feedback
    Seunghun Kim, Graham Wakefield and Juhan Nam
    Proceedings of the 41st International Computer Music Conference (ICMC), 2015 [pdf]
  • SoniControl: Gesture Recognition System for Electric Guitar Using VLF Beacon Signals
    Sangwon Suh, Juhan Nam and Sung-hee Lee
    Proceedings of the 15th International Conference on New Interfaces for Musical Expression (NIME), 2015 [pdf]
  • Toward Certain Sonic Properties of an Audio Feedback System by Evolutionary Control of Second-Order Structures
    Seunghun Kim, Juhan Nam and Graham Wakefield
    Proceedings of the 4th International Conference (and 12th European event) on Evolutionary and Biologically Inspired Music, Sound, Art and Design (EvoMUSART), 2015 [pdf] [demo]

Prior to 2014

  • Acoustic Scene Classification Using Sparse Feature Learning and Event-based Pooling
    Kyogu Lee, Ziwon Hyung, and Juhan Nam
    Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), 2013 [pdf]
  • Learning Sparse Feature Representations for Music Annotation and Retrieval
    Juhan Nam, Jorge Herrera, Malcolm Slaney and Julius O. Smith
    Proceedings of the 13th International Conference for Music Information Retrieval (ISMIR) Conference, 2012 [pdf]
  • Sound Recognition in Mixtures
    Juhan Nam, Gautham J. Mysore and Paris Smaragdis
    Proceedings of the International Conference on Latent Variable Analysis and Signal Separation (LVA/ICA), 2012 [pdf]
  • Optimized Polynomial Spline Basis Function Design for Quasi-Bandlimited Classical Waveform Synthesis
    Jussi Pekonen, Juhan Nam, Vesa Välimäki and Julius O. Smith
    IEEE Signal Processing Letters, 2012 [pdf]
  • Perceptually Informed Synthesis of Bandlimited Classical Waveforms Using Integrated Polynomial Interpolation
    Vesa Välimäki, Jussi Pekonen, Juhan Nam
    Journal of the Acoustical Society of America (JASA), 2012 [pdf]
  • A Classification-Based Polyphonic Piano Transcription Approach Using Learned Feature Representations
    Juhan Nam, Jiquan Ngiam, Honglak Lee and Malcolm Slaney
    Proceedings of the 12th International Conference for Music Information Retrieval (ISMIR) Conference, 2011 [pdf]
  • Multimodal Deep Learning
    Jiquan Ngiam, Aditya Khosla, Mingyu Kim, Juhan Nam, Honglak Lee and Andrew Y. Ng
    Proceedings of the 28th International Conference on Machine Learning (ICML), 2011 [pdf]
  • Multimodal Deep Learning
    Jiquan Ngiam, Aditya Khosla, Mingyu Kim, Juhan Nam, Honglak Lee and Andrew Y. Ng
    Workshop on Deep Learning and Unsupervised Feature Learning, Neural Information Processing Systems (NIPS), 2010 [pdf]
  • Efficient antialiasing oscillator algorithms using low-order fractional delay filters
    Juhan Nam, Vesa Välimäki, Jonathan S. Abel, and Julius O. Smith
    IEEE Transactions on Audio, Speech and Language Processing, 2010 [pdf]
  • Alias-suppressed oscillators based on differentiated polynomial waveforms
    Vesa Välimäki, Juhan Nam, Jonathan O. Smith, and Jonathan S. Abel
    IEEE Transactions on Audio, Speech and Language Processing, 2010 [pdf]
  • A super-resolution spectrogram using coupled PLCA
    Juhan Nam, Gautham Mysore, Joachim Ganseman, Kyogu Lee, and Jonathan S. Abel
    Proceedings of the 11th Conference of the International Speech Communication Association (InterSpeech), 2010 [pdf]
  • On Minimizing the Look-Up Table Size in Quasibandlimited Classical Waveform Oscillators
    Jussi Pekonen, Juhan Nam, Julius O. Smith, Jonathan S. Abel and V. Välimäki
    Proceedings of the 13th Int. Conference on Digital Audio Effects (DAFx), 2010 [pdf]
  • Variable Fractional Delay Filters in Bandlimited Oscillator Algorithms for Music Synthesis
    Jussi Pekonen, Vesa Välimäki, Juhan Nam, Julius O. Smith, and Jonathan S. Abel
    Proceedings of Int. Conference on Green Circuits and Systems, 2010 (Invited paper) [pdf]
  • Alias-free virtual analog oscillators using a feedback delay loop
    Juhan Nam, Vesa Välimäki, Jonathan S. Abel, Julius O. Smith
    Proceedings of the 12th Int. Conference on Digital Audio Effects (DAFx), 2009 [pdf]
  • A Method for Estimating Interaural Time Difference for Binaural Synthesis
    Juhan Nam, Jonathan S. Abel, Julius O. Smith
    Proceedings of the 125th Audio Engineering Society Convention (AES), 2008 [pdf]
  • On the Minimum-phase Nature of Head-Related Transfer Functions
    Juhan Nam, Miriam A. Kolar, Jonathan S. Abel
    Proceedings of the 125th Audio Engineering Society Convention (AES), 2008 [pdf]
  • A Study of Sinusoid Generation Using Recursive Algorithms
    Juhan Nam
    Journal of Korea Electro-Acoustic Music Society (Emile), 2005

Patents

  • 음원의 가수 목소리를 사용자의 음색으로 변환하는 시스템 및 방법
    남주한, 용상언, 출원 10-2018-0151531, 2018
  • 심층 인공신경망 기반 자동 악보 채보를 이용한 연주 및 악보 정렬 방법 및 시스템
    남주한, 권태균, 정다샘, 출원 10-2017-0166444, 2017
  • 가창 표현 이식 시스템
    남주한, 용상언, 출원 10-2017-0077908, 2017, 등록 10-1925217-0000, 2018