Deep Learning for Music

Deep Learning (creative AI) might potentially be used for music analysis and music creation. Deepmind’s Wavenet is a step in that direction. This blog post presents recent papers in Deep Learning for Music.

note: If you are curious about oversight of Deep Learning topics, please consider subscribing to my Deep Learning Newsletter at the end of this blog post.

Best regards,

Amund Tveit

Generation, Analysis and Segmentation of Music

  1. Deep Learning for Music
    – Authors: 
    A HuangR Wu (2016)
  2. Live Orchestral Piano, a system for real-time orchestral music generation
    – Authors: L CrestelP Esling (2016)
  3. Unsupervised feature learning for Music Structural Analysis
    – Authors: M BuccoliM ZanoniA SartiS TubaroD Andreoletti (2016)
  4. Music staff removal with supervised pixel classification
    – Authors: J Calvo (2016)
  5. An Intelligent Musical Rhythm Variation Interface
    – Authors: R VoglP Knees (2016)
  6. Probabilistic Segmentation of Musical Sequences using Restricted Boltzmann Machines
    – Authors: S LattnerM GrachtenK AgresCec Chacan (2015)
  7. Machine Learning Applied to Musical Improvisation
    – Authors: Rm Keller (2015)
  8. A Deep Neural Network for Modeling Music
    – Authors: P ZhangX ZhengW ZhangS LiS QianW (2015)
  9. Deep symbolic learning of multiple temporal granularities for musical orchestration.
    – Authors: F JacquemardG PeetersP E. (2015)
  10. Deep Karaoke: Extracting Vocals from Musical Mixtures Using a Convolutional Deep Neural Network
    – Authors: Ajr SimpsonG RomaMd Plumbley (2015)
  11. Deep Remix: Remixing Musical Mixtures Using a Convolutional Deep Neural Network
    – Authors: Ajr SimpsonG RomaMd Plumbley (2015)
  12. Analysis of musical structure: an approach based on deep learning
    – Authors: D Andreoletti (2015)
  13. An exploration of deep learning in content-based music informatics
    – Authors: Ej Humphrey (2015)
  14. Fusing Music and Video Modalities Using Multi-timescale Shared Representations
    – Authors: B XuX WangX Tang (2014)

Music Transcription

  1. An End-to-End Neural Network for Polyphonic Piano Music Transcription
    – Authors: S SigtiaE BenetosS Dixon (2016)
  2. Music transcription modelling and composition using deep learning
    – Authors: Bl SturmJf SantosO Ben (2016)
  3. Rewind: A Music Transcription Method
    – Authors: Cd Carthen (2016)
  4. An End-to-End Neural Network for Polyphonic Music Transcription
    – Authors: S SigtiaE BenetosS Dixon (2015)


  1. Novel Affective Features For Multiscale Prediction Of Emotion In Music
    – Authors: N KumarT GuhaCw HuangC VazSs Narayanan (2016)
  2. Demv-Matchmaker: Emotional Temporal Course Representation And Deep Similarity Matching For Automatic Music Video Generation 
    – Authors: Jc LinWl WeiHm Wang (2016)


  1. A Comparative Study on Music Genre Classification Algorithms
    – Authors: W Stokowiec (2016)
  2. Audio-Based Music Classification with A Pretrained Convolutional Network
    – Authors: E DielemanB Schrauwen (2016)
  3. Semantic Labeling of Music
    – Authors: P KneesM Schedl (2016)
  4. Classification of classic Turkish music makams by using deep belief networks
    – Authors: Mak SB Bolat (2016)
  5. Deep convolutional neural networks for predominant instrument recognition in polyphonic music
    – Authors: Y HanJ KimK Lee (2016)
  6. Deep learning, audio adversaries, and music content analysis
    – Authors: C KereliukBl SturmJ Larsen (2015)
  7. Speech Music Discrimination Using an Ensemble of Biased Classifiers
    – Authors: K KimA BaijalBs KoS LeeI HwangY Kim (2015)
  8. Deep Learning and Music Adversaries
    – Authors: C KereliukBl SturmJ Larsen (2015)
  9. Musical notes classification with Neuromorphic Auditory System using FPGA and a Convolutional Spiking Network
    – Authors: E Cerezuela (2015)
  10. A Deep Bag-of-Features Model for Music Auto-Tagging
    – Authors: J NamJ HerreraK Lee (2015)
  11. Music Genre Classification Using Convolutional Neural Network
    – Authors: Q KongX FengY Li (2014)
  12. An Associative Memorization Architecture of Extracted Musical Features from Audio Signals by Deep Learning Architecture
    – Authors: T NiwaK NaruseR OoeM KinoshitaT M (2014)
  13. Unsupervised Feature Pre-training of the Scattering Wavelet Transform for Musical Genre Recognition
    – Authors: M KD K (2014)

Search and Recommender Systems

  1. Deep learning for audio-based music recommendation
    – Authors: S Dieleman (2016)
  2. A compositional hierarchical model for music information retrieval
    – Authors: M PesekA LeonardisM Marolt (2014)

Please sign up for Amund Tveit’s Deep Learning Newsletter!

You may also like

1 Comment

Leave a Reply

Your email address will not be published. Required fields are marked *