Deep Learning for Traffic Sign Detection and Recognition

Traffic Sign Detection and Recognition is key functionality for self-driving cars. This posting has recent papers in this area. Check also out related posting: Deep Learning for Vehicle Detection and Classification

Best regards,
Amund Tveit
Amund Tveit

Year  Title Author
2016   Road surface traffic sign detection with hybrid region proposal and fast R-CNN  R Qian, Q Liu, Y Yue, F Coenen, B Zhang
2016   Traffic sign classification with deep convolutional neural networks  J CREDI
2016   Real-time Traffic Sign Recognition system with deep convolutional neural network  S Jung, U Lee, J Jung, DH Shim
2016   Traffic Sign Detection and Recognition using Fully Convolutional Network Guided Proposals  Y Zhu, C Zhang, D Zhou, X Wang, X Bai, W Liu
2016   A traffic sign recognition method based on deep visual feature  F Lin, Y Lai, L Lin, Y Yuan
2016   The research on traffic sign recognition based on deep learning  C Li, C Yang
2015   Fast Traffic Sign Recognition with a Rotation Invariant Binary Pattern Based Feature  S Yin, P Ouyang, L Liu, Y Guo, S Wei
2015   Malaysia traffic sign recognition with convolutional neural network  MM Lau, KH Lim, AA Gopalai
2015   Negative-Supervised Cascaded Deep Learning for Traffic Sign Classification  K Xie, S Ge, R Yang, X Lu, L Sun
Continue Reading

Deep Learning for Vehicle Detection and Classification

This posting has recent papers about vehicle (e.g. car) detection and classification, e.g. for selv-driving/autonomous cars. Related: check also out Nvidia‘s End-to-End Deep Learning for Self-driving Cars and Udacity‘s Self-Driving Car Engineer (Nanodegree).

Best regards,

<a href=”https://amundtveit.com/about/”>Amund Tveit</a> (<a href=”https://twitter.com/atveit”>@atveit</a>)

Year  Title Author
2016   Vehicle Classification using Transferable Deep Neural Network Features  Y Zhou, NM Cheung
2016   A Hybrid Fuzzy Morphology And Connected Components Labeling Methods For Vehicle Detection And Counting System  C Fatichah, JL Buliali, A Saikhu, S Tena
2016   Evaluation of vehicle interior sound quality using a continuous restricted Boltzmann machine-based DBN  HB Huang, RX Li, ML Yang, TC Lim, WP Ding
2016   An Automated Traffic Surveillance System with Aerial Camera Arrays: Data Collection with Vehicle Tracking  X Zhao, D Dawson, WA Sarasua, ST Birchfield
2016   Vehicle type classification via adaptive feature clustering for traffic surveillance video  S Wang, F Liu, Z Gan, Z Cui
2016   Vehicle Detection in Satellite Images by Incorporating Objectness and Convolutional Neural Network  S Qu, Y Wang, G Meng, C Pan
2016   DAVE: A Unified Framework for Fast Vehicle Detection and Annotation  Y Zhou, L Liu, L Shao, M Mellor
2016   3D Fully Convolutional Network for Vehicle Detection in Point Cloud  B Li
2016   A Deep Learning-Based Approach to Progressive Vehicle Re-identification for Urban Surveillance  X Liu, W Liu, T Mei, H Ma
2016   TraCount: a deep convolutional neural network for highly overlapping vehicle counting  S Surya, RV Babu
2016   Pedestrian, bike, motorcycle, and vehicle classification via deep learning: Deep belief network and small training set  YY Wu, CM Tsai
2016   Fast Vehicle Detection in Satellite Images Using Fully Convolutional Network  J Hu, T Xu, J Zhang, Y Yang
2016   Local Tiled Deep Networks for Recognition of Vehicle Make and Model  Y Gao, HJ Lee
2016   Vehicle detection based on visual saliency and deep sparse convolution hierarchical model  Y Cai, H Wang, X Chen, L Gao, L Chen
2016   Sound quality prediction of vehicle interior noise using deep belief networks  HB Huang, XR Huang, RX Li, TC Lim, WP Ding
2016   Accurate On-Road Vehicle Detection with Deep Fully Convolutional Networks  Z Jie, WF Lu, EHF Tay
2016   Fault Detection and Identification of Vehicle Starters and Alternators Using Machine Learning Techniques  E Seddik
2016   Fault diagnosis network design for vehicle on-board equipments of high-speed railway: A deep learning approach  J Yin, W Zhao
2016   Real-time state-of-health estimation for electric vehicle batteries: A data-driven approach  G You, S Park, D Oh
2016   The Precise Vehicle Retrieval in Traffic Surveillance with Deep Convolutional Neural Networks  B Su, J Shao, J Zhou, X Zhang, L Mei, C Hu
2016   Online vehicle detection using deep neural networks and lidar based preselected image patches  S Lange, F Ulbrich, D Goehring
2016   A closer look at Faster R-CNN for vehicle detection  Q Fan, L Brown, J Smith
2016   Appearance-based Brake-Lights recognition using deep learning and vehicle detection  JG Wang, L Zhou, Y Pan, S Lee, Z Song, BS Han
2016   Night time vehicle detection algorithm based on visual saliency and deep learning  Y Cai, HW Xiaoqiang Sun, LCH Jiang
2016   Vehicle classification in WAMI imagery using deep network  M Yi, F Yang, E Blasch, C Sheaff, K Liu, G Chen, H Ling
2015   VeTrack: Real Time Vehicle Tracking in Uninstrumented Indoor Environments  M Zhao, T Ye, R Gao, F Ye, Y Wang, G Luo
2015   Vehicle Color Recognition in The Surveillance with Deep Convolutional Neural Networks  B Su, J Shao, J Zhou, X Zhang, L Mei
2015   Vehicle Speed Prediction using Deep Learning  J Lemieux, Y Ma
2015   Monza: Image Classification of Vehicle Make and Model Using Convolutional Neural Networks and Transfer Learning  D Liu, Y Wang
2015   Night Time Vehicle Sensing in Far Infrared Image with Deep Learning  H Wang, Y Cai, X Chen, L Chen
2015   A Vehicle Type Recognition Method based on Sparse Auto Encoder  HL Rong, YX Xia
2015   Occluded vehicle detection with local connected deep model  H Wang, Y Cai, X Chen, L Chen
2015   Performance Evaluation of the Neural Network based Vehicle Detection Models  K Goyal, D Kaur
2015   A Smartphone-based Connected Vehicle Solution for Winter Road Surface Condition Monitoring  MA Linton
2015   Vehicle Logo Recognition System Based on Convolutional Neural Networks With a Pretraining Strategy  Y Huang, R Wu, Y Sun, W Wang, X Ding
2015   SiftKeyPre: A Vehicle Recognition Method Based on SIFT Key-Points Preference in Car-Face Image  CY Zhang, XY Wang, J Feng, Y Cheng
2015   Vehicle Detection in Aerial Imagery: A small target detection benchmark  S Razakarivony, F Jurie
2015   Vehicle license plate recognition using visual attention model and deep learning  D Zang, Z Chai, J Zhang, D Zhang, J Cheng
2015   Domain adaption of vehicle detector based on convolutional neural networks  X Li, M Ye, M Fu, P Xu, T Li
2015   Trainable Convolutional Network Apparatus And Methods For Operating A Robotic Vehicle  P O’connor, E Izhikevich
2015   Vehicle detection and classification based on convolutional neural network  D He, C Lang, S Feng, X Du, C Zhang
2015   The AdaBoost algorithm for vehicle detection based on CNN features  X Song, T Rui, Z Zha, X Wang, H Fang
2015   Deep neural networks-based vehicle detection in satellite images  Q Jiang, L Cao, M Cheng, C Wang, J Li
2015   Vehicle License Plate Recognition Based on Extremal Regions and Restricted Boltzmann Machines  C Gou, K Wang, Y Yao, Z Li
2014   Multi-modal Sensor Registration for Vehicle Perception via Deep Neural Networks  M Giering, K Reddy, V Venugopalan
2014   Mooting within the curriculum as a vehicle for learning: student perceptions  L Jones, S Field
2014   Vehicle Type Classification Using Semi-Supervised Convolutional Neural Network  Z Dong, Y Wu, M Pei, Y Jia
2014   Vehicle License Plate Recognition With Random Convolutional Networks  D Menotti, G Chiachia, AX Falcao, VJO Neto
2014   Vehicle Type Classification Using Unsupervised Convolutional Neural Network  Z Dong, M Pei, Y He, T Liu, Y Dong, Y Jia
Continue Reading

Deep Learning with Gaussian Process

Gaussian Process is a statistical model where observations are in the continuous domain, to learn more check out a tutorial on gaussian process (by Univ.of Cambridge’s Zoubin G.). Gaussian Process is an infinite-dimensional generalization of multivariate normal distributions.

Researchers from University of Sheffield – Andreas C. Damanianou and Neil D. Lawrence – started using Gaussian Process with Deep Belief Networks (in 2013). This Blog post contains recent papers related to combining Deep Learning with Gaussian Process.

Best regards,
Amund Tveit

Year  Title Author
2016   Inverse Reinforcement Learning via Deep Gaussian Process  M Jin, C Spanos
2016   Annealing Gaussian into ReLU: a New Sampling Strategy for Leaky-ReLU RBM  CL Li, S Ravanbakhsh, B Poczos
2016   Large Scale Gaussian Process for Overlap-based Object Proposal Scoring  SL Pintea, S Karaoglu, JC van Gemert
2016   Gaussian Neuron in Deep Belief Network for Sentiment Prediction  Y Jin, D Du, H Zhang
2016   Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation with Deep Gaussian CRFs  S Chandra, I Kokkinos
2016   The Variational Gaussian Process  D Tran, R Ranganath, DM Blei
2016   Probabilistic Feature Learning Using Gaussian Process Auto-Encoders  S Olofsson
2016   Sequential Inference for Deep Gaussian Process  Y Wang, M Brubaker, B Chaib
2016   Gaussian Copula Variational Autoencoders for Mixed Data  S Suh, S Choi
2016   Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising  K Zhang, W Zuo, Y Chen, D Meng, L Zhang
2016   Image super-resolution using non-local Gaussian process regression  H Wang, X Gao, K Zhang, J Li
2016   Gaussian Conditional Random Field Network for Semantic Segmentation  R Vemulapalli, O Tuzel, MY Liu, R Chellappa
2016   Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteriors  C Louizos, M Welling
2016   Deep Gaussian Processes for Regression using Approximate Expectation Propagation  TD Bui, D Hernández
2015   Learning to Assess Terrain from Human Demonstration Using an Introspective Gaussian Process Classifier  LP Berczi, I Posner, TD Barfoot
2015   Assessing the Degree of Nativeness and Parkinson’s Condition Using Gaussian Processes and Deep Rectifier Neural Networks  T Grósz, R Busa
2015   Gaussian processes methods for nostationary regression  L Muñoz González
2015   Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?  R Giryes, G Sapiro, AM Bronstein
2015   Nonlinear Gaussian Belief Network based fault diagnosis for industrial processes  H Yu, F Khan, V Garaniya
2015   Interactions Between Gaussian Processes and Bayesian Estimation  YL Wang
2015   Gaussian discrete restricted Boltzmann machine: theory and its applications: a thesis presented in partial fulfilment of the requirements for the degree of Master of …  S Manoharan
2015   Prosody Generation Using Frame-based Gaussian Process Regression  T Koriyama, T Kobayashi
2015   Mean-Field Inference in Gaussian Restricted Boltzmann Machine  C Takahashi, M Yasuda
2015   Variational Auto-encoded Deep Gaussian Processes  Z Dai, A Damianou, J González, N Lawrence
2015   Training Deep Gaussian Processes using Stochastic Expectation Propagation and Probabilistic Backpropagation  TD Bui, JM Hernández
2015   Accurate Object Detection and Semantic Segmentation using Gaussian Mixture Model and CNN  S Jain, S Dehriya, YK Jain
2014   Cross Modal Deep Model and Gaussian Process Based Model for MSR-Bing Challenge  J Wang, C Kang, Y He, S Xiang, C Pan
2014   Non-negative Factor Analysis of Gaussian Mixture Model Weight Adaptation for Language and Dialect Recognition  J Glass
2014   Gaussian Process Models with Parallelization and GPU acceleration  Z Dai, A Damianou, J Hensman, N Lawrence
2014   Parametric Speech Synthesis Using Local and Global Sparse Gaussian  T Koriyama, T Nose, T Kobayashi
2014   On the Link Between Gaussian Homotopy Continuation and Convex Envelopes  H Mobahi, JW Fisher III
2014   Improving Deep Neural Networks Using State Projection Vectors Of Subspace Gaussian Mixture Model As Features  M Karthick, S Umesh
2014   A Theoretical Analysis of Optimization by Gaussian Continuation  H Mobahi, JW Fisher III
2014   Factoring Variations in Natural Images with Deep Gaussian Mixture Models  A van den Oord, B Schrauwen
2014   Feature representation with Deep Gaussian processes
Continue Reading

Deep Learning for Ultrasound Analysis


Ultrasound (also called Sonography) are sound waves with higher frequency than humans can hear, they frequently used in medical settings, e.g. for checking that pregnancy is going well with fetal ultrasound. For more about Ultrasound data formats check out Ultrasound Research Interface. This blog post has recent publications about applying Deep Learning for analyzing Ultrasound data.

Best regards,
Amund Tveit

Year  Title Authors
2016   Early-stage atherosclerosis detection using deep learning over carotid ultrasound images  RM Menchón
2016   Automatic Detection of Standard Sagittal Plane in the First Trimester of Pregnancy Using 3-D Ultrasound Data  S Nie, J Yu, P Chen, Y Wang, JQ Zhang
2016   Detection of prostate cancer using temporal sequences of ultrasound data: a large clinical feasibility study  S Azizi, F Imani, S Ghavidel, A Tahmasebi, JT Kwak
2016   Hough-CNN: Deep Learning for Segmentation of Deep Brain Regions in MRI and Ultrasound  F Milletari, SA Ahmadi, C Kroll, A Plate, V Rozanski
2016   Hybrid approach for automatic segmentation of fetal abdomen from ultrasound images using deep learning  H Ravishankar, SM Prabhu, V Vaidya, N Singhal
2016   Iterative Multi-domain Regularized Deep Learning for Anatomical Structure Detection and Segmentation from Ultrasound Images  H Chen, Y Zheng, JH Park, PA Heng, SK Zhou
2016   4D Cardiac Ultrasound Standard Plane Location by Spatial-Temporal Correlation  Y Gu, GZ Yang, J Yang, K Sun
2016   Computer-Aided Diagnosis for Breast Ultrasound Using Computerized BI-RADS Features and Machine Learning Methods  J Shan, SK Alam, B Garra, Y Zhang, T Ahmed
2016   Stacked Deep Polynomial Network Based Representation Learning for Tumor Classification with Small Ultrasound Image Dataset  J Shi, S Zhou, X Liu, Q Zhang, M Lu, T Wang
2016   Coupling Convolutional Neural Networks and Hough Voting for Robust Segmentation of Ultrasound Volumes  C Kroll, F Milletari, N Navab, SA Ahmadi
2016   Classifying Cancer Grades Using Temporal Ultrasound for Transrectal Prostate Biopsy  S Azizi, F Imani, JT Kwak, A Tahmasebi, S Xu, P Yan
2015   Tumor Classification by Deep Polynomial Network and Multiple Kernel Learning on Small Ultrasound Image Dataset  X Liu, J Shi, Q Zhang
2015   Automatic Recognition of Fetal Facial Standard Plane in Ultrasound Image via Fisher Vector  B Lei, EL Tan, S Chen, L Zhuo, S Li, D Ni, T Wang
2015   Estimation of the Arterial Diameter in Ultrasound Images of the Common Carotid Artery  RM Menchón
2015   Cell recognition based on topological sparse coding for microscopy imaging of focused ultrasound treatment  Z Wang, J Zhu, Y Xue, C Song, N Bi
2014   Mapping between ultrasound and vowel speech using DNN framework  X Zheng, J Wei, W Lu, Q Fang, J Dang
2014   High-definition 3D Image Processing Technology for Ultrasound Diagnostic Scanners  M Ogino, T Shibahara, Y Noguchi, T Tsujita
2014   Fully automatic segmentation of ultrasound common carotid artery images based on machine learning  RM Menchón
Continue Reading

Deep Learning with FPGA

This chapter presents recent papers for using FPGAs (Field Programmable Gate Arrays) for Deep Learning. FPGAs can roughly be seen as a Software-configurable Hardware, i.e you in some cases get close to dedicated hardware speed (although typically at lower clock frequency than chips, but typically with strong on-FPGA parallelism), this can be a potential good fit for e.g. Convolutional Neural Networks since they require many convolutional layer calculations (with many convolutional filters per conv.layer) with large tensors. Recommend starting with having a look at Deep Learning on FPGAs: Past, Present, and Future

Best regards,

Amund Tveit

Convolutional Neural Network

  1. Throughput-Optimized OpenCL-based FPGA Accelerator for Large-Scale Convolutional Neural Networks
    – Authors: N Suda, V Chandra, G Dasika, A Mohanty, Y M (2016)
  2. Curbing the roofline: a scalable and flexible architecture for CNNs on FPGA
    – Authors: P Meloni, G Deriu, F Conti, I Loi, L Raffo, L Benini (2016)
  3. Comprehensive Evaluation of OpenCL-based Convolutional Neural Network Accelerators in Xilinx and Altera FPGAs
    – Authors: R Tapiador, A Rios (2016)
  4. Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
    – Authors: C Zhang, P Li, G Sun, Y Guan, B Xiao, J Cong (2015)
  5. Musical notes classification with Neuromorphic Auditory System using FPGA and a Convolutional Spiking Network
    – Authors: E Cerezuela (2015)
  6. CNNLab: a Novel Parallel Framework for Neural Networks using GPU and FPGA-a Practical Study with Trade-off Analysis
    – Authors: M Zhu, L Liu, C Wang, Y Xie (2016)
  7. Energy-Efficient CNN Implementation on a Deeply Pipelined FPGA Cluster
    – Authors: C Zhang, D Wu, J Sun, G Sun, G Luo, J Cong (2016)

 

Other uses of FPGA in Deep Learning

  1. Deep Neural Network Architecture Implementation on FPGAs Using a Layer Multiplexing Scheme
    – Authors: F Ortega (2016)
  2. FPGA Based Multi-core Architectures for Deep Learning Networks
    – Authors: H Chen (2016)
  3. FPGA Implementation of a Scalable and Highly Parallel Architecture for Restricted Boltzmann Machines
    – Authors: K Ueyoshi, T Marukame, T Asai, M Motomura… (2016)
  4. DLAU: A Scalable Deep Learning Accelerator Unit on FPGA
    – Authors: C Wang, Q Yu, L Gong, X Li, Y Xie, X Zhou (2016)
  5. Deep Learning on FPGAs
    – Authors: Gj Lacey (2016)
  6. DNNWEAVER: From High-Level Deep Network Models to FPGA Acceleration
    – Authors: H Sharma, J Park, E Amaro, B Thwaites, P Kotha (2016)
  7. Handwritten Digit Classification on FPGA
    – Authors: K Kudrolli, S Shah, Dj Park (2016)
  8. Fpga Based Implementation of Deep Neural Networks Using On-chip Memory Only
    – Authors: J Park, W Sung (2016)
  9. FPGA Implementation of Autoencoders Having Shared Synapse Architecture
    – Authors: A Suzuki, T Morie, H Tamukoh (2016)
  10. Programming and Runtime Support to Blaze FPGA Accelerator Deployment at Datacenter Scale
    – Authors: M Huang, D Wu, Ch Yu, Z Fang, M Interlandi, T Condie… (2016)
  11. A Deep Learning Prediction Process Accelerator Based FPGA
    – Authors: Q Yu, C Wang, X Ma, X Li, X Zhou (2015)
  12. FPGA implementation of a Deep Belief Network architecture for character recognition using stochastic computation
    – Authors: K Sanni, G Garreau, Jl Molin, Ag Andreou (2015)
  13. An FPGA-Based Multiple-Weight-and-Neuron-Fault Tolerant Digital Multilayer Perceptron (Full Version)
    – Authors: T Horita, I Takanami, M Akiba, M Terauchi, T Kanno (2015)
  14. Efficient Generation of Energy and Performance Pareto Front for FPGA Designs
    – Authors: Sr Kuppannagari, Vk Prasanna (2015)
  15. Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
    – Authors: C Zhang, P Li, G Sun, Y Guan, B Xiao, J Cong (2015)
  16. Musical notes classification with Neuromorphic Auditory System using FPGA and a Convolutional Spiking Network
    – Authors: E Cerezuela (2015)
  17. FPGA Acceleration of Recurrent Neural Network based Language Model
    – Authors: S Li, C Wu, Hh Li, B Li, Y Wang, Q Qiu (2015)
  18. FPGA emulation of a spike-based, stochastic system for real-time image dewarping
    – Authors: Jl Molin, T Figliolia, K Sanni, I Doxas, A Andreou… (2015)
Continue Reading

Zero-Shot (Deep) Learning

Zero-Shot Learning is making decisions after seing only one or few examples (as opposed to other types of learning that typically requires large amount of training examples). Recommend having a look at An embarrassingly simple approach to zero-shot learning first.

Best regards,

Amund Tveit

  1. Less is more: zero-shot learning from online textual documents with noise suppression
    – Authors: R Qiao, L Liu, C Shen, A Hengel (2016)
  2. Synthesized Classifiers for Zero-Shot Learning
    – Authors: S Changpinyo, Wl Chao, B Gong, F Sha (2016)
  3. Tinkering Under The Hood: Interactive Zero-Shot Learning with Pictorial Classifiers
    – Authors: V Krishnan (2016)
  4. Active Transfer Learning with Zero-Shot Priors: Reusing Past Datasets for Future Tasks
    – Authors: E Gavves, T Mensink, T Tommasi, Cgm Snoek… (2015)
  5. Transductive Multi-view Zero-Shot Learning
    – Authors: Y Fu, Tm Hospedales, T Xiang, S Gong (2015)
  6. Predicting Deep Zero-Shot Convolutional Neural Networks using Textual Descriptions
    – Authors: J Ba, K Swersky, S Fidler, R Salakhutdinov (2015)
  7. Zero-Shot Learning with Structured Embeddings
    – Authors: Z Akata, H Lee, B Schiele (2014)
Continue Reading

Embedding for NLP with Deep Learning

Word Embedding was introduced by Bengio in early 2000s, and interest in it really accelerated when Google presented Word2Vec in 2013.

This blog post has recent papers related to embedding for Natural Language Processing with Deep Learning. Example application areas embedding is used for in the papers include finance (stock market prediction), biomedical text analysis, part-of-speech tagging, sentiment analysis, pharmacology (drug adverse effects).

I recommend you to start with the paper: In Defense of Word Embedding for Generic Text Representation

Best regards,

Amund Tveit

  1. An approach to the use of word embeddings in an opinion classification task
    – Authors: F Enríquez, Ja Troyano, T López (2016)
  2. Learning Document Embeddings by Predicting N-grams for Sentiment Classification of Long Movie Reviews
    – Authors: B Li, T Liu, X Du, D Zhang, Z Zhao (2016)
  3. A Distributed Chinese Naive Bayes Classifier Based on Word Embedding
    – Authors: M Feng, G Wu (2016)
  4. An Empirical Study on Sentiment Classification of Chinese Review using Word Embedding
    – Authors: Y Lin, H Lei, J Wu, X Li (2015)
  5. Learning Bilingual Embedding Model for Cross-Language Sentiment Classification
    – Authors: X Tang, X Wan (2014)
  6. Training word embeddings for deep learning in biomedical text mining tasks
    – Authors: Z Jiang, L Li, D Huang, L Jin (2016)
  7. Learning Dense Convolutional Embeddings For Semantic Segmentation
    – Authors: Aw Harley, Kg Derpanis, I Kokkinos (2016)
  8. Creating Causal Embeddings for Question Answering with Minimal Supervision
    – Authors: R Sharp, M Surdeanu, P Jansen, P Clark, M Hammond (2016)
  9. Discriminative Phrase Embedding for Paraphrase Identification
    – Authors: W Yin, H Schütze (2016)
  10. Word embedding based retrieval model for similar cases recommendation
    – Authors: Y Zhao, J Wang, F Wang (2016)
  11. Learning Embeddings of API Tokens to Facilitate Deep Learning Based Program Processing
    – Authors: Y Lu, G Li, R Miao, Z Jin (2016)
  12. Locally Embedding Autoencoders: A Semi-Supervised Manifold Learning Approach of Document Representation
    – Authors: C Wei, S Luo, X Ma, H Ren, J Zhang, L Pan (2016)
  13. Deep Learning Architecture for Part-of-Speech Tagging with Word and Suffix Embeddings
    – Authors: A Popov (2016)
  14. Robobarista: Learning to Manipulate Novel Objects via Deep Multimodal Embedding
    – Authors: J Sung, Sh Jin, I Lenz, A Saxena (2016)
  15. Pruning subsequence search with attention-based embedding
    – Authors: C Raffel, Dpw Ellis (2016)
  16. Sentence Embedding Evaluation Using Pyramid Annotation
    – Authors: T Baumel, R Cohen, M Elhadad (2016)
  17. Deep Sentence Embedding Using the Long Short Term Memory Network: Analysis and Application to Information Retrieval
    – Authors: H Palangi, L Deng, Y Shen, J Gao, X He, J Chen… (2015)
  18. Feedback recurrent neural network-based embedded vector and its application in topic model
    – Authors: L Li, S Gan, X Yin (2016)
  19. Enhancing Sentence Relation Modeling with Auxiliary Character-level Embedding
    – Authors: P Li, H Huang (2016)
  20. Learning Word Meta-Embeddings by Using Ensembles of Embedding Sets
    – Authors: W Yin, H Schütze (2015)
  21. Syntax-Aware Multi-Sense Word Embeddings for Deep Compositional Models of Meaning
    – Authors: J Cheng, D Kartsaklis (2015)
  22. A Deep Embedding Model for Co-occurrence Learning
    – Authors: Y Shen, R Jin, J Chen, X He, J Gao, L Deng (2015)
  23. Jointly Modeling Embedding and Translation to Bridge Video and Language
    – Authors: Y Pan, T Mei, T Yao, H Li, Y Rui (2015)
  24. Learning semantic word embeddings based on ordinal knowledge constraints
    – Authors: Q Liu, H Jiang, S Wei, Zh Ling, Y Hu (2015)
  25. Boosting Named Entity Recognition with Neural Character Embeddings
    – Authors: C Dos Santos, V Guimaraes, Rj Niterói, R De Janeiro (2015)
  26. Evaluating word embeddings and a revised corpus for part-of-speech tagging in Portuguese
    – Authors: Er Fonseca, Jlg Rosa, Sm Aluísio (2015)
  27. Temporal Embedding in Convolutional Neural Networks for Robust Learning of Abstract Snippets
    – Authors: J Liu, K Zhao, B Kusy, J Wen, R Jurdak (2015)
  28. Learning Feature Hierarchies: A Layer-wise Tag-embedded Approach
    – Authors: Z Yuan, C Xu, J Sang, S Yan, M Hossain (2015)
  29. Multi-Source Bayesian Embeddings for Learning Social Knowledge Graphs
    – Authors: Z Yang, J Tang (2015)
  30. PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networks
    – Authors: J Tang, M Qu, Q Mei (2015)
  31. Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features
    – Authors: A Nikfarjam, A Sarker, K O’Connor, R Ginn, G Gonzalez (2015)
  32. Projective Label Propagation by Label Embedding
    – Authors: Z Zhang, W Jiang, F Li, L Zhang, M Zhao, L Jia (2015)
  33. An Investigation of Neural Embeddings for Coreference Resolution
    – Authors: V Godbole, W Liu, R Togneri (2015)
  34. Deep Multimodal Embedding: Manipulating Novel Objects with Point-clouds, Language and Trajectories
    – Authors: J Sung, I Lenz, A Saxena (2015)
  35. AutoExtend: Extending Word Embeddings to Embeddings for Synsets and Lexemes
    – Authors: S Rothe, H Schütze (2015)
  36. Deep Multilingual Correlation for Improved Word Embeddings
    – Authors: A Lu, W Wang, M Bansal, K Gimpel, K Livescu (2015)
  37. Leverage Financial News to Predict Stock Price Movements Using Word Embeddings and Deep Neural Networks
    – Authors: Y Peng, H Jiang (2015)
  38. The Impact of Structured Event Embeddings on Scalable Stock Forecasting Models
    – Authors: Jb Nascimento, M Cristo (2015)
  39. Representing Text for Joint Embedding of Text and Knowledge Bases
    – Authors: K Toutanova, D Chen, P Pantel, H Poon, P Choudhury… (2015)
  40. In Defense of Word Embedding for Generic Text Representation
    – Authors: G Lev, B Klein, L Wolf (2015)
  41. Learning Multi-Relational Semantics Using Neural-Embedding Models
    – Authors: B Yang, W Yih, X He, J Gao, L Deng (2014)
  42. Improving relation descriptor extraction with word embeddings and cluster features
    – Authors: T Liu, M Li (2014)
Continue Reading

Deep Learning in combination with EEG electrical signals from the brain

eeg

EEG (Electroencephalography) is the measurement of electrical signals in the brain. It has long been used for medical purposes (e.g. diagnosis of epilepsy), and has in more recent years also been used in Brain Computer Interfaces (BCI) – note: if BCI is new to you don’t get overly excited about it, since these interfaces are still in my opinion quite premature. But they are definitely interesting in a longer term perspective .

This blog post gives an overview of recent research on Deep Learning in combination with EEG, e.g. r for classification, feature representation, diagnosis, safety (cognitive state of drivers) and hybrid methods (Computer Vision or Speech Recognition together with EEG and Deep Learning).

Best regards,

Amund Tveit

Diagnosis and Medicine

  1. Classification of Epileptic EEG Signals with Stacked Sparse Autoencoder Based on Deep Learning
    – Authors: Q Lin, S Ye, X Huang, S Li, M Zhang, Y Xue, Ws Chen (2016)
  2. Advanced use of EEG in drug development and personalized medicine
    – Authors: S Simpraga, R Alvarez (2016)
  3. Low-complexity algorithms for automatic detection of sleep stages and events for use in wearable EEG systems
    – Authors: Sa Imtiaz (2016)
  4. Predicting epileptic seizure from Electroencephalography (EEG) using hilbert huang transformation and neural network
    – Authors: Mo Rahman, Mn Karim (2015)
  5. Multi-Channel EEG based Sleep Stage Classification with Joint Collaborative Representation and Multiple Kernel Learning
    – Authors: J Shi, X Liu, Y Li, Q Zhang, Y Li, S Yin (2015)
  6. Superchords: decoding EEG signals in the millisecond range
    – Authors: R Normand, Ha Ferreira (2015)
  7. A novel motor imagery EEG recognition method based on deep learning
    – Authors: M Li, M Zhang, Y Sun (2016)

Brain Computer Interfaces

  1. Convolutional Networks for EEG Signal Classification in Non-Invasive Brain-Computer Interfaces
    – Authors: E Forney, C Anderson, W Gavin, P Davies (2016)
  2. Using Deep Learning for Human Computer Interface via Electroencephalography
    – Authors: S Redkar (2016)
  3. Deep learning EEG response representation for brain computer interface
    – Authors: L Jingwei, C Yin, Z Weidong (2015)

Cognition and Emotion

  1. Single-channel EEG-based mental fatigue detection based on deep belief network
    – Authors: P Li, W Jiang, F Su (2016)
  2. EEG-based prediction of driver’s cognitive performance by deep convolutional neural network
    – Authors: M Hajinoroozi, Z Mao, Tp Jung, Ct Lin, Y Huang (2016)
  3. EEG-based Driver Fatigue Detection using Hybrid Deep Generic Model
    – Authors: Pp San, Sh Ling, R Chai, Y Tran, A Craig, Ht Nguyen (2016)
  4. Mental State Recognition via Wearable EEG
    – Authors: P Bashivan, I Rish, S Heisig (2016)
  5. Single trial prediction of normal and excessive cognitive load through EEG feature fusion
    – Authors: P Bashivan, M Yeasin, Gm Bidelman (2016)
  6. Prediction of driver’s drowsy and alert states from EEG signals with deep learning
    – Authors: M Hajinoroozi, Z Mao, Y Huang (2016)
  7. Investigating Critical Frequency Bands and Channels for EEG-based Emotion Recognition with Deep Neural Networks
    – Authors: Wl Zheng, Bl Lu (2015)
  8. Deep learninig of EEG signals for emotion recognition
    – Authors: Y Gao, Hj Lee, Rm Mehmood (2015)
  9. EEG Based Emotion Identification Using Unsupervised Deep Feature Learning
    – Authors: X Li, P Zhang, D Song, G Yu, Y Hou, B Hu (2015)
  10. Feature extraction with deep belief networks for driver’s cognitive states prediction from EEG data
    – Authors: M Hajinoroozi, Tp Jung, Ct Lin, Y Huang (2015)
  11. Measurement Of Stress Intensity Using Eeg
    – Authors: V Tóth (2015)
  12. Revealing critical channels and frequency bands for emotion recognition from EEG with deep belief network
    – Authors: Wl Zheng, Ht Guo, Bl Lu (2015)
  13. Interpretable Deep Neural Networks for Single-Trial EEG Classification
    – Authors: I Sturm, S Bach, W Samek, Kr Müller (2016)

Hybrid methods – combining Deep Learning and EEG with other Deep Learning methods

  1. Improving Electroencephalography-Based Imagined Speech Recognition with a Simultaneous Video Data Stream
    – Authors: Sj Stolze (2016)
  2. A closed-loop system for rapid face retrieval by combining EEG and computer vision
    – Authors: Y Wang, L Jiang, B Cai, Y Wang, S Zhang, X Zheng (2015)
  3. Emotional Affect Estimation Using Video and EEG Data in Deep Neural Networks
    – Authors: A Frydenlund, F Rudzicz (2015)

Feature representation and Classification

  1. Improving EEG feature learning via synchronized facial video
    – Authors: X Li, X Jia, G Xun, A Zhang (2016)
  2. Decoding EEG and LFP signals using deep learning: heading TrueNorth
    – Authors: E Nurse, Bs Mashford, Aj Yepes, I Kiral (2016)
  3. Fast and efficient rejection of background waveforms in interictal EEG
    – Authors: E Bagheri, J Jin, J Dauwels, S Cash, Mb Westover (2016)
  4. Class-wise Deep Dictionaries for EEG Classification
    – Authors: P Khurana, A Majumdar, R Ward (2016)
  5. EEG-based affect states classification using Deep Belief Networks
    – Authors: H Xu, Kn Plataniotis (2016)
  6. Feature Learning from Incomplete EEG with Denoising Autoencoder
    – Authors: J Li, Z Struzik, L Zhang, A Cichocki (2014)
  7. Joint optimization of algorithmic suites for EEG analysis
    – Authors: E Santana, Aj Brockmeier, Jc Principe (2014)
  8. Deep Extreme Learning Machine and Its Application in EEG Classification
    – Authors: S Ding, N Zhang, X Xu, L Guo, J Zhang (2014)
  9. Deep Feature Learning for EEG Recordings
    – Authors: S Stober, A Sternin, Am Owen, Ja Grahn (2015)
  10. A Multichannel Deep Belief Network for the Classification of EEG Data
    – Authors: Am Al (2015)
  11. Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks
    – Authors: P Bashivan, I Rish, M Yeasin, N Codella (2015)
Continue Reading

Deep Learning with Generative and Generative Adverserial Networks – ICLR 2017 Discoveries

The 5th International Conference on Learning Representation (ICLR 2017) is coming to Toulon, France (April 24-26 2017).

This blog post gives an overview of Deep Learning with Generative and Adverserial Networks related papers submitted to ICLR 2017, see underneath for the list of papers. Want to learn about these topics? See OpenAI’s article about Generative Models and Ian Goodfellow et.al’s paper about Generative Adversarial Networks.

Best regards,

Amund Tveit

ICLR 2017 – Generative and Generative Adversarial Papers

  1. Unsupervised Learning Using Generative Adversarial Training And Clustering – Authors: Vittal Premachandran, Alan L. Yuille
  2. Improving Generative Adversarial Networks with Denoising Feature Matching – Authors: David Warde-Farley, Yoshua Bengio
  3. Generative Adversarial Parallelization – Authors: Daniel Jiwoong Im, He Ma, Chris Dongjoo Kim, Graham Taylor
  4. b-GAN: Unified Framework of Generative Adversarial Networks – Authors: Masatosi Uehara, Issei Sato, Masahiro Suzuki, Kotaro Nakayama, Yutaka Matsuo
  5. Generative Adversarial Networks as Variational Training of Energy Based Models – Authors: Shuangfei Zhai, Yu Cheng, Rogerio Feris, Zhongfei Zhang
  6. Boosted Generative Models – Authors: Aditya Grover, Stefano Ermon
  7. Adversarial examples for generative models – Authors: Jernej Kos, Dawn Song
  8. Mode Regularized Generative Adversarial Networks – Authors: Tong Che, Yanran Li, Athul Jacob, Yoshua Bengio, Wenjie Li
  9. Variational Recurrent Adversarial Deep Domain Adaptation – Authors: Sanjay Purushotham, Wilka Carvalho, Tanachat Nilanon, Yan Liu
  10. Structured Interpretation of Deep Generative Models – Authors: N. Siddharth, Brooks Paige, Alban Desmaison, Jan-Willem van de Meent, Frank Wood, Noah D. Goodman, Pushmeet Kohli, Philip H.S. Torr
  11. Inference and Introspection in Deep Generative Models of Sparse Data – Authors: Rahul G. Krishnan, Matthew Hoffman
  12. Generative Models and Model Criticism via Optimized Maximum Mean Discrepancy – Authors: Dougal J. Sutherland, Hsiao-Yu Tung, Heiko Strathmann, Soumyajit De, Aaditya Ramdas, Alex Smola, Arthur Gretton
  13. Unsupervised sentence representation learning with adversarial auto-encoder – Authors: Shuai Tang, Hailin Jin, Chen Fang, Zhaowen Wang
  14. Unsupervised Program Induction with Hierarchical Generative Convolutional Neural Networks – Authors: Qucheng Gong, Yuandong Tian, C. Lawrence Zitnick
  15. A Theoretical Framework for Robustness of (Deep) Classifiers against Adversarial Noise – Authors: Beilun Wang, Ji Gao, Yanjun Qi
  16. On the Quantitative Analysis of Decoder-Based Generative Models – Authors: Yuhuai Wu, Yuri Burda, Ruslan Salakhutdinov, Roger Grosse
  17. Evaluation of Defensive Methods for DNNs against Multiple Adversarial Evasion Models – Authors: Xinyun Chen, Bo Li, Yevgeniy Vorobeychik
  18. Calibrating Energy-based Generative Adversarial Networks – Authors: Zihang Dai, Amjad Almahairi, Philip Bachman, Eduard Hovy, Aaron Courville
  19. Inverse Problems in Computer Vision using Adversarial Imagination Priors – Authors: Hsiao-Yu Fish Tung, Katerina Fragkiadaki
  20. Towards Principled Methods for Training Generative Adversarial Networks – Authors: Martin Arjovsky, Leon Bottou
  21. Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial Learning – Authors: Dilin Wang, Qiang Liu
  22. Multi-view Generative Adversarial Networks – Authors: Mickaël Chen, Ludovic Denoyer
  23. LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation – Authors: Jianwei Yang, Anitha Kannan, Dhruv Batra, Devi Parikh
  24. Semi-Supervised Learning with Context-Conditional Generative Adversarial Networks – Authors: Emily Denton, Sam Gross, Rob Fergus
  25. Generative Adversarial Networks for Image Steganography – Authors: Denis Volkhonskiy, Boris Borisenko, Evgeny Burnaev
  26. Unrolled Generative Adversarial Networks – Authors: Luke Metz, Ben Poole, David Pfau, Jascha Sohl-Dickstein
  27. Generative Multi-Adversarial Networks – Authors: Ishan Durugkar, Ian Gemp, Sridhar Mahadevan
  28. Joint Multimodal Learning with Deep Generative Models – Authors: Masahiro Suzuki, Kotaro Nakayama, Yutaka Matsuo
  29. Fast Adaptation in Generative Models with Generative Matching Networks – Authors: Sergey Bartunov, Dmitry P. Vetrov
  30. Adversarially Learned Inference – Authors: Vincent Dumoulin, Ishmael Belghazi, Ben Poole, Alex Lamb, Martin Arjovsky, Olivier Mastropietro, Aaron Courville
  31. Perception Updating Networks: On architectural constraints for interpretable video generative models – Authors: Eder Santana, Jose C Principe
  32. Energy-based Generative Adversarial Networks – Authors: Junbo Zhao, Michael Mathieu, Yann LeCun
  33. Simple Black-Box Adversarial Perturbations for Deep Networks – Authors: Nina Narodytska, Shiva Kasiviswanathan
  34. Learning in Implicit Generative Models – Authors: Shakir Mohamed, Balaji Lakshminarayanan
  35. On Detecting Adversarial Perturbations – Authors: Jan Hendrik Metzen, Tim Genewein, Volker Fischer, Bastian Bischoff
  36. Delving into Transferable Adversarial Examples and Black-box Attacks – Authors: Yanpei Liu, Xinyun Chen, Chang Liu, Dawn Song
  37. Adversarial Feature Learning – Authors: Jeff Donahue, Philipp Krähenbühl, Trevor Darrell
  38. Generative Paragraph Vector – Authors: Ruqing Zhang, Jiafeng Guo, Yanyan Lan, Jun Xu, Xueqi Cheng
  39. Adversarial Machine Learning at Scale – Authors: Alexey Kurakin, Ian J. Goodfellow, Samy Bengio
  40. Adversarial Training Methods for Semi-Supervised Text Classification – Authors: Takeru Miyato, Andrew M. Dai, Ian Goodfellow
  41. Sampling Generative Networks: Notes on a Few Effective Techniques – Authors: Tom White
  42. Adversarial examples in the physical world – Authors: Alexey Kurakin, Ian J. Goodfellow, Samy Bengio
  43. Improving Sampling from Generative Autoencoders with Markov Chains – Authors: Kai Arulkumaran, Antonia Creswell, Anil Anthony Bharath
  44. Neural Photo Editing with Introspective Adversarial Networks – Authors: Andrew Brock, Theodore Lim, J.M. Ritchie, Nick Weston
  45. Learning to Protect Communications with Adversarial Neural Cryptography – Authors: Martín Abadi, David G. Andersen

Sign up for Deep Learning newsletter!


Continue Reading

Deep Learning for Natural Language Processing – ICLR 2017 Discoveries

The 5th International Conference on Learning Representation (ICLR 2017) is coming to Toulon, France (April 24-26 2017), and there is large amount of Deep Learning papers submitted to the conference, looks like it will be a great event (see word cloud below for most frequent words used in submitted paper titles).

iclr2017wordcloud

This blog post gives an overview of Natural Language Processing related papers submitted to ICLR 2017, see underneath for the list of papers. If you want to learn about Deep Learning with NLP check out Stanford’s CS224d: Deep Learning for Natural Language Processing

Best regards,

Amund Tveit

ICLR 2017 – NLP PAPERs

Character/Word/Sentence Representation

  1. Character-aware Attention Residual Network for Sentence Representation – Authors: Xin Zheng, Zhenzhou Wu
  2. Program Synthesis for Character Level Language Modeling – Authors: Pavol Bielik, Veselin Raychev, Martin Vechev
  3. Words or Characters? Fine-grained Gating for Reading Comprehension – Authors: Zhilin Yang, Bhuwan Dhingra, Ye Yuan, Junjie Hu, William W. Cohen, Ruslan Salakhutdinov
  4. Deep Character-Level Neural Machine Translation By Learning Morphology – Authors: Shenjian Zhao, Zhihua Zhang
  5. Opening the vocabulary of neural language models with character-level word representations – Authors: Matthieu Labeau, Alexandre Allauzen
  6. Unsupervised sentence representation learning with adversarial auto-encoder – Authors: Shuai Tang, Hailin Jin, Chen Fang, Zhaowen Wang
  7. Offline Bilingual Word Vectors Without a Dictionary – Authors: Samuel L. Smith, David H. P. Turban, Nils Y. Hammerla, Steven Hamblin
  8. Learning Word-Like Units from Joint Audio-Visual Analylsis – Authors: David Harwath, James R. Glass
  9. Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling – Authors: Hakan Inan, Khashayar Khosravi, Richard Socher
  10. Sentence Ordering using Recurrent Neural Networks – Authors: Lajanugen Logeswaran, Honglak Lee, Dragomir Radev

Search/Question-Answer/Recommender Systems

  1. Learning to Query, Reason, and Answer Questions On Ambiguous Texts – Authors: Xiaoxiao Guo, Tim Klinger, Clemens Rosenbaum, Joseph P. Bigus, Murray Campbell, Ban Kawas, Kartik Talamadupula, Gerry Tesauro, Satinder Singh
  2. Group Sparse CNNs for Question Sentence Classification with Answer Sets – Authors: Mingbo Ma, Liang Huang, Bing Xiang, Bowen Zhou
  3. CONTENT2VEC: Specializing Joint Representations of Product Images and Text for the task of Product Recommendation – Authors: Thomas Nedelec, Elena Smirnova, Flavian Vasile
  4. Is a picture worth a thousand words? A Deep Multi-Modal Fusion Architecture for Product Classification in e-commerce – Authors: Tom Zahavy, Alessandro Magnani, Abhinandan Krishnan, Shie Mannor

Word/Sentence Embedding

  1. A Simple but Tough-to-Beat Baseline for Sentence Embeddings – Authors: Sanjeev Arora, Yingyu Liang, Tengyu Ma
  2. Investigating Different Context Types and Representations for Learning Word Embeddings – Authors: Bofang Li, Tao Liu, Zhe Zhao, Xiaoyong Du
  3. Multi-view Recurrent Neural Acoustic Word Embeddings – Authors: Wanjia He, Weiran Wang, Karen Livescu
  4. A Self-Attentive Sentence Embedding – Authors: Zhouhan Lin, Minwei Feng, Cicero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, Yoshua Bengio
  5. Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks – Authors: Yossi Adi, Einat Kermany, Yonatan Belinkov, Ofer Lavi, Yoav Goldberg

Multilingual/Translation/Sentiment

  1. Neural Machine Translation with Latent Semantic of Image and Text – Authors: Joji Toyama, Masanori Misono, Masahiro Suzuki, Kotaro Nakayama, Yutaka Matsuo
  2. Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context – Authors: Shyam Upadhyay, Kai-Wei Chang, James Zhou, Matt Taddy, Adam Kalai
  3. Learning to Understand: Incorporating Local Contexts with Global Attention for Sentiment Classification – Authors: Zhigang Yuan, Yuting Hu, Yongfeng Huang
  4. Adaptive Feature Abstraction for Translating Video to Language – Authors: Yunchen Pu, Martin Renqiang Min, Zhe Gan, Lawrence Carin
  5. A Convolutional Encoder Model for Neural Machine Translation – Authors: Jonas Gehring, Michael Auli, David Grangier, Yann N. Dauphin
  6. Fuzzy paraphrases in learning word representations with a corpus and a lexicon – Authors: Yuanzhi Ke, Masafumi Hagiwara
  7. Iterative Refinement for Machine Translation – Authors: Roman Novak, Michael Auli, David Grangier
  8. Vocabulary Selection Strategies for Neural Machine Translation – Authors: Gurvan L’Hostis, David Grangier, Michael Auli

Language Models/Text Comprehension/Matching/Compression/Classification/++

  1. A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks – Authors: Kazuma Hashimoto, Caiming Xiong, Yoshimasa Tsuruoka, Richard Socher
  2. Gated-Attention Readers for Text Comprehension – Authors: Bhuwan Dhingra, Hanxiao Liu, Zhilin Yang, William W. Cohen, Ruslan Salakhutdinov
  3. A Compare-Aggregate Model for Matching Text Sequences – Authors: Shuohang Wang, Jing Jiang
  4. A Context-aware Attention Network for Interactive Question Answering – Authors: Huayu Li, Martin Renqiang Min, Yong Ge, Asim Kadav
  5. FastText.zip: Compressing text classification models – Authors: Armand Joulin, Edouard Grave, Piotr Bojanowski, Matthijs Douze, Herve Jegou, Tomas Mikolov
  6. Multi-Agent Cooperation and the Emergence of (Natural) Language – Authors: Angeliki Lazaridou, Alexander Peysakhovich, Marco Baroni
  7. Learning a Natural Language Interface with Neural Programmer – Authors: Arvind Neelakantan, Quoc V. Le, Martin Abadi, Andrew McCallum, Dario Amodei
  8. Learning similarity preserving representations with neural similarity and context encoders – Authors: Franziska Horn, Klaus-Robert Müller
  9. Adversarial Training Methods for Semi-Supervised Text Classification – Authors: Takeru Miyato, Andrew M. Dai, Ian Goodfellow
  10. Multi-Label Learning using Tensor Decomposition for Large Text Corpora – Authors: Sayantan Dasgupta

 

Sign up for Deep Learning newsletter!


Continue Reading