Deep Learning with Gaussian Process

Gaussian Process is a statistical model where observations are in the continuous domain, to learn more check out a tutorial on gaussian process (by Univ.of Cambridge’s Zoubin G.). Gaussian Process is an infinite-dimensional generalization of multivariate normal distributions.

Researchers from University of Sheffield – Andreas C. Damanianou and Neil D. Lawrence – started using Gaussian Process with Deep Belief Networks (in 2013). This Blog post contains recent papers related to combining Deep Learning with Gaussian Process.

Best regards,
Amund Tveit

Year  Title Author
2016   Inverse Reinforcement Learning via Deep Gaussian Process  M Jin, C Spanos
2016   Annealing Gaussian into ReLU: a New Sampling Strategy for Leaky-ReLU RBM  CL Li, S Ravanbakhsh, B Poczos
2016   Large Scale Gaussian Process for Overlap-based Object Proposal Scoring  SL Pintea, S Karaoglu, JC van Gemert
2016   Gaussian Neuron in Deep Belief Network for Sentiment Prediction  Y Jin, D Du, H Zhang
2016   Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation with Deep Gaussian CRFs  S Chandra, I Kokkinos
2016   The Variational Gaussian Process  D Tran, R Ranganath, DM Blei
2016   Probabilistic Feature Learning Using Gaussian Process Auto-Encoders  S Olofsson
2016   Sequential Inference for Deep Gaussian Process  Y Wang, M Brubaker, B Chaib
2016   Gaussian Copula Variational Autoencoders for Mixed Data  S Suh, S Choi
2016   Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising  K Zhang, W Zuo, Y Chen, D Meng, L Zhang
2016   Image super-resolution using non-local Gaussian process regression  H Wang, X Gao, K Zhang, J Li
2016   Gaussian Conditional Random Field Network for Semantic Segmentation  R Vemulapalli, O Tuzel, MY Liu, R Chellappa
2016   Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteriors  C Louizos, M Welling
2016   Deep Gaussian Processes for Regression using Approximate Expectation Propagation  TD Bui, D Hernández
2015   Learning to Assess Terrain from Human Demonstration Using an Introspective Gaussian Process Classifier  LP Berczi, I Posner, TD Barfoot
2015   Assessing the Degree of Nativeness and Parkinson’s Condition Using Gaussian Processes and Deep Rectifier Neural Networks  T Grósz, R Busa
2015   Gaussian processes methods for nostationary regression  L Muñoz González
2015   Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?  R Giryes, G Sapiro, AM Bronstein
2015   Nonlinear Gaussian Belief Network based fault diagnosis for industrial processes  H Yu, F Khan, V Garaniya
2015   Interactions Between Gaussian Processes and Bayesian Estimation  YL Wang
2015   Gaussian discrete restricted Boltzmann machine: theory and its applications: a thesis presented in partial fulfilment of the requirements for the degree of Master of …  S Manoharan
2015   Prosody Generation Using Frame-based Gaussian Process Regression  T Koriyama, T Kobayashi
2015   Mean-Field Inference in Gaussian Restricted Boltzmann Machine  C Takahashi, M Yasuda
2015   Variational Auto-encoded Deep Gaussian Processes  Z Dai, A Damianou, J González, N Lawrence
2015   Training Deep Gaussian Processes using Stochastic Expectation Propagation and Probabilistic Backpropagation  TD Bui, JM Hernández
2015   Accurate Object Detection and Semantic Segmentation using Gaussian Mixture Model and CNN  S Jain, S Dehriya, YK Jain
2014   Cross Modal Deep Model and Gaussian Process Based Model for MSR-Bing Challenge  J Wang, C Kang, Y He, S Xiang, C Pan
2014   Non-negative Factor Analysis of Gaussian Mixture Model Weight Adaptation for Language and Dialect Recognition  J Glass
2014   Gaussian Process Models with Parallelization and GPU acceleration  Z Dai, A Damianou, J Hensman, N Lawrence
2014   Parametric Speech Synthesis Using Local and Global Sparse Gaussian  T Koriyama, T Nose, T Kobayashi
2014   On the Link Between Gaussian Homotopy Continuation and Convex Envelopes  H Mobahi, JW Fisher III
2014   Improving Deep Neural Networks Using State Projection Vectors Of Subspace Gaussian Mixture Model As Features  M Karthick, S Umesh
2014   A Theoretical Analysis of Optimization by Gaussian Continuation  H Mobahi, JW Fisher III
2014   Factoring Variations in Natural Images with Deep Gaussian Mixture Models  A van den Oord, B Schrauwen
2014   Feature representation with Deep Gaussian processes
Continue Reading

Deep Learning for Clustering

Previously I published an ICLR 2017 discoveries blog post about Unsupervised Deep Learning – a subset of Unsupervised methods is Clustering, and this blog post has recent publications about Deep Learning for Clustering.

Best regards,

Amund Tveit


Year  Title Author
2016   An Intention-Topic Model Based on Verbs Clustering and Short Texts Topic Mining  T Lu, S Hou, Z Chen, L Cui, L Zhang
2016   Speaker Identification And Clustering Using Convolutional Neural Networks  Y Lukic, C Vogt, O Dürr, T Stadelmann
2016   Building energy modeling (BEM) using clustering algorithms and semi-supervised machine learning approaches  H Naganathan, WO Chong, X Chen
2016   Clustering Based Feature Learning on Variable Stars  C Mackenzie, K Pichara, P Protopapas
2016   Deep Belief Networks Oriented Clustering  Q Yang, H Wang, T Li, Y Yang
2016   Clustering Non-Stationary Data Streams with Online Deep Learning  A Hontabat, M Rising
2016   Fast image clustering based on convolutional neural network and binary K-means  S Ke, Y Zhao, B Li, Z Wu, X Liu
2016   Extracting Bottlenecks for Reinforcement Learning Agent by Holonic Concept Clustering and Attentional Functions  B Ghazanfari, N Mozayani
2016   A Hybrid Spectral Clustering and Deep Neural Network Ensemble Algorithm for Intrusion Detection in Sensor Networks  T Ma, F Wang, J Cheng, Y Yu, X Chen
2016   Single-Channel Multi-Speaker Separation using Deep Clustering  Y Isik, JL Roux, Z Chen, S Watanabe, JR Hershey
2016   Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering  B Yang, X Fu, ND Sidiropoulos, M Hong
2016   A Personalized Markov Clustering and Deep Learning Approach for Arabic Text Categorization  V Jindal
2016   Clustering the seoul metropolitan area by travel patterns based on a deep belief network  G Han, K Sohn
2016   An Empirical Investigation of Word Clustering Techniques for Natural Language Understanding  DA Shunmugam, P Archana
2016   Infinite Ensemble for Image Clustering  H Liu, M Shao, S Li, Y Fu
2015   Theoretical Analysis-based Distributed Load Balancing over Dynamic Overlay Clustering  H Lee, B Kwon, S Kim, I Lee, S Lee
2015   Competitive and Penalized Clustering Auto-encoder  Z Wang, Y Cheung
2015   Learning A Task-Specific Deep Architecture For Clustering  Z Wang, S Chang, J Zhou, TS Huang
2015   Pedestrian detection in thermal images using adaptive fuzzy C-means clustering and convolutional neural networks  V John, S Mita, Z Liu, B Qi
2015   Active Learning with Clustering and Unsupervised Feature Learning  S Berardo, E Favero, N Neto
2015   Clustering Noisy Signals with Structured Sparsity Using Time-Frequency Representation  T Hope, A Wagner, O Zuk
2015   Neuron Clustering for Mitigating Catastrophic Forgetting in Supervised and Reinforcement Learning  BF Goodrich
2015   Clustering Data of Mixed Categorical and Numerical Type with Unsupervised Feature Learning  D Lam, M Wei, D Wunsch
2015   Semi-supervised Hierarchical Clustering Ensemble and Its Application  W Xiao, Y Yang, H Wang, T Li, H Xing
2015   FaceNet: A Unified Embedding for Face Recognition and Clustering  F Schroff, D Kalenichenko, J Philbin
2015   Deep Transductive Semi-supervised Maximum Margin Clustering  G Chen
2015   Max-Entropy Feed-Forward Clustering Neural Network  H Xiao, X Zhu
2015   Overview of the ImageCLEF 2015 medical clustering task  MA Amin, MK Mohammed
2015   Joint Image Clustering and Labeling by Matrix Factorization  S Hong, J Choi, J Feyereisl, B Han, LS Davis
2015   Combining deep learning and unsupervised clustering to improve scene recognition performance  A Kappeler, RD Morris, AR Kamat, N Rasiwasia
2015   Experimental Study of Unsupervised Feature Learning for HEp-2 Cell Images Clustering  Y Zhao, Z Gao, L Wang, L Zhou
2015   Soft context clustering for F0 modeling in HMM-based speech synthesis  S Khorram, H Sameti, S King
2015   Semi-automatic ground truth generation using unsupervised clustering and limited manual labeling: Application to handwritten character recognition  S Vajda, Y Rangoni, H Cecotti
2015   Language discrimination and clustering via a neural network approach  A Mariano, G Parisi, S Pascazio
2015   Active Distance-Based Clustering using K-medoids  A Aghaee, M Ghadiri, MS Baghshah
2015   Convolutional Clustering for Unsupervised Learning  A Dundar, J Jin, E Culurciello
2015   Deep Learning with Nonparametric Clustering  G Chen
2015   Multi-view clustering via structured low-rank representation  D Wang, Q Yin, R He, L Wang, T Tan
2014   A Convex Formulation for Spectral Shrunk Clustering  X Chang, F Nie, Z Ma, Y Yang, X Zhou
2014   Ghent University-iMinds at MediaEval 2014 Diverse Images: Adaptive Clustering with Deep Features  B Vandersmissen, A Tomar, F Godin, W De Neve
2014   Features in Concert: Discriminative Feature Selection meets Unsupervised Clustering  M Leordeanu, A Radu, R Sukthankar
2014   Deep Embedding Network for Clustering  P Huang, Y Huang, W Wang, L Wang
2014   SoF: Soft-Cluster Matrix Factorization for Probabilistic Clustering  H Zhao, P Poupart, Y Zhang, M Lysy
Continue Reading