A curated list of resources dedicated to bayesian deep learning

This article comes from GitHub.

A curated list of resources dedicated to bayesian deep learning.

2013:

1. Deep gaussian processes|Andreas C. Damianou,Neil D. Lawrence|2013 — Source: http://www.jmlr.org/proceedings/papers/v31/damianou13a.pdf

2014:

1. Avoiding pathologies in very deep networks|D Duvenaud, O Rippel, R Adams|2014 — Source: http://www.jmlr.org/proceedings/papers/v33/duvenaud14.pdf
2. Nested variational compression in deep Gaussian processes|J Hensman, ND Lawrence|2014  — Source: https://arxiv.org/abs/1412.1370

2015:

1. On Modern Deep Learning and Variational Inference |Yarin Gal, Zoubin Ghahramani|2015 — Source: http://www.approximateinference.org/accepted/GalGhahramani2015.pdf
2. Rapid Prototyping of Probabilistic Models: Emerging Challenges in Variational Inference |Yarin Gal, |2015 — Source: http://www.approximateinference.org/accepted/Gal2015.pdf
3. Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference |Yarin Gal, Zoubin Ghahramani|2015 — Source: http://arxiv.org/abs/1506.02158
4. Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning |Yarin Gal, Zoubin Ghahramani|2015 — Source: http://arxiv.org/abs/1506.02142
5. Dropout as a Bayesian Approximation: Insights and Applications |Yarin Gal, |2015  — Source: https://sites.google.com/site/deeplearning2015/33.pdf?attredirects=0
6. Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference |Yarin Gal, Zoubin Ghahramani|2015 — Source: http://arxiv.org/abs/1506.02158
7. Scalable Variational Gaussian Process Classification|J Hensman, AGG Matthews, Z Ghahramani|2015 — Source: http://www.jmlr.org/proceedings/papers/v38/hensman15.pdf

2016:

1. Relativistic Monte Carlo | Xiaoyu Lu| 2016 — Source: https://arxiv.org/abs/1609.04388
2. Risk versus Uncertainty in Deep Learning: Bayes, Bootstrap and the Dangers of Dropout | Ian Osband| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_4.pdf
3. Semi-supervised deep kernel learning|Neal Jean, Michael Xie, Stefano Ermon|2016 — Source: http://bayesiandeeplearning.org/papers/BDL_5.pdf
4. Categorical Reparameterization with Gumbel-Softmax| Eric Jang, Shixiang Gu,Ben Poole| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_8.pdf
5. Learning to Optimise: Using Bayesian Deep Learning for Transfer Learning in Optimisation| Jonas Langhabel, Jannik Wolff| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_9.pdf
6. One-Shot Learning in Discriminative Neural Networks| Jordan Burgess,James Robert Lloyd,Zoubin Ghahramani| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_10.pdf
7. Distributed Bayesian Learning with Stochastic Natural-gradient Expectation Propagation| Leonard Hasenclever, Stefan Webb| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_11.pdf
8. Knots in random neural networks| Kevin K. Chen| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_2.pdf
9. Discriminative Bayesian neural networks know what they do not know | Christian Leibig, Siegfried Wahl| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_12.pdf
10. Variational Inference in Neural Networks using an Approximate Closed-Form Objective|Wolfgang Roth and Franz Pernkopf|2016 — Source: http://bayesiandeeplearning.org/papers/BDL_13.pdf
11. Combining sequential deep learning and variational Bayes for semi-supervised inference| Jos van der Westhuizen, Dr. Joan Lasenby| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_14.pdf
12. Importance Weighted Autoencoders with Random Neural Network Parameters| Daniel Hernández-Lobato,Thang D. Bui,Yinzhen Li| 2016
13. Stefan Webb| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_15.pdf
14. Variational Graph Auto-Encoders| Thomas N. Kipf,Max Welling| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_16.pdf
15. Dropout-based Automatic Relevance Determination| Dmitry Molchanov, Arseniy Ashuha, Dmitry Vetrov| 2016 — — Source: http://bayesiandeeplearning.org/papers/BDL_18.pdf
16. Scalable GP-LSTMs with Semi-Stochastic Gradients| Maruan Al-Shedivat, Andrew Gordon Wilson, Yunus Saatchi, Zhiting Hu and Eric P. Xing| 2016
17. Source: http://bayesiandeeplearning.org/papers/BDL_19.pdf
18. Approximate Inference for Deep Latent Gaussian Mixture Models|Eric Nalisnick, Lars Hertel and Padhraic Smyth|2016 — Source: http://bayesiandeeplearning.org/papers/BDL_20.pdf
19. Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial Training | Dilin Wang, Yihao Feng and Qiang Liu| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_21.pdf
20. Learning and Policy Search in Stochastic Dynamical Systems with Bayesian Neural Networks| Stefan Depeweg, José Miguel Hernández-Lobato, Finale Doshi-Velez and Steffen Udluft| 2016 — Source: https://arxiv.org/abs/1605.07127
21. Accelerating Deep Gaussian Processes Inference with Arc-Cosine Kernels | Kurt Cutajar, Edwin V. Bonilla, Pietro Michiardi and Maurizio Filippone| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_24.pdf
22. Embedding Words as Distributions with a Bayesian Skip-gram Model | Arthur Bražinskas, Serhii Havrylov and Ivan Titov| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_25.pdf
23. Variational Inference on Deep Exponential Family by using Variational Inferences on Conjugate Models|Mohammad Emtiyaz Khan and Wu Lin|2016 — Source: http://bayesiandeeplearning.org/papers/BDL_26.pdf
24. Neural Variational Inference for Latent Dirichlet Allocation| Akash Srivastava and Charles Sutton| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_27.pdf
25. Hierarchical Bayesian Neural Networks for Personalized Classification | Ajjen Joshi, Soumya Ghosh, Margrit Betke and Hanspeter Pfister| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_28.pdf
26. Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles| Balaji Lakshminarayanan, Alexander Pritzel and Charles Blundell| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_29.pdf
27. Asynchronous Stochastic Gradient MCMC with Elastic Coupling| Jost Tobias Springenberg, Aaron Klein, Stefan Falkner and Frank Hutter| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_30.pdf
28. The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables|Chris J. Maddison, Andriy Mnih and Yee Whye Teh| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_31.pdf
29. Known Unknowns: Uncertainty Quality in Bayesian Neural Networks | Ramon Oliveira, Pedro Tabacof and Eduardo Valle| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_32.pdf
30. Normalizing Flows on Riemannian Manifolds |Mevlana Gemici, Danilo Rezende and Shakir Mohamed|2016 — Source: http://bayesiandeeplearning.org/papers/BDL_33.pdf
31. Posterior Distribution Analysis for Bayesian Inference in Neural Networks| Pavel Myshkov and Simon Julier| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_34.pdf
32. Deep Bayesian Active Learning with Image Data| Yarin Gal, Riashat Islam and Zoubin Ghahramani| 2016
33. Stefan Webb| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_35.pdf
34. Bottleneck Conditional Density Estimators|Rui Shu, Hung Bui and Mohammad Ghavamzadeh| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_36.pdf
35. A Tighter Monte Carlo Objective with Renyi alpha-Divergence Measures| Stefan Webb and Yee Whye Teh| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_37.pdf
36. Bayesian Neural Networks for Predicting Learning Curves| Aaron Klein, Stefan Falkner, Jost Tobias Springenberg and Frank Hutter| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_38.pdf
37. Nested Compiled Inference for Hierarchical Reinforcement Learning|Tuan Anh Le, Atılım Güneş Baydin and Frank Wood|2016 — Source: http://bayesiandeeplearning.org/papers/BDL_41.pdf
38. Open Problems for Online Bayesian Inference in Neural Networks | Robert Loftin and David Roberts| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_42.pdf
39. Deep Probabilistic Programming| Dustin Tran, Matt Hoffman, Kevin Murphy, Rif Saurous, Eugene Brevdo, and David Blei| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_43.pdf
40. Markov Chain Monte Carlo for Deep Latent Gaussian Models |Matthew Hoffman| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_44.pdf
41. Semi-supervised Active Learning with Deep Probabilistic Generative Models | Amar Shah and Zoubin Ghahramani| 2016 — Source: http://bayesiandeeplearning.org/papers/BDL_43.pdf
42. Thesis: Uncertainty in Deep Learning | Yarin Gal| PhD Thesis, 2016 — Source: http://mlg.eng.cam.ac.uk/yarin/thesis/thesis.pdf, Blog: http://mlg.eng.cam.ac.uk/yarin/blog_2248.html
43. Deep survival analysis|R. Ranganath, A. Perotte, N. Elhadad, and D. Blei|2016 — Source: http://www.cs.columbia.edu/~blei/papers/RanganathPerotteElhadadBlei…
44. Towards Bayesian Deep Learning: A Survey| Hao Wang, Dit-Yan Yeung|2016 — Source: https://arxiv.org/pdf/1604.01662

2017

1. Dropout Inference in Bayesian Neural Networks with Alpha-divergences |Yingzhen Li, Yarin Gal|2017 — Source: https://arxiv.org/abs/1703.02914
2. What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? |Alex Kendall, Yarin Gal|2017 — Source: https://arxiv.org/abs/1703.04977

To read the original article, click here. 

DSC Resources

• Services: Hire a Data Scientist | Search DSC | Classifieds | Find a Job
• Contributors: Post a Blog | Ask a Question
• Follow us: @DataScienceCtrl | @AnalyticBridge

Popular Articles

• Difference between Machine Learning, Data Science, AI, Deep Learnin…
• What is Data Science? 24 Fundamental Articles Answering This Question
• Hitchhiker’s Guide to Data Science, Machine Learning, R, Python
• Advanced Machine Learning with Basic Excel