awesome-deeplearning-resources

2015

Deep Learning

[ADAM] A Method for Stochastic Optimization. arxiv :star:
A Diversity-Promoting Objective Function for Neural Conversation Models.acl]
A Neural Conversational Model. arxiv
A Neural Network Approach to Context-Sensitive Generation of Conversational Responses. acl
A Roadmap towards Machine Intelligence. arxiv
A Survey- Time Travel in Deep Learning Space- An Introduction to Deep Learning Models and How Deep Learning Models Evolved from the Initial Ideas.arxiv
An Empirical Exploration of Recurrent Network Architectures.pdf :star:
[Inception V2] Batch Normalization- Accelerating Deep Network Training by Reducing Internal Covariate Shift. arxiv :star:
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models. arxiv
Correlational Neural Networks. arxiv code
Deconstructing the Ladder Network Architecture. arxiv
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding. arxiv
Deep Knowledge Tracing. pdf
Deep learning. nature :star:
Distilling the Knowledge in a Neural Network. pdf :star:
Dropout as a Bayesian Approximation- Representing Model Uncertainty in Deep Learning. arxiv
Effective LSTMs for Target-Dependent Sentiment Classification. arxiv
[ELUs] Fast and Accurate Deep Network Learning by Exponential Linear Units. arxiv :star:
Human-level concept learning through probabilistic program induction science :star:
Learning Simple Algorithms from Examples. pdf
Learning to Transduce with Unbounded Memory. arxiv
Listen, Attend and Spell. arxiv pytorch :star:
LSTM A Search Space Odyssey. arxiv :star:
LSTM-based Deep Learning Models for non-factoid answer selection. arxiv
Neural GPUs Learn Algorithms. arxiv tensorflow :star:
Neural Programmer- Inducing Latent Programs with Gradient Descent. pdf
Pointer Networks. arxiv tensorflow :star:
Poker-CNN- A Pattern Learning Strategy for Making Draws and Bets in Poker Games.pdf
Policy distillation. arxiv :star:
Regularizing RNNs by Stabilizing Activations. arxiv
ReNet- A Recurrent Neural Network Based Alternative to Convolutional Networks. arxiv
Semi-Supervised Learning with Ladder Networks. arxiv :star:
Session-based Recommendations with Recurrent Neural Networks. arxiv
Skip-Thought Vectors. arxiv :star:
Training Very Deep Networks. arxiv :star:
Tree-structured composition in neural networks without tree-structured architectures. pdf

Computer vision

A Neural Algorithm of Artistic Style. arxiv code :star:
Autoencoding beyond pixels using a learned similarity metric. arxiv tensorflow
Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images. arxiv pytorch
[ResNet] Deep Residual Learning for Image Recognition. arxiv tensorflow :star:
[ResNet] Delving Deep into Rectifiers- Surpassing Human-Level Performance on ImageNet Classification. arxiv :star:
[FaceNet] A Unified Embedding for Face Recognition and Clustering. arxiv tensorflow :star:
[Faster R-CNN] Towards Real-Time Object Detection with Region Proposal Networks. arxiv code :star:
[Fast R-CNN] Fast R-CNN arxiv code :star:
Hierarchical Recurrent Neural Network for Skeleton Based Action Recognition. pdf :star:
Inceptionism: Going Deeper into Neural Networks. google :star:
Inside-Outside Net- Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks. url
Multi-view 3D Models from Single Images with a Convolutional Network.arxiv tensorflow
ReSeg- A Recurrent Neural Network for Object Segmentation. arxiv :star:
[Inception V3] Rethinking the Inception Architecture for Computer Vision. arxiv tensorflow :star:
Unsupervised Learning of Video Representations using LSTMs. arxiv tensorflow :star:
[FCNT] Visual Tracking with fully Convolutional Networks. cuhk code :star:
You Only Look Once: Unified, Real-Time Object Detection. arxiv

Generative learning

Adversarial Autoencoders. arxiv
A note on the evaluation of generative models. arxiv :star:
Autoencoding beyond pixels using a learned similarity metric. arxiv :star:
Censoring Representations with an Adversary. arxiv
Conditional generative adversarial nets for convolutional face generation. pdf
[LAPGAN] Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks arxiv code :star:
Distributional Smoothing with Virtual Adversarial Training. arxiv :star:
Exploring the Space of Adversarial Images. arxiv code :star:
Generative Adversarial Networks in Estimation of Distribution Algorithms for Combinatorial Optimization. arxiv code
Generative Image Modeling Using Spatial LSTMs. arxiv
Generative Moment Matching Networks. arxiv :star:
Improving Semi-Supervised Learning with Auxiliary Deep Generative Models. pdf
[CVAE] Learning Structured Output Representation using Deep Conditional Generative Models. nips :star:
Max-margin Deep Generative Models. arxiv code
Semi-Supervised Learning with Ladder Networks. arxiv :star:
[CatGAN] Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks. arxiv :star:
[DCGAN] Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. arxiv tensorflow :star:

Attention and memory

[ABCNN] Attention-Based Convolutional Neural Network for Modeling Sentence Pairs. arxiv :star:
Action Recognition using Visual Attention. arxiv code
Ask Me Anything- Dynamic Memory Networks for Natural Language Processing. arxiv :star:
Attention-Based Models for Speech Recognition. arxiv
Attention with Intention for a Neural Network Conversation Model. arxiv]
[VAE with attention] A Recurrent Neural Network For Image Generation.arxiv code :star:
Show, Attend and Tell- Neural Image Caption Generation with Visual Attention. arxiv :star:
Agreement-based Joint Training for Bidirectional Attention-based Neural Machine Translation. arxiv
Ask Me Anything: Dynamic Memory Networks for Natural Language Processing. arxiv :star:
A Neural Attention Model for Sentence Summarization. pdf :star:
[Global And Local Attention] Effective Approaches to Attention-based Neural Machine Translation.arxiv code tensorflow :star:
End-to-End Attention-based Large Vocabulary Speech Recognition. arxiv.
End-To-End Memory Networks. arxiv :star:
Grammar as a Foreign Language. arxiv :star:
Large-scale Simple Question Answering with Memory Networks. arxiv
Learning Deep Neural Network Policies with Continuous Memory States. arxiv
[LAS] Listen, Attend and Spell. arxiv :star:
Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences. arxiv :star:
Memory-based control with recurrent neural networks. arxiv
Not All Contexts Are Created Equal: Better Word Representations with Variable Attention. pdf
Reinforcement Learning Neural Turing Machines. arxiv :star:
[Soft And Hard Attention] Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. arxiv code tensorflow :star:
Teaching Machines to Read and Comprehend. arxiv :star:
Video Description Generation Incorporating Spatio-Temporal Features and a Soft-Attention Mechanism. arxiv

Transfer learning

Heterogeneous defect prediction. pdf
Learning Transferred Weights From Co-Occurrence Data for Heterogeneous Transfer Learning. pdf
Net2Net-Accelerating Learning via Knowledge Transfer. arxiv :star:
Siamese Neural Networks for One-shot Image Recognition. pdf
Spatial Transformer Networks. arxiv tensorflow :star:
Transfer Learning from Deep Features for Remote Sensing and Poverty Mapping. arxiv
Transfer learning using computational intelligence: A survey. pdf
Transfer learning used to analyze the dynamic evolution of the dust aerosol. url
Transferring Rich Feature Hierarchies for Robust Visual Tracking. arxiv :star:

Deep reinforcement learning

ADAAPT: A Deep Architecture for Adaptive Policy Transfer from Multiple Sources. arxiv
Action-Conditional Video Prediction using Deep Networks in Atari Games. arxiv :star:
Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning. arxiv :star:
[DDPG] Continuous control with deep reinforcement learning. arxiv :star:
[NAF] Continuous Deep Q-Learning with Model-based Acceleration. arxiv :star:
Dueling Network Architectures for Deep Reinforcement Learning. arxiv :star:
Deep Reinforcement Learning with an Action Space Defined by Natural Language.arxiv
Deep Reinforcement Learning with Double Q-learning. arxiv :star:
Deep Recurrent Q-Learning for Partially Observable MDPs. arxiv :star:
DeepMPC: Learning Deep Latent Features for Model Predictive Control. pdf
Deterministic Policy Gradient Algorithms. pdf :star:
Dueling Network Architectures for Deep Reinforcement Learning. arxiv
End-to-End Training of Deep Visuomotor Policies. arxiv :star:
Giraffe: Using Deep Reinforcement Learning to Play Chess. arxiv
Generating Text with Deep Reinforcement Learning. arxiv
How to Discount Deep Reinforcement Learning: Towards New Dynamic Strategies. arxiv
Human-level control through deep reinforcement learning. nature :star:
Incentivizing Exploration In Reinforcement Learning With Deep Predictive Models. arxiv :star:
Learning Simple Algorithms from Examples. arxiv
Language Understanding for Text-based Games Using Deep Reinforcement Learning. pdf :star:
Learning Continuous Control Policies by Stochastic Value Gradients.pdf :star:
Multiagent Cooperation and Competition with Deep Reinforcement Learning. arxiv
Maximum Entropy Deep Inverse Reinforcement Learning. arxiv
Massively Parallel Methods for Deep Reinforcement Learning. pdf] :star:
On Learning to Think- Algorithmic Information Theory for Novel Combinations of Reinforcement Learning Controllers and Recurrent Neural World Models. arxiv
Playing Atari with Deep Reinforcement Learning. arxiv
Recurrent Reinforcement Learning: A Hybrid Approach. arxiv
Strategic Dialogue Management via Deep Reinforcement Learning. arxiv
Towards Vision-Based Deep Reinforcement Learning for Robotic Motion Control. arxiv
Trust Region Policy Optimization. pdf :star:
Universal Value Function Approximators. pdf
Variational Information Maximisation for Intrinsically Motivated Reinforcement Learning. arxiv

Natural language process

A Primer on Neural Network Models for Natural Language Processing. [url]
A Unified Tagging Solution- Bidirectional LSTM Recurrent Neural Network with Word Embedding. [url]
Alternative structures for character-level RNNs. [url]
Ask Me Anything- Dynamic Memory Networks for Natural Language Processing. [url] :star:
BlackOut- Speeding up Recurrent Neural Network Language Models With Very Large Vocabularies. arxiv
Character-Aware Neural Language Models. [url] :star:
Character-level Convolutional Networks for Text Classification.[url]
Deep Speech 2- End-to-End Speech Recognition in English and Mandarin. [url] :star:
Deep Unordered Composition Rivals Syntactic Methods for Text Classification. pdf code
Distributed Representations of Sentences and Documents. [url] :star:
Dynamic Capacity Networks. [url]
Exploring Models and Data for Image Question Answering. arxiv tensorflow
From Word Embeddings To Document Distances. pdf code
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks. arxiv pytorch :star:
Improved Transition-Based Parsing by Modeling Characters instead of Words with LSTMs. acl
Larger-Context Language Modeling. [url]
Multi-Perspective Sentence Similarity Modeling with Convolutional Neural Networks. pdf code
Multi-task Sequence to Sequence Learning. [url]
Natural Language Understanding with Distributed Representation. [url]
Neural Machine Translation of Rare Words with Subword Units. arxiv
Neural Responding Machine for Short-Text Conversation. [url]
Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Recurrent Neural Network. [url]
Conditional Random Fields as Recurrent Neural Networks. arxiv :star:
Reading Scene Text in Deep Convolutional Sequences. [url]
Recurrent Convolutional Neural Networks for Text Classification. pdf code :star:
Semi-supervised Sequence Learning. [url]
Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems. arxiv
sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word Embeddings. [url]
Sequence Level Training with Recurrent Neural Networks. [url]
Strategies for Training Large Vocabulary Neural Language Models. [url]
Towards Universal Paraphrastic Sentence Embeddings. [url]
Visualizing and Understanding Neural Models in NLP. [url]

This site is open source. Improve this page.