DOI: 10.1038/nature14539
OpenAccess: Closed
This work is not Open Acccess. We may still have a PDF on file in the green box below.
Share this:
Get up to 30% off our standard price for selected sequencing services covering sample extraction, library preparation, sequencing, and bioinformatic analysis.
Find out more

Deep learning

Yann LeCun,Yoshua Bengio,Geoffrey E. Hinton

Epistemology
Layer (electronics)
Political science
Deep learning allows computational models that are composed of multiple processing layers to learn representations of data with multiple levels of abstraction. These methods have dramatically improved the state-of-the-art in speech recognition, visual object recognition, object detection and many other domains such as drug discovery and genomics. Deep learning discovers intricate structure in large data sets by using the backpropagation algorithm to indicate how a machine should change its internal parameters that are used to compute the representation in each layer from the representation in the previous layer. Deep convolutional nets have brought about breakthroughs in processing images, video, speech and audio, whereas recurrent nets have shone light on sequential data such as text and speech.


Referenced Papers:
DOI: 10.1038/323533a0
·
1988
Cited 17,350 times
Learning representations by back-propagating errors
DOI: 10.1017/cbo9781139042918.020
·
2011
Cited 79 times
Large-Scale FPGA-Based Convolutional Networks
DOI: 10.1016/j.csl.2006.09.003
·
2007
Cited 455 times
Continuous space language models
DOI: 10.1088/1742-6596/368/1/012030
·
2012
Cited 41 times
Online particle detection with Neural Networks based on topological calorimetry information
DOI: 10.1126/science.7761831
·
1995
Cited 772 times
The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
DOI: 10.1109/tasl.2011.2109382
·
2012
Cited 1,276 times
Acoustic Modeling Using Deep Belief Networks
DOI: 10.1109/4.104196
·
1991
Cited 119 times
An analog neural network processor with programmable topology
DOI: 10.1021/ci500747n
·
2015
Cited 643 times
Deep Neural Nets as a Method for Quantitative Structure–Activity Relationships
DOI: 10.1109/tpami.2012.231
·
2013
Cited 2,198 times
Learning Hierarchical Features for Scene Labeling
DOI: 10.1145/1390156.1390294
·
2008
Cited 3,736 times
Extracting and composing robust features with denoising autoencoders
DOI: 10.1162/neco.1997.9.8.1735
·
1997
Cited 39,992 times
Long Short-Term Memory
DOI: 10.1561/9781601982957
·
2009
Cited 2,667 times
Learning Deep Architectures for AI
DOI: 10.1109/tpami.2013.29
·
2013
Cited 50 times
Modeling Natural Images Using Gated MRFs
DOI: 10.1126/science.1254806
·
2015
Cited 857 times
The human splicing code reveals new insights into the genetic determinants of disease
DOI: 10.1016/0031-3203(82)90024-3
·
1982
Cited 528 times
Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position
DOI: 10.1007/s10994-013-5335-x
·
2014
Cited 154 times
From machine learning to machine reasoning
DOI: 10.1093/cercor/1.1.1
·
1991
Cited 5,294 times
Distributed Hierarchical Processing in the Primate Cerebral Cortex
DOI: 10.1126/science.1127647
·
2006
Cited 12,149 times
Reducing the Dimensionality of Data with Neural Networks
DOI: 10.1109/72.279181
·
1994
Cited 4,405 times
Learning long-term dependencies with gradient descent is difficult
DOI: 10.1016/j.neunet.2012.02.023
·
2012
Cited 666 times
Multi-column deep neural network for traffic sign classification
DOI: 10.1109/5.726791
·
1998
Cited 32,786 times
Gradient-based learning applied to document recognition
DOI: 10.1113/jphysiol.1962.sp006837
·
1962
Cited 9,593 times
Receptive fields, binocular interaction and functional architecture in the cat's visual cortex
DOI: 10.1109/29.21701
·
1989
Cited 1,937 times
Phoneme recognition using time-delay neural networks
DOI: 10.1109/tpami.2004.97
·
2004
Cited 483 times
Convolutional face finder: a neural architecture for fast and robust face detection
DOI: 10.1038/nature12346
·
2013
Cited 770 times
Connectomic reconstruction of the inner plexiform layer in the mouse retina
DOI: 10.1162/neco.2006.18.7.1527
·
2006
Cited 10,747 times
A Fast Learning Algorithm for Deep Belief Nets
DOI: 10.1093/bioinformatics/btu277
·
2014
Cited 346 times
Deep learning of the tissue-regulated splicing code
DOI: 10.1109/72.554195
·
1997
Cited 2,090 times
Face recognition: a convolutional neural-network approach
DOI: 10.1038/nature14236
·
2015
Cited 12,450 times
Human-level control through deep reinforcement learning
DOI: 10.1109/tip.2005.852470
·
2005
Cited 202 times
Toward automatic phenotyping of developing embryos from videos
DOI: 10.1109/msp.2012.2205597
·
2012
Cited 6,398 times
Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
DOI: 10.1109/tpami.2013.50
·
2013
Cited 7,719 times
Representation Learning: A Review and New Perspectives
DOI: 10.1371/journal.pcbi.1003963
·
2014
Cited 589 times
Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition
DOI: 10.1162/neco.2009.10-08-881
·
2010
Cited 302 times
Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation
DOI: 10.1002/rob.20276
·
2009
Cited 166 times
Learning long-range vision for autonomous off-road driving
DOI: 10.7551/mitpress/6161.001.0001
·
2004
Cited 367 times
Semantic Cognition
Related Papers: