Top 25 Natural Language Processing (NLP) Papers published 2020
2020 was a great year for NLP
NLP (Natural Language Processing) is a subfield of linguistics, computer science, and artificial intelligence concerned with the interactions between computers and human language, in particular how to program computers to process and analyze large amounts of natural language data. The goal is a computer capable of "understanding" the contents of documents, including the contextual nuances of the language within them. The technology can then accurately extract information and insights contained in the documents as well as categorize and organize the documents themselves.
MAG: 3082274269
Journal of Machine Learning Research ·
2020
Cited 1,928 times
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Automatic summarization
Computer science
Transfer of learning
DOI: 10.1162/tacl_a_00300
Transactions of the Association for Computational Linguistics ·
2020
Cited 683 times
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Computer science
Security token
Training (meteorology)
DOI: 10.1162/tacl_a_00343
Transactions of the Association for Computational Linguistics ·
2020
Cited 404 times
Multilingual Denoising Pre-training for Neural Machine Translation
Artificial intelligence
Training (meteorology)
Natural language processing
DOI: 10.1609/aaai.v34i07.7005
Proceedings of the ... AAAI Conference on Artificial Intelligence ·
2020
Cited 246 times
Unified Vision-Language Pre-Training for Image Captioning and VQA
Closed captioning
Computer science
Transformer
DOI: 10.1609/aaai.v34i05.6311
Proceedings of the ... AAAI Conference on Artificial Intelligence ·
2020
Cited 207 times
Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailment
Adversarial system
Computer science
Grammaticality
DOI: 10.1609/aaai.v34i05.6394
Proceedings of the ... AAAI Conference on Artificial Intelligence ·
2020
Cited 196 times
Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Dataset
Domain (mathematical analysis)
Artificial intelligence
Natural language processing
DOI: 10.1109/tmm.2019.2924576
IEEE Transactions on Multimedia ·
2020
Cited 164 times
STAT: Spatial-Temporal Attention Mechanism for Video Captioning
Artificial intelligence
Task (project management)
Attention network
DOI: 10.1609/aaai.v34i05.6510
Proceedings of the ... AAAI Conference on Artificial Intelligence ·
2020
Cited 153 times
Semantics-Aware BERT for Language Understanding
Computer science
Natural language processing
Semantics (computer science)
DOI: 10.1162/tacl_a_00313
Transactions of the Association for Computational Linguistics ·
2020
Cited 151 times
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks
Computer science
Sequence (biology)
Artificial intelligence
DOI: 10.1162/tacl_a_00317
Transactions of the Association for Computational Linguistics ·
2020
Cited 147 times
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages
Benchmark (surveying)
Computer science
Question answering
DOI: 10.1109/tpami.2020.3007032
IEEE Transactions on Pattern Analysis and Machine Intelligence ·
2020
Cited 136 times
CCNet: Criss-Cross Attention for Semantic Segmentation
Image segmentation
Pattern recognition (psychology)
Pascal (unit)
DOI: 10.3390/info11060314
Information-an International Interdisciplinary Journal ·
2020
Cited 125 times
COVID-19 public sentiment insights and machine learning for tweets classification
Social media
Deep learning
Natural language processing
DOI: 10.1007/s10462-019-09794-5
Artificial Intelligence Review ·
2020
Cited 120 times
Sentiment analysis using deep learning architectures: a review
Natural language processing
Machine learning
Convolutional neural network
DOI: 10.1016/j.jml.2019.104038
Journal of Memory and Language ·
2020
Cited 119 times
How to capitalize on a priori contrasts in linear (mixed) models: A tutorial
Computer science
Artificial intelligence
Cognitive psychology
DOI: 10.1007/s00521-019-04144-6
Neural Computing and Applications ·
2020
Cited 108 times
Assessing gender bias in machine translation: a case study with Google Translate
Computer science
Artificial intelligence
Natural language processing
DOI: 10.1609/aaai.v34i05.6239
Proceedings of the ... AAAI Conference on Artificial Intelligence ·
2020
Cited 108 times
PIQA: Reasoning about Physical Commonsense in Natural Language
Commonsense knowledge
Artificial intelligence
Natural (archaeology)
DOI: 10.1007/s10700-019-09309-5
Fuzzy Optimization and Decision Making ·
2020
Cited 96 times
A survey of decision-making methods with probabilistic linguistic information: bibliometrics, preliminaries, methodologies, applications and future directions
Artificial intelligence
Natural language processing
DOI: 10.1073/pnas.1907375117
Proceedings of the National Academy of Sciences of the United States of America ·
2020
Cited 90 times
Understanding the role of individual units in a deep neural network.
Computer science
Artificial intelligence
Convolutional neural network
DOI: 10.1109/tpami.2019.2911077
IEEE Transactions on Pattern Analysis and Machine Intelligence ·
2020
Cited 87 times
Weakly Supervised Learning with Multi-Stream CNN-LSTM-HMMs to Discover Sequential Parallelism in Sign Language Videos
Convolutional neural network
Pattern recognition (psychology)
Deep learning
DOI: 10.3390/electronics9030483
Electronics ·
2020
Cited 80 times
Sentiment analysis based on deep learning: A comparative study
Sentiment analysis
Computer science
Artificial intelligence
DOI: 10.1162/tacl_a_00324
Transactions of the Association for Computational Linguistics ·
2020
Cited 79 times
How Can We Know What Language Models Know
Natural language processing
Artificial intelligence
Natural language
DOI: 10.1007/s10462-019-09770-z
Artificial Intelligence Review ·
2020
Cited 78 times
Recent trends in deep learning based personality detection
Machine learning
Convolutional neural network
Artificial neural network
DOI: 10.1162/tacl_a_00321
Transactions of the Association for Computational Linguistics ·
2020
Cited 78 times
BLiMP: The Benchmark of Linguistic Minimal Pairs for English
Artificial intelligence
Natural language processing
Benchmark (surveying)
DOI: 10.1109/mis.2020.2992799
IEEE Intelligent Systems ·
2020
Cited 77 times
The Hourglass Model Revisited
Categorization
Computer science
Sentiment analysis
DOI: 10.1609/aaai.v34i05.6282
Proceedings of the ... AAAI Conference on Artificial Intelligence ·
2020
Cited 76 times
TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection
Transformer
Natural language processing
Speech recognition