AboutValuesWhy OA.mg?OA.mg PremiumExploreDataContact
Chrome ExtensionScholarMindChatGPT Plugin
ϟ

Top 25 Natural Language Processing (NLP) Papers published 2020

2020 was a great year for NLP

NLP (Natural Language Processing) is a subfield of linguistics, computer science, and artificial intelligence concerned with the interactions between computers and human language, in particular how to program computers to process and analyze large amounts of natural language data. The goal is a computer capable of "understanding" the contents of documents, including the contextual nuances of the language within them. The technology can then accurately extract information and insights contained in the documents as well as categorize and organize the documents themselves.
MAG: 3082274269
2020
Cited 1,928 times
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu
Automatic summarization
Computer science
Transfer of learning
DOI: 10.1162/tacl_a_00300
2020
Cited 683 times
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, Omer Levy
Computer science
Security token
Training (meteorology)
DOI: 10.1162/tacl_a_00343
2020
Cited 404 times
Multilingual Denoising Pre-training for Neural Machine Translation
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Michael Lewis, Luke Zettlemoyer
Artificial intelligence
Training (meteorology)
Natural language processing
DOI: 10.1609/aaai.v34i07.7005
2020
Cited 246 times
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
Closed captioning
Computer science
Transformer
DOI: 10.1609/aaai.v34i05.6311
2020
Cited 207 times
Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailment
Di Jin, Zhijing Jin, Joey Tianyi Zhou, Peter Szolovits
Adversarial system
Computer science
Grammaticality
DOI: 10.1609/aaai.v34i05.6394
2020
Cited 196 times
Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Dataset
Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta, Pranav Khaitan
Domain (mathematical analysis)
Artificial intelligence
Natural language processing
DOI: 10.1109/tmm.2019.2924576
2020
Cited 164 times
STAT: Spatial-Temporal Attention Mechanism for Video Captioning
Chenggang Yan, Yunbin Tu, Wang Xingzheng, Yongbing Zhang, Xinhong Hao, Yongdong Zhang, Qionghai Dai
Artificial intelligence
Task (project management)
Attention network
DOI: 10.1609/aaai.v34i05.6510
2020
Cited 153 times
Semantics-Aware BERT for Language Understanding
Zhuosheng Zhang, Yuwei Wu, Hai Zhao, Zuchao Li, Shuailiang Zhang, Xi Zhou, Xiang Zhou
Computer science
Natural language processing
Semantics (computer science)
DOI: 10.1162/tacl_a_00313
2020
Cited 151 times
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks
Sascha Rothe, Shashi Narayan, Aliaksei Severyn
Computer science
Sequence (biology)
Artificial intelligence
DOI: 10.1162/tacl_a_00317
2020
Cited 147 times
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages
Jonathan H. Clark, Eunsol Choi, Michael Collins, Dan Garrette, Tom Kwiatkowski, Vitaly Nikolaev, Jennimaria Palomaki
Benchmark (surveying)
Computer science
Question answering
DOI: 10.1109/tpami.2020.3007032
2020
Cited 136 times
CCNet: Criss-Cross Attention for Semantic Segmentation
Zilong Huang, Xinggang Wang, Yunchao Wei, Lichao Huang, Humphrey Shi, Wenyu Liu, Thomas S. Huang
Image segmentation
Pattern recognition (psychology)
Pascal (unit)
DOI: 10.3390/info11060314
2020
Cited 125 times
COVID-19 public sentiment insights and machine learning for tweets classification
Jim Samuel, G. G. Md. Nawaz Ali, Md. Mokhlesur Rahman, Ek Esawi, Yana Samuel
Social media
Deep learning
Natural language processing
DOI: 10.1007/s10462-019-09794-5
2020
Cited 120 times
Sentiment analysis using deep learning architectures: a review
Ashima Yadav, Dinesh Kumar Vishwakarma
Natural language processing
Machine learning
Convolutional neural network
DOI: 10.1016/j.jml.2019.104038
2020
Cited 119 times
How to capitalize on a priori contrasts in linear (mixed) models: A tutorial
Daniel J. Schad, Shravan Vasishth, Sven Hohenstein, Reinhold Kliegl
Computer science
Artificial intelligence
Cognitive psychology
DOI: 10.1007/s00521-019-04144-6
2020
Cited 108 times
Assessing gender bias in machine translation: a case study with Google Translate
Marcelo O. R. Prates, Pedro H. C. Avelar, Luis C. Lamb
Computer science
Artificial intelligence
Natural language processing
DOI: 10.1609/aaai.v34i05.6239
2020
Cited 108 times
PIQA: Reasoning about Physical Commonsense in Natural Language
Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, Yejin Choi
Commonsense knowledge
Artificial intelligence
Natural (archaeology)
DOI: 10.1007/s10700-019-09309-5
2020
Cited 96 times
A survey of decision-making methods with probabilistic linguistic information: bibliometrics, preliminaries, methodologies, applications and future directions
Huchang Liao, Xiaomei Mi, Zeshui Xu
Artificial intelligence
Natural language processing
DOI: 10.1073/pnas.1907375117
2020
Cited 90 times
Understanding the role of individual units in a deep neural network.
David Bau, Jun-Yan Zhu, Hendrik Strobelt, Agata Lapedriza, Bolei Zhou, Antonio Torralba
Computer science
Artificial intelligence
Convolutional neural network
DOI: 10.1109/tpami.2019.2911077
2020
Cited 87 times
Weakly Supervised Learning with Multi-Stream CNN-LSTM-HMMs to Discover Sequential Parallelism in Sign Language Videos
Oscar Koller, Necati Cihan Camgoz, Hermann Ney, Richard Bowden
Convolutional neural network
Pattern recognition (psychology)
Deep learning
DOI: 10.3390/electronics9030483
2020
Cited 80 times
Sentiment analysis based on deep learning: A comparative study
Nhan Cach Dang, María N. Moreno-García, Fernando De la Prieta
Sentiment analysis
Computer science
Artificial intelligence
DOI: 10.1162/tacl_a_00324
2020
Cited 79 times
How Can We Know What Language Models Know
Zhengbao Jiang, Frank F. Xu, Jun Araki, Graham Neubig
Natural language processing
Artificial intelligence
Natural language
DOI: 10.1007/s10462-019-09770-z
2020
Cited 78 times
Recent trends in deep learning based personality detection
Yash Mehta, Navonil Majumder, Alexander Gelbukh, Erik Cambria
Machine learning
Convolutional neural network
Artificial neural network
DOI: 10.1162/tacl_a_00321
2020
Cited 78 times
BLiMP: The Benchmark of Linguistic Minimal Pairs for English
Alex Warstadt, Alicia Parrish, Haokun Liu, Anhad Mohananey, Wei Peng, Sheng-Fu Wang, Samuel R. Bowman
Artificial intelligence
Natural language processing
Benchmark (surveying)
DOI: 10.1109/mis.2020.2992799
2020
Cited 77 times
The Hourglass Model Revisited
Yosephine Susanto, Andrew G. Livingstone, Bee Chin Ng, Erik Cambria
Categorization
Computer science
Sentiment analysis
DOI: 10.1609/aaai.v34i05.6282
2020
Cited 76 times
TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection
Siddhant Garg, Thuy Vu, Alessandro Moschitti
Transformer
Natural language processing
Speech recognition
OA.mgAbout UsOur ValuesWhy OA.mg? OA.mg PremiumChrome ExtensionChatGPT PluginPublic RoadmapChangelogContact UsFeedback?
Privacy PolicyTerms of ServiceRefund Policy
ContentOA.mg CoverageTop ListsOpen Access JournalsOpen Access DissertationsTopicsBlog
ExploreGeographyEngineeringPoliSciGeologyPhilosophySociologyArtHistoryMathematicsPhysics
 PsychologyComputer ScienceBusinessEnvironmental ScienceChemistryMaterials ScienceMedicineBiologyEconomics
OA.mg is built in Stockholm and London. We work hand in hand with the scientific community to advance the cause of Open Access. Feedback makes us better.