Deep Contextualized Word Representations
Matthew E. Peters, Mark Neumann, Mohit Iyyer et al. · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2018
Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). 2018.
Cited by 11,541 works. doi:10.18653/v1/n18-1202 Open-access PDF
Authors
References
- Long Short-Term Memory
- AutoResearch Lite: a reproducible paper-inspired experiment runner (Adam mechanism reproduction and convergence-speed comparison)
- Dropout: a simple way to prevent neural networks from overfitting
- Glove: Global Vectors for Word Representation
- Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
- Building a Large Annotated Corpus of English: The Penn Treebank
- ADADELTA: An Adaptive Learning Rate Method
- Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
- Word Representations: A Simple and General Method for Semi-Supervised Learning
- On the Properties of Neural Machine Translation: Encoder–Decoder Approaches