Idioma:

Pre-trained models for natural language processing: A survey

Qiu, XiPeng ; Sun, TianXiang ; Xu, YiGe ; Shao, YunFan ; Dai, Ning ; Huang, XuanJing

Science China. Technological sciences, 2020-10, Vol.63 (10), p.1872-1897 [Periódico revisado por pares]

Texto completo disponível

Citações Citado por

Título:
Pre-trained models for natural language processing: A survey
Autor: Qiu, XiPeng ; Sun, TianXiang ; Xu, YiGe ; Shao, YunFan ; Dai, Ning ; Huang, XuanJing
Assuntos: Engineering ; Natural language processing ; Review ; Taxonomy
É parte de: Science China. Technological sciences, 2020-10, Vol.63 (10), p.1872-1897
Descrição: Recently, the emergence of pre-trained models (PTMs) has brought natural language processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language representation learning and its research progress. Then we systematically categorize existing PTMs based on a taxonomy from four different perspectives. Next, we describe how to adapt the knowledge of PTMs to downstream tasks. Finally, we outline some potential directions of PTMs for future research. This survey is purposed to be a hands-on guide for understanding, using, and developing PTMs for various NLP tasks.
Editor: Beijing: Science China Press
Idioma: Inglês

Voltar para lista de resultados