Pre-trained models for natural language processing: A survey
https://doi.org/10.1007/s11431-020-1647-3
Discover Books. Explore Knowledge.
Search and discover peer-reviewed scholarly literature, open-access articles, and research citations across DOAJ, PubMed Central, and OpenAlex.
https://doi.org/10.1007/s11431-020-1647-3
https://doi.org/10.1007/978-3-031-02139-8
Over the past few years, neural networks have re-emerged as powerful machine-learning models, yielding state-of-the-art results in fields such as image recognition and speech processing. More recently, neural network models started to be ap...
https://doi.org/10.1613/jair.4992
Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining. Transformer architectures have facilitated building higher-capacity models and pretraining has made it possible to ...
https://doi.org/10.48550/arxiv.1910.03771
We describe a single convolutional neural network architecture that, given a sentence, outputs a host of language processing predictions: part-of-speech tags, chunks, named entity tags, semantic roles, semantically similar words and the lik...
https://doi.org/10.1145/1390156.1390177
Abstract Natural language processing is a field that explores computational methods for interpreting and processing natural language, in either textual or spoken form....
https://doi.org/10.1002/0470018860.s00078
Statistical approaches to processing natural language text have become dominant in recent years. This foundational text is the first comprehensive introduction to statistical natural language processing (NLP) to appear. The book contains al...
https://doi.org/10.4324/9781315802671
Natural language processing (NLP) is the study of mathematical and computational modeling of various aspects of language and the development of a wide range of systems. These include spoken language systems that integrate speech and natural...
https://doi.org/10.1126/science.253.5025.1242
The Arabic language presents researchers and developers of natural language processing (NLP) applications for Arabic text and speech with serious challenges. The purpose of this article is to describe some of these challenges and to present...
https://doi.org/10.1145/1644879.1644881
10.26508/lsa.202603876
PMC: PMC13736178
10.1038/s41419-026-09177-z
PMC: PMC13737179
10.1038/s41467-026-78219-z
PMC: PMC13736962
10.1038/s42003-026-11067-1
PMC: PMC13737086
The parliament, as a key component of the public sphere, is both a reflection of and a stage for the post-democratic transition. Our study examines Hungarian parliamentary discourse as an indicator of a transition in which democratic instit...
10.1016/j.ssaho.2026.103122
Since the early twenty-first century, ecological, economic, and geopolitical crises have intensified challenges related to food systems, reshaping dietary practices and individual relationships with the environment. Sustainable food consump...
10.13092/csznaa09
Abstract Mapping a sentence into a two-dimensional (2D) representation can flatten nested semantic structures and build multi-granular span dependencies in named entity recognition. Existing approaches to recognizing named entities often cl...
10.1038/s41598-025-87722-0
10.1162/coli.2007.33.2.275
IntroductionBibliometric analysis is widely acknowledged as a robust and systematic approach for examining extensive scholarly literature. It serves as a vital tool for mapping the landscape of contemporary research across various academic ...
10.22108/jas.2025.144379.2609
This study explores the application of GPT models for automating consumer food survey analysis, focusing on Chinese consumers' acceptance of plant-based foods, cultured meat, insect-based proteins, and microbial proteins. Traditional survey...
10.1016/j.jafr.2025.102086