Academic Articles & Research Papers

Natural Language Processing in Psychiatry

The potential benefit of artificial intelligence (AI) technology as a tool of psychiatry has not been well defined. In this essay, the technology of natural language processing and its position with regard to the two main schools of AI is c...

Semantic Alignment in Disciplinary Tutoring System: Leveraging Sentence Transformer Technology

In this work, we present a disciplinary e-tutoring system that integrates ONTO-TDM, an ontology designed for teaching domain modeling, with advanced transformer technology. Our primary objective is to enhance semantic similarity tasks withi...

Machine Unlearning: A Perspective, Taxonomy, and Benchmark Evaluation

Machine Learning (ML) models trained on large-scale datasets learn useful predictive patterns, but they may also memorize undesired information, leading to risks such as information leakage, bias, copyright violations, and privacy attacks. ...

Sentiment Analysis and Topic Modeling of Indonesian Public Conversation about COVID-19 Epidemics on Twitter

The World Health Organization (WHO) declared the COVID-19 outbreak has resulted in more than six million confirmed cases and more than 371,000 deaths globally on June 1, 2020. The incident sparked a flood of scientific research to help soci...

Natural Language Processing and Information Retrieval

Natural Language Processing and Information Retrieval is a textbook designed to meet the requirements of engineering students pursuing undergraduate and postgraduate programs in computer science and information technology. The book attempts...

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on general domain corpora, such as newswire and Web. A prevailing a...

Topic Modeling and Content Analysis of Chinese Medical Device Policies Using BERTopic.

Ensembles machine learning for short duration rainfall intensity forecasting

Abstract This study introduces an ensemble machine learning (EML) framework to enhance short-duration rainfall-intensity prediction under limited-data conditions. By integrating multiple base learners within a stacking architecture, the pro...

Comparative Study of CNN and RNN for Natural Language Processing

Deep neural networks (DNN) have revolutionized the field of natural language processing (NLP). Convolutional neural network (CNN) and recurrent neural network (RNN), the two main types of DNN architectures, are widely explored to handle var...

Methods for Analyzing the Contents of Social Media for Health Care: Scoping Review

BackgroundGiven the rapid development of social media, effective extraction and analysis of the contents of social media for health care have attracted widespread attention from health care providers. As far as we know, most of the reviews ...

Paradigm Shift in Natural Language Processing

Abstract In the era of deep learning, modeling for most natural language processing (NLP) tasks has converged into several mainstream paradigms. For example, we usually adopt the sequence labeling paradigm to solve a bundle of tasks such as...

GBsim: A Robust GCN-BERT Approach for Cross-Architecture Binary Code Similarity Analysis

Recent advances in graph neural networks have transformed structural pattern learning in domains ranging from social network analysis to biomolecular modeling. Nevertheless, practical deployments in mission-critical scenarios such as binary...

Natural Language Processing

Understanding and processing human language has always been a complicated task in computational theory. Natural language processing, a combination of artificial intelligence and computational linguistics, employs computational techniques to...

A Model-Driven Approach Employing DSL and Generation Templates to Accelerate the Development of Conversational Agents for Smart Tourism

Conversational agents are intelligent, ubiquitous software applications widely used across various sectors, such as commerce, tourism, and more. Their key benefits include automating tasks, improving customer service, and ensuring service a...

A maximum entropy approach to natural language processing

The concept of maximum entropy can be traced back along multiple threads to Biblical times. Only recently, however, have computers become powerful enough to permit the widescale application of this concept to real world problems in statisti...

An Analysis of the Training Data Impact for Domain-Adapted Tokenizer Performances—The Case of Serbian Legal Domain Adaptation

Various areas of natural language processing (NLP) have greatly benefited from the development of large language models in recent years. This research addresses the challenge of developing efficient tokenizers for transformer-based domain-s...

A Refutation of Finite-State Language Models through Zipf’s Law for Factual Knowledge

We present a hypothetical argument against finite-state processes in statistical language modeling that is based on semantics rather than syntax. In this theoretical model, we suppose that the semantic properties of texts in a natural langu...

ILSA: an automated language complexity analysis tool for French

Estimating language complexity is an important aspect of educational measurement and assessment that can be used, for instance, to control for unwanted variance due to language, or to provide students with texts that are conducive to learni...

Natural Language Processing

Natural language processing (NLP) is the study of mathematical and computational modeling of various aspects of language and the development of a wide range of systems. These include spoken language systems that integrate speech and natural...

Assessing GPT's capabilities in consumer food survey analysis: A comparative approach for understanding food technophobia and novel protein perceptions

This study explores the application of GPT models for automating consumer food survey analysis, focusing on Chinese consumers' acceptance of plant-based foods, cultured meat, insect-based proteins, and microbial proteins. Traditional survey...