Academic Articles & Research Papers

Readings in natural language processing

Attention in Natural Language Processing

Attention is an increasingly popular mechanism used in a wide range of neural architectures. The mechanism itself has been realized in a variety of formats. However, because of the fast-paced advances in this domain, a systematic overview o...

Natural Language Processing

Natural language processing

Previous ARIST chapters (Haas, 1996;Warner, 1987) described a number of theoretical developments that have influenced research in NLP.The most recent theoretical developments can be grouped into four classes: (i) statistical and corpus-base...

Advances in natural language processing

Natural language processing employs computational techniques for the purpose of learning, understanding, and producing human language content. Early computational approaches to language research focused on automating the analysis of the lin...

Natural language processing: an introduction

OBJECTIVES: To provide an overview and tutorial of natural language processing (NLP) and modern NLP-system design. TARGET AUDIENCE: This tutorial targets the medical informatics generalist who has limited acquaintance with the principles be...

Handbook of Natural Language Processing

The Handbook of Natural Language Processing, Second Edition presents practical tools and techniques for implementing natural language processing in computer systems. Along with removing outdated material, this edition updates every chapter ...

Natural language processing with Python

This book offers a highly accessible introduction to natural language processing, the field that supports a variety of language technologies, from predictive text and email filtering to automatic summarization and translation. With it, you'...

Collectively encoding protein properties enriches protein language models

Abstract Pre-trained natural language processing models on a large natural language corpus can naturally transfer learned knowledge to protein domains by fine-tuning specific in-domain tasks. However, few studies focused on enriching such p...

Transformer in Computer Vision

Transformer is widely used in Natural Language Processing (NLP), in which numerous papers have been proposed. Recently, the transformer has been borrowed for many computer vision tasks. However, there are few papers to give a comprehensive ...

Research progress and trends of deep learning based wireless communication receiving method

With the continues expansion of the application boundary for wireless communications, the application environment of wireless communications is becoming increasingly complex and diverse, which faces negative impacts such as radio frequency ...

VISION-LINK AI Smart Glass: An Edge-Cloud Wearable AI System for Workflow Automation and Digital Inclusion in Emerging Economies

The rapid advancement of Artificial Intelligence (AI), wearable computing, and Internet of Things (IoT) technologies has significantly transformed digital interactions across various sectors. However, the adoption of smart wearable technolo...

Human Behavior Analysis: A Comprehensive Survey on Techniques, Applications, Challenges, and Future Directions

Human Behavior Analysis (HBA) has emerged as a critical interdisciplinary field, combining psychology, sociology, artificial intelligence, and data science to model, understand, and predict human behavior across diverse domains. This paper ...

Learning by Watching: A Review of Video-Based Learning Approaches for Robot Manipulation

Robot learning of manipulation skills is hindered by the scarcity of diverse, unbiased datasets. While curated datasets can help, challenges remain regarding generalizability and real-world transfer. Meanwhile, large-scale ‘in-the-wi...

Frozen Weights as Prior for Parameter-Efficient Fine-Tuning

In the fields of natural language processing and computer vision, the emergence of large pre-trained models has led to the adoption of fine-tuning them for downstream tasks as an important paradigm. However, the full fine-tuning approach of...

Artificial Intelligence in Healthcare: Advancing Innovation and Ethics to Foster Well-Being

Artificial intelligence (AI) is reshaping healthcare by enhancing diagnostic precision, treatment personalization, and overall patient care. By leveraging technologies such as machine learning, deep learning, natural language processing, an...

Application of Graph Structures in Computer Vision Tasks

On the one hand, the solution of computer vision tasks is associated with the development of various kinds of images or random fields mathematical models, i.e., algorithms, that are called traditional image processing. On the other hand, no...

Attention is All Large Language Model Need

With the advent of the Transformer, the attention mechanism has been applied to Large Language Model (LLM), evolving from initial single- modal large models to today's multi-modal large models. This has greatly propelled the development of ...

An Efficient Optimization Technique for Training Deep Neural Networks

Deep learning is a sub-branch of artificial intelligence that acquires knowledge by training a neural network. It has many applications in the field of banking, automobile industry, agriculture, and healthcare industry. Deep learning has pl...

Enhanced gradient learning for deep neural networks

Abstract Deep neural networks have achieved great success in both computer vision and natural language processing tasks. How to improve the gradient flows is crucial in training very deep neural networks. To address this challenge, a gradie...