Academic Articles & Research Papers

HuggingFace's Transformers: State-of-the-art Natural Language Processing

Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining. Transformer architectures have facilitated building higher-capacity models and pretraining has made it possible to ...

Transformers: State-of-the-Art Natural Language Processing

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu...

Transformer in Computer Vision

Transformer is widely used in Natural Language Processing (NLP), in which numerous papers have been proposed. Recently, the transformer has been borrowed for many computer vision tasks. However, there are few papers to give a comprehensive ...

UPANets: Learning from the Universal Pixel Attention Neworks

With the successful development in computer vision, building a deep convolutional neural network (CNNs) has been mainstream, considering the character of shared parameters in a convolutional layer. Stacking convolutional layers into a deep ...

TransCat: a hybrid CNN-transformer network with KAN for medical image segmentation

Medical image segmentation is a fundamental task in computer vision and plays an important role in clinical diagnosis and treatment planning. Existing methods are mainly built on either convolutional neural networks (CNNs) or Transformer-ba...

Deep learning based computer vision approaches for smart agricultural applications

The agriculture industry is undergoing a rapid digital transformation and is growing powerful by the pillars of cutting-edge approaches like artificial intelligence and allied technologies. At the core of artificial intelligence, deep learn...

A comprehensive analytical assessment of dino-based architectures for sustainable automated potato inspection in the Al Kharj Region

Abstract Self-supervised learning (SSL) has emerged as a pivotal paradigm in computer vision, particularly for applications where labeled data are limited, costly, or labor-intensive to obtain. This paradigm is especially relevant to sustai...

Vision Transformers in medical computer vision—A contemplative retrospection

Application of Graph Structures in Computer Vision Tasks

On the one hand, the solution of computer vision tasks is associated with the development of various kinds of images or random fields mathematical models, i.e., algorithms, that are called traditional image processing. On the other hand, no...

CG-DINO: Improved Network for Small Object Detection in Uncrewed Aerial Vehicle Imagery Based on DINO

Object detection in uncrewed aerial vehicle (UAV) acquired images remains a challenging task due to extreme scale variation, dense object layouts, and complex backgrounds, etc. Although convolutional neural networks (CNNs), transformers, an...

Quantum Leap in Healthcare: A Comparative Analysis of AI/ML and Quantum Computing for Healthcare opportunities of the new era

The healthcare sector is undergoing rapid transformation driven by advances in artificial intelligence and machine learning, with quantum computing emerging as the next major breakthrough. This paper presents a comparative analysis of class...

Empirical Evaluation of Invariances in Deep Vision Models

The ability of deep learning models to maintain consistent performance under image transformations-termed invariances, is critical for reliable deployment across diverse computer vision applications. This study presents a comprehensive empi...

Unmixing-Guided Convolutional Transformer for Spectral Reconstruction

Deep learning networks based on CNNs or transformers have made progress in spectral reconstruction (SR). However, many methods focus solely on feature extraction, overlooking the interpretability of network design. Additionally, models excl...

A Transformer-Based Approach for Efficient Geometric Feature Extraction from Vector Shape Data

The extraction of shape features from vector elements is essential in cartography and geographic information science, supporting a range of intelligent processing tasks. Traditional methods rely on different machine learning algorithms tail...

Tachyon: Enhancing stacked models using Bayesian optimization for intrusion detection using different sampling approaches

The integration of sensors in the monitoring of essential bodily measurements, air quality, and energy consumption in buildings demonstrates the importance of the Internet of Things (IoT) in everyday life. These security breaches are caused...