Reset
Showing 20 of 280 academic articles

Power and Energy Profiling of Scientific Applications on Distributed Systems

Xizhou Feng, Rong Ge, Kirk W. Cameron • IEEE International Parallel and Distributed Processing Symposium (IPDPS) (2005)

Power consumption is a troublesome design constraint for emergent systems such as IBM's BlueGene /L. If current trends continue, future petaflop systems will require 100 megawatts of power to maintain high-performance. To address this probl...

OPENALEX DOI: https://doi.org/10.1109/ipdps.2005.346

Fault Tolerance in Distributed Systems

Gérard Tel • Cambridge University Press eBooks (2000)

The earlier parts of this book studied the coordinated behavior that can be achieved in distributed systems where processes are reliable . For several reasons it is attractive to study what coordinated behavior of processes is possible unde...

OPENALEX Open Access DOI: https://doi.org/10.1017/cbo9781139168724.014

Natural Language Processing

Nils J. Nilsson • Cambridge University Press eBooks (2009)

B eyond pattern recognition of individual alphanumeric characters , whether they be of fixed font or handwritten, lies the problem of understanding strings of characters that form words, sentences, or larger assemblages of text in a “natura...

OPENALEX DOI: https://doi.org/10.1017/cbo9780511819346.009

Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1

Matthieu Courbariaux, Itay Hubara, Daniel Soudry, Ran El‐Yaniv et al. • arXiv (Cornell University) (2016)

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time. At training-time the binary weights and activations are used for computing the parameters gradients. During t...

OPENALEX Open Access DOI: https://doi.org/10.48550/arxiv.1602.02830

Neural Networks in Structural Engineering

R. Daniel VanLuchene, ROUFEI SUN • Computer-Aided Civil and Infrastructure Engineering (1990)

In the past few years literature on computational civil engineering has concentrated primarily on artificial intelligence (Al) applications involving expert system technology. This article discusses a different Al approach involving neural ...

OPENALEX cc-by-nc-nd DOI: https://doi.org/10.1111/j.1467-8667.1990.tb00377.x

LSTM neural networks for language modeling

Martin Sundermeyer, Ralf Schlüter, Hermann Ney • Interspeech (USB) (2012)

Neural networks have become increasingly popular for the task of language modeling.Whereas feed-forward networks only exploit a fixed context length to predict the next word of a sequence, conceptually, standard recurrent neural networks ca...

OPENALEX Open Access DOI: https://doi.org/10.21437/interspeech.2012-65

Memristor devices for neural networks

Hongsik Jeong, Luping Shi • Journal of Physics D Applied Physics (2018)

Abstract Neural network technologies have taken center stage owing to their powerful computing capability for supporting deep learning in artificial intelligence. However, conventional synaptic devices such as SRAM and DRAM are not satisfac...

OPENALEX cc-by DOI: https://doi.org/10.1088/1361-6463/aae223

A general regression neural network

Donald F. Specht • IEEE Transactions on Neural Networks (1991)

A memory-based network that provides estimates of continuous variables and converges to the underlying (linear or nonlinear) regression surface is described. The general regression neural network (GRNN) is a one-pass learning algorithm with...

OPENALEX DOI: https://doi.org/10.1109/72.97934

NEURAL NETWORK DYNAMICS

Tim P. Vogels, Kanaka Rajan, Larry F. Abbott • Annual Review of Neuroscience (2005)

Neural network modeling is often concerned with stimulus-driven responses, but most of the activity in the brain is internally generated. Here, we review network models of internally generated activity, focusing on three types of network dy...

OPENALEX DOI: https://doi.org/10.1146/annurev.neuro.28.061604.135637

Recurrent Neural Network Regularization

Wojciech Zaremba, Ilya Sutskever, Oriol Vinyals • arXiv (Cornell University) (2014)

We present a simple regularization technique for Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units. Dropout, the most successful technique for regularizing neural networks, does not work well with RNNs and LSTMs. In ...

OPENALEX Open Access DOI: https://doi.org/10.48550/arxiv.1409.2329

Tensorizing Neural Networks

Alexander Novikov, Dmitry Podoprikhin, Anton Osokin, Dmitry Vetrov • arXiv (Cornell University) (2015)

Deep neural networks currently demonstrate state-of-the-art performance in several domains. At the same time, models of this class are very demanding in terms of computational resources. In particular, a large amount of memory is required b...

OPENALEX Open Access DOI: https://doi.org/10.48550/arxiv.1509.06569

Neural networks: a tutorial

Michael Chester • Prentice-Hall, Inc eBooks (1993)

1. A Structure of an Artificial Neural Network. 2. Applications of Neural Networks. 3. The Early Years. 4. The Hopfield Net. 5. Self Organizing Maps. 6. Backpropagation. 7. Learning Laws and Continued Taxonomy. 8. Adaptive Resonance Theory....

OPENALEX

Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations

Itay Hubara, Matthieu Courbariaux, Daniel Soudry, Ran El‐Yaniv et al. • arXiv (Cornell University) (2016)

We introduce a method to train Quantized Neural Networks (QNNs) --- neural networks with extremely low precision (e.g., 1-bit) weights and activations, at run-time. At train-time the quantized weights and activations are used for computing ...

OPENALEX Open Access DOI: https://doi.org/10.48550/arxiv.1609.07061

cuDNN: Efficient Primitives for Deep Learning

Sharan Chetlur, Cliff Woolley, Philippe Vandermersch, Cohen, Jonathan et al. • arXiv (Cornell University) (2014)

We present a library of efficient implementations of deep learning primitives. Deep learning workloads are computationally intensive, and optimizing their kernels is difficult and time-consuming. As parallel architectures evolve, kernels mu...

OPENALEX Open Access DOI: https://doi.org/10.48550/arxiv.1410.0759

Unstructured Grid Computing Acceleration Algorithm Based on Sunway TaihuLight

XU Le, AN Hong, CHEN Junshi, ZHANG Pengfei, WU Zheng • Jisuanji gongcheng (2022)

The performance of unstructured grid computing on Sunway TaihuLight, a domestic heterogeneous many-core platform, is limited by sparse storage, discrete memory access, and data dependency.To relieve the sparse storage and discrete memory ac...

DOAJ Open Access (DOAJ) DOI: 10.19678/j.issn.1000-3428.0065567

Associations of subclinical autistic-like traits with brain structural variation using diffusion tensor imaging and voxel-based morphometry

Yvonne Schröder, Daniela Michelle Hohmann, Tina Meller, Ulrika Evermann et al. • European Psychiatry (2021)

Abstract Background Previous case–control studies of autistic spectrum disorder (ASD) have identified altered brain structure such as altered frontal and temporal cortex volumes, or decreased fractional anisotropy (FA) within the inferior ...

DOAJ Open Access (DOAJ) DOI: 10.1192/j.eurpsy.2021.15