Neural Networks and the Bias/Variance Dilemma

Maximum Likelihood from Incomplete Data Via the EM Algorithm

1977 • 46,601 citations

Learning representations by back-propagating errors

1986 • 25,825 citations

Classification and Regression Trees.

1984 • 23,117 citations

Classification and Regression Trees.

1986 • 21,574 citations

Multilayer feedforward networks are universal approximators

1989 • 18,606 citations

Information Theory and an Extension of the Maximum Likelihood Principle

1998 • 16,234 citations

Pattern classification and scene analysis

1973 • 12,976 citations

Approximation by superpositions of a sigmoidal function

1989 • 12,384 citations

Backpropagation Applied to Handwritten Zip Code Recognition

1989 • 10,538 citations

Multilayer feedforward networks are universal approximators

1989 • 9,696 citations

An introduction to computing with neural nets

1987 • 7,916 citations

Multivariate Adaptive Regression Splines

1991 • 7,851 citations

On the approximate realization of continuous mappings by neural networks

1989 • 4,187 citations

Neural network ensembles

1990 • 4,138 citations

Connectionism and cognitive architecture: A critical analysis

1988 • 3,736 citations

Convergence of Stochastic Processes.

1985 • 2,394 citations

The Analysis of Binary Data.

1971 • 2,339 citations

Estimation of Dependences Based on Empirical Data

2006 • 2,270 citations

Projection Pursuit Regression

1981 • 2,099 citations

On the proper treatment of connectionism

1988 • 2,080 citations

Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms

1963 • 1,840 citations

Estimating Optimal Transformations for Multiple Regression and Correlation

1985 • 1,572 citations

What Size Net Gives Valid Generalization?

1989 • 1,555 citations

An inequality and associated maximization technique in statistical estimation of probabilistic functions of a Markov process

1972 • 1,453 citations

Neural networks and principal component analysis: Learning from examples without local minima

1989 • 1,338 citations

The Representation and Matching of Pictorial Structures

1973 • 1,318 citations

Auto-association by multilayer perceptrons and singular value decomposition

1988 • 1,296 citations

The Correlation Theory of Brain Function

1994 • 1,130 citations

Projection Pursuit

1985 • 1,126 citations

Multiresolution elastic matching

1989 • 1,090 citations

Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks

1990 • 1,058 citations

Learning and Relearning in Boltzmann Machines

2001 • 1,056 citations

V. Adaptive Control Processes

1964 • 1,049 citations

Stochastic Complexity and Modeling

1986 • 959 citations

Learning in Artificial Neural Networks: A Statistical Perspective

1989 • 927 citations

Decision theoretic generalizations of the PAC model for neural net and other learning applications

1992 • 897 citations

Distinctive features, categorical perception, and probability learning: Some applications of a neural model.

1977 • 875 citations

Neurocomputing: Foundations of Research

1988 • 866 citations

A Statistical Model for Positron Emission Tomography

1985 • 810 citations

Layered Neural Networks with Gaussian Hidden Units as Universal Approximations

1990 • 786 citations

Connectionist nonparametric regression: Multilayer feedforward networks can learn arbitrary mappings

1990 • 688 citations

The recent excitement about neural networks

1989 • 667 citations

Cross-Validatory Choice and Assessment of Statistical Predictions (With Discussion)

1976 • 661 citations

A simple procedure for pruning back-propagation trained neural networks

1990 • 661 citations

On the Consistency of Bayes Estimates

1986 • 639 citations

A learning algorithm for boltzmann machines

1985 • 616 citations

Am I Thinking Assemblies?

1986 • 550 citations

Skeletonization: A Technique for Trimming the Fat from a Network via Relevance Assessment

1988 • 541 citations

A Computer-Derived Protocol to Aid in the Diagnosis of Emergency Room Patients with Acute Chest Pain

1982 • 515 citations

A Comparison of GCV and GML for Choosing the Smoothing Parameter in the Generalized Spline Smoothing Problem

1985 • 513 citations

A Theory of Adaptive Pattern Classifiers

1967 • 498 citations

Review of Neural Networks for Speech Recognition

1989 • 488 citations

Projection Pursuit Regression

1981 • 473 citations

Estimating Optimal Transformations for Multiple Regression and Correlation

1985 • 439 citations

Biased and Unbiased Cross-Validation in Density Estimation

1987 • 428 citations

A completely automatic french curve: fitting spline functions by cross validation

1975 • 365 citations

How Far are Automatically Chosen Regression Smoothing Parameters from their Optimum?

1988 • 362 citations

Nonparametric Maximum Likelihood Estimation by the Method of Sieves

1982 • 358 citations

Links between Markov models and multilayer perceptrons

1990 • 333 citations

Structural Image Restoration through Deformable Templates

1991 • 323 citations

A Statistical Model for Positron Emission Tomography

1985 • 307 citations

Stopping Rule for the MLE Algorithm Based on Statistical Hypothesis Testing

1987 • 253 citations

Generalization and Parameter Estimation in Feedforward Nets: Some Experiments

1989 • 232 citations

Generalized Deformable Models, Statistical Physics, and Matching Problems

1990 • 224 citations

Automatic smoothing parameter selection: A survey

1988 • 194 citations

Elastic Matching of Line Drawings

1981 • 187 citations

Complexity Regularization with Application to Artificial Neural Networks

1991 • 164 citations

Universal Donsker Classes and Metric Entropy

2010 • 158 citations

How Far Are Automatically Chosen Regression Smoothing Parameters From Their Optimum?

1988 • 151 citations

Consistent inference of probabilities in layered networks: predictions and generalizations

1989 • 146 citations

Bootstrap Choice of Bandwidth for Density Estimation

1990 • 127 citations

An application of a multiple neural network learning system to emulation of mortgage underwriting judgements

1988 • 109 citations

A Learning Algorithm for Boltzmann Machines**The research reported here was supported by grants from the System Development Foundation. We thank Peter Brown, Francis Crick, Mark Derthick, Scott Fahlman, Jerry Feldman, Stuart Geman, Gail Gong, John Hopfield, Jay McClelland, Barak Pearlmutter, Harry Printz, Dave Rumelhart, Tim Shallice, Paul Smolensky, Rick Szeliski, and Venkataraman Venkatasubramanian for helpful discussions.Reprint requests should be addressed to David Ackley, Computer Science …

1987 • 108 citations

Exhaustive Thermodynamical Analysis of Boolean Learning Networks

1987 • 103 citations

CONSTRAINED REGULARIZATION FOR ILL POSED LINEAR OPERATOR EQUATIONS, WITH APPLICATIONS IN METEOROLOGY AND MEDICINE11This work was supported by the Office of Naval Research under Contract No. N00014-77-C-0675.

1982 • 100 citations

Universal Donsker Classes and Metric Entropy

1987 • 96 citations

Recognizing Hand-Printed Letters and Digits Using Backpropagation Learning

1991 • 94 citations

Biased and Unbiased Cross-Validation in Density Estimation

1987 • 86 citations

The “rubber-mask” technique—I. Pattern measurement and analysis

1973 • 85 citations

Statistical properties of artificial neural networks

2003 • 80 citations

On empirical spectral analysis of stochastic processes

1952 • 76 citations

A Proposal for More Powerful Learning Algorithms

1989 • 74 citations

Exhaustive Learning

1990 • 72 citations

Statistical Coding and Short-Term Synaptic Plasticity: A Scheme for Knowledge Representation in the Brain

1986 • 72 citations

Dualistic geometry of the manifold of higher-order neurons

1991 • 69 citations

The Perceptron Algorithm is Fast for Nonmalicious Distributions

1990 • 68 citations

Generalizing the PAC model: sample size bounds from metric dimension-based uniform convergence results

1989 • 66 citations

A cross validated bayesian retrieval algorithm for nonlinear remote sensing experiments

1985 • 65 citations

On the Nonconsistency of Maximum Likelihood Nonparametric Density Estimators

1981 • 62 citations

Convergence rates of "thin plate" smoothing splines wihen the data are noisy

1979 • 59 citations

The Bootstrap Widrow-Hoff Rule as a Cluster-Formation Algorithm

1990 • 43 citations

Structural Image Restoration Through Deformable Templates

1991 • 42 citations

Projection pursuit learning networks for regression

2002 • 41 citations

Dynamic behavior of constrained back propagation networks

1990 • 39 citations

Bootstrap Choice of Bandwidth for Density Estimation

1990 • 35 citations

When are k-nearest neighbor and back propagation accurate for feasible sized sets of examples?

1990 • 30 citations

Synchronous Boltzmann Machines and Gibbs Fields: Learning Algorithms

1990 • 21 citations

Experiments with Representation in Neural Networks: Object Motion, Speech, and Arithmetic

1990 • 14 citations

Elastic matching and pattern recognition in neural networks.

1989 • 13 citations

Speech recognition using time-delay neural networks

1988 • 12 citations

Multilayer perceptrons and data analysis.

1988 • 7 citations