Statistical strategies for avoiding false discoveries in metabolomics and related experiments

Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing

1995 • 93,704 citations

Fuzzy sets

1965 • 60,040 citations

Fuzzy sets

1996 • 48,650 citations

An Introduction to the Bootstrap

1994 • 39,661 citations

Statistical Learning Theory

1999 • 27,709 citations

The Elements of Statistical Learning

2001 • 24,302 citations

The meaning and use of the area under a receiver operating characteristic (ROC) curve.

1982 • 20,275 citations

Pattern Classification

2012 • 20,094 citations

An Introduction to the Bootstrap

1993 • 19,341 citations

The Elements of Statistical Learning: Data Mining, Inference, and Prediction

2013 • 19,068 citations

Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference

1988 • 17,362 citations

Multi-Objective Optimization Using Evolutionary Algorithms

2001 • 15,138 citations

Genetic Programming: On the Programming of Computers by Means of Natural Selection

1992 • 13,426 citations

Exploratory Data Analysis

1977 • 12,265 citations

Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring

1999 • 11,586 citations

Practical Nonparametric Statistics

2000 • 11,073 citations

Response Surface Methodology: Process and Product Optimization Using Designed Experiments

1996 • 9,987 citations

A study of cross-validation and bootstrap for accuracy estimation and model selection

1995 • 9,976 citations

Causality

2009 • 9,709 citations

Cluster Analysis

1974 • 9,459 citations

Statistical significance for genomewide studies

2003 • 9,411 citations

Gene expression profiling predicts clinical outcome of breast cancer

2002 • 9,314 citations

Why Most Published Research Findings Are False

2005 • 9,226 citations

Self-Organization and Associative Memory

1989 • 8,952 citations

Principal Component Analysis

1988 • 8,927 citations

Principal Component Analysis

1986 • 7,864 citations

Design and Analysis of Computer Experiments

1989 • 6,989 citations

Information theory, inference, and learning algorithms

2004 • 6,948 citations

Statistics for Experimenters

1979 • 6,604 citations

A Simple Statistical Parameter for Use in Evaluation and Validation of High Throughput Screening Assays

1999 • 6,580 citations

A review of methods for the assessment of prediction errors in conservation presence/absence models

1997 • 6,434 citations

A Gene-Expression Signature as a Predictor of Survival in Breast Cancer

2002 • 6,428 citations

Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine

1993 • 6,407 citations

Nonparametric Statistical Methods

1999 • 6,387 citations

Comparing partitions

1985 • 6,323 citations

Basic principles of ROC analysis

1978 • 5,844 citations

Multivariate Statistical Methods

2008 • 5,797 citations

Evolutionary Algorithms for Solving Multi-Objective Problems

2007 • 5,751 citations

Graph drawing by force‐directed placement

1991 • 5,730 citations

Statistical Inference

1990 • 5,570 citations

What's wrong with Bonferroni adjustments

1998 • 5,540 citations

A Direct Approach to False Discovery Rates

2002 • 5,455 citations

The visual display of quantitative information

1985 • 5,281 citations

Causality: Models, Reasoning and Inference

2001 • 5,101 citations

Information Theory, Inference, and Learning Algorithms

2004 • 4,822 citations

A theory of the learnable

1984 • 4,471 citations

Life with 6000 Genes

1996 • 4,125 citations

Bayesian Networks and Decision Graphs

2007 • 4,044 citations

Pattern Classification

2001 • 3,951 citations

Missing value estimation methods for DNA microarrays

2001 • 3,768 citations

Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)

2001 • 3,663 citations

Statistics notes: Multiple significance tests: the Bonferroni method

1995 • 3,474 citations

Beware of q2!

2002 • 3,432 citations

A Nonlinear Mapping for Data Structure Analysis

1969 • 3,389 citations

Use of proteomic patterns in serum to identify ovarian cancer

2002 • 3,227 citations

A theory of the learnable

1984 • 2,968 citations

Nonparametric Statistical Methods.

1974 • 2,964 citations

A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation

1983 • 2,903 citations

Essential Medical Statistics

2014 • 2,828 citations

An algorithm for drawing general undirected graphs

1989 • 2,688 citations

Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer

2005 • 2,658 citations

Adaptive Control Processes

1961 • 2,548 citations

Multivariate Statistical Methods: A Primer.

1996 • 2,508 citations

Principles of data mining

2001 • 2,490 citations

Pharmacogenomics: Translating Functional Genomics into Rational Therapeutics

1999 • 2,458 citations

Design and Analysis of Experiments

2000 • 2,370 citations

Comparative assessment of large-scale data sets of protein–protein interactions

2002 • 2,357 citations

Multivariate calibration

1990 • 2,323 citations

Evolutionary Algorithms for Solving Multi-Objective Problems

2002 • 2,288 citations

Adaptive Control Processes: A Guided Tour.

1962 • 2,271 citations

An Introduction to Medical Statistics.

1931 • 2,220 citations

Machine Learning, Neural and Statistical Classification

1995 • 2,125 citations

The Visual Display of Quantitative Information.

1990 • 2,030 citations

Evolutionary Algorithms for Multiobjective Optimization: Methods and Applications

1999 • 1,941 citations

Nonlinear Regression

1989 • 1,846 citations

Replication validity of genetic association studies

2001 • 1,845 citations

The Visual Display of Quantitative Information.

1984 • 1,815 citations

Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models

2005 • 1,796 citations

Statistical Methods in Diagnostic Medicine

2011 • 1,772 citations

Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models

2004 • 1,764 citations

Identifying differentially expressed genes using false discovery rate controlling procedures

2003 • 1,741 citations

Protein biomarker discovery and validation: the long and uncertain path to clinical utility

2006 • 1,729 citations

Assessing the Probability That a Positive Report is False: An Approach for Molecular Epidemiology Studies

2004 • 1,720 citations

Principles of Data Mining

2002 • 1,713 citations

Problems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests

1978 • 1,699 citations

Signal detection theory and ROC analysis

1975 • 1,689 citations

How to Solve It: Modern Heuristics

2004 • 1,684 citations

Bayesian Networks and Decision Graphs

2001 • 1,683 citations

Visualizing Data

1993 • 1,658 citations

Taverna: a tool for the composition and enactment of bioinformatics workflows

2004 • 1,640 citations

A Bayesian framework for the analysis of microarray expression data: regularized t -test and statistical inferences of gene changes

2001 • 1,622 citations

Causality: Models, Reasoning, and Inference

2001 • 1,599 citations

Subset Selection in Regression

2003 • 1,542 citations

Practical Nonparametric Statistics

1981 • 1,437 citations

The elements of graphing data

1985 • 1,416 citations

Contradicted and Initially Stronger Effects in Highly Cited Clinical Research

2005 • 1,394 citations

Statistical modeling: The two cultures

2001 • 1,391 citations

Chemometrics: Data Analysis for the Laboratory and Chemical Plant

2003 • 1,370 citations

Statistics with Confidence: Confidence Intervals and Statistical Guidelines.

1990 • 1,355 citations

Fundamental Concepts in the Design of Experiments

2000 • 1,310 citations

Understanding the control of metabolism

1997 • 1,265 citations

The Regulation of Cellular Systems

1996 • 1,232 citations

Systematic functional analysis of the yeast genome

1998 • 1,213 citations

A Heuristic for Graph Drawing

1984 • 1,184 citations

Multiobjective Evolutionary Algorithms: Analyzing the State-of-the-Art

2000 • 1,178 citations

Heuristics of instability and stabilization in model selection

1996 • 1,136 citations

Principles of Multivariate Analysis, A User's Perspective.

1989 • 1,111 citations

An open graph visualization system and its applications to software engineering

2000 • 1,108 citations

Cause and Correlation in Biology: A User's Guide to Path Analysis, Structural Equations and Causal Inference

2009 • 1,100 citations

Statistical Methods in Diagnostic Medicine

2002 • 1,090 citations

Model Uncertainty, Data Mining and Statistical Inference

1995 • 1,071 citations

Probabilistic Sensitivity Analysis of Complex Models: A Bayesian Approach

2004 • 1,069 citations

A functional genomics strategy that uses metabolome data to reveal the phenotype of silent mutations

2001 • 1,008 citations

Computer systems that learn: classification and prediction methods from statistics, neural nets, machine learning, and expert systems

1991 • 916 citations

How to Solve It: Modern Heuristics

2000 • 904 citations

Identification and Review of Sensitivity Analysis Methods

2002 • 897 citations

Computational cluster validation in post-genomic data analysis

2005 • 896 citations

Statistical tests for differential expression in cDNA microarray experiments

2003 • 894 citations

Multivariate Statistical Methods: A Primer

1997 • 866 citations

Statistical Evidence: A Likelihood Paradigm

1998 • 864 citations

Introduction to Graphical Modelling

2000 • 853 citations

Epidemiology: Study Design and Data Analysis

2006 • 830 citations

Scientific Discovery

1987 • 816 citations

Semi-Supervised Support Vector Machines

1998 • 809 citations

Chemometrics

2003 • 764 citations

Moving towards individualized medicine with pharmacogenomics

2004 • 762 citations

Systematic reviews in health care: Systematic reviews of evaluations of prognostic variables

2001 • 759 citations

An Evolutionary Approach to Multiobjective Clustering

2007 • 704 citations

Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer

2006 • 702 citations

Empirical bayes methods and false discovery rates for microarrays

2002 • 679 citations

A Gene Expression Map for Caenorhabditis elegans

2001 • 674 citations

Machine learning and data mining

1999 • 658 citations

Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments

2004 • 632 citations

Subset Selection in Regression

1990 • 610 citations

Genetic associations in large versus small studies: an empirical assessment

2003 • 595 citations

Intelligent Engineering Systems through Artificial Neural Networks

2009 • 594 citations

Predictive Data Mining: A Practical Guide

1997 • 590 citations

The Grammar of Graphics

1999 • 576 citations

Subset Selection in Regression.

1991 • 572 citations

Statistical Evidence: A Likelihood Paradigm

1998 • 559 citations

Some recent developments in PLS modeling

2001 • 524 citations

Here is the evidence, now what is the hypothesis? The complementary roles of inductive and hypothesis‐driven science in the post‐genomic era

2003 • 522 citations

Metabolomics and systems biology: making sense of the soup

2004 • 521 citations

Foundations of Fuzzy Systems

1994 • 511 citations

Discovering Data Mining: From Concept to Implementation

1997 • 506 citations

Rules of evidence for cancer molecular-marker discovery and validation

2004 • 495 citations

Bias as a threat to the validity of cancer molecular-marker research

2005 • 483 citations

Fuzzy models for pattern recognition : methods that search for structures in data

1992 • 483 citations

Why Most Published Research Findings Are False

2019 • 483 citations

TAMBIS: Transparent Access to Multiple Bioinformatics Information Sources

2000 • 468 citations

Artificial Neural Networks: Approximation and Learning Theory

1992 • 454 citations

VARIATION OF SENSITIVITY, SPECIFICITY, LIKELIHOOD RATIOS AND PREDICTIVE VALUES WITH DISEASE PREVALENCE

1997 • 452 citations

Data mining

1996 • 450 citations

Foundations of Fuzzy Systems

1994 • 423 citations

Pharmacogenomics: The Inherited Basis for Interindividual Differences in Drug Response

2001 • 420 citations

Metabolic footprinting and systems biology: the medium is the message

2005 • 420 citations

Measuring diagnostic and predictive accuracy in disease management: an introduction to receiver operating characteristic (ROC) analysis

2006 • 403 citations

Analysis of Serum Proteomic Patterns for Early Cancer Diagnosis: Drawing Attention to Potential Problems

2004 • 403 citations

Microarray Biochip Technology

2000 • 402 citations

Machine Learning and Data Mining; Methods and Applications

1998 • 399 citations

Metabolic Profiling: Its Role in Biomarker Discovery and Gene Function Analysis

2003 • 386 citations

Hierarchical metabolomics demonstrates substantial compositional similarity between genetically modified and conventional potato crops

2005 • 385 citations

Book review: Machine Learning, Neural and Statistical Classification Edited by D. Michie, D.J. Spiegelhalter and C.C. Taylor (Ellis Horwood Limited, 1994)

1996 • 379 citations

Chemogenomic profiling on a genome-wide scale using reverse-engineered gene networks

2005 • 347 citations

Reducing Local Optima in Single-Objective Problems by Multi-objectivization

2001 • 343 citations

Computational learning theory

1992 • 334 citations

Experimental Design: A Chemometric Approach

1989 • 333 citations

Early extreme contradictory estimates may appear in published research: The Proteus phenomenon in molecular genetics research and randomized trials

2005 • 329 citations

ROC Curves in Clinical Chemistry: Uses, Misuses, and Possible Solutions

2004 • 329 citations

Likelihood

1992 • 328 citations

Predictive ability of DNA microarrays for cancer outcomes and correlates: an empirical assessment

2003 • 326 citations

Parallel analysis of transcript and metabolic profiles: a new approach in systems biology

2003 • 320 citations

Statistics: A Bayesian Perspective

1995 • 316 citations

Observing and interpreting correlations in metabolomic networks

2003 • 311 citations

A review on design, modeling and applications of computer experiments

2006 • 305 citations

Multiobjective Optimization in Bioinformatics and Computational Biology

2007 • 297 citations

Genetic algorithms as a method for variable selection in multiple linear regression and partial least squares regression, with applications to pyrolysis mass spectrometry

1997 • 291 citations

Metabolic control analysis in drug discovery and disease

2002 • 288 citations

Range of serum cholesterol values in the population developing coronary artery disease

1995 • 287 citations

Metabolomics: from pattern recognition to biological interpretation

2005 • 283 citations

The origin of correlations in metabolomics data

2005 • 265 citations

Genetic Programming and Data Structures

1998 • 264 citations

Quantitative noise analysis for gene expression microarray experiments

2002 • 257 citations

Epidemiology: Study Design and Data Analysis

2000 • 253 citations

Multiplicity Considerations in the Design and Analysis of Clinical Trials

1996 • 250 citations

Transparent access to multiple bioinformatics information sources

2001 • 249 citations

Statistics: A Bayesian Perspective

1997 • 248 citations

Fuzzy Sets and Fuzzy Decision-Making

1995 • 241 citations

System Modeling in Cellular Biology: From Concepts to Nuts and Bolts

2007 • 240 citations

Review: On the analysis and interpretation of correlations in metabolomic data

2006 • 233 citations

The Elements of Graphing Data.

1995 • 230 citations

Evidence and scientific research.

1988 • 224 citations

The parsimony principle applied to multivariate calibration

1993 • 221 citations

Metabolic Profiles: Gas-Phase Methods for Analysis of Metabolites

1971 • 219 citations

Identification by Gas Chromatography-Mass Spectrometry of 150 Compounds in Propolis

1991 • 213 citations

Metabolic control theory: its role in microbiology and biotechnology

1986 • 186 citations

Outcome selection bias in meta-analysis

2005 • 183 citations

Statistical false positive or true disease pathway?

2006 • 182 citations

Visualizing plant metabolomic correlation networks using clique–metabolite matrices

2001 • 180 citations

Proton NMR analysis of plasma is a weak predictor of coronary artery disease

2006 • 179 citations

Genetic algorithms in wavelength selection: a comparative study

1994 • 172 citations

The Grammar of Graphics

1999 • 170 citations

Understanding and using genetic algorithms Part 2. Representation, configuration and hybridization

1994 • 169 citations

The relation between treatment benefit and underlying risk in meta-analysis

1996 • 167 citations

Genetic algorithm optimization for pre-processing and variable selection of spectroscopic data

2004 • 166 citations

Explaining the high mutation rates of cancer cells to drug and multidrug resistance by chromosome reassortments that are catalyzed by aneuploidy

2000 • 163 citations

Statistical Inference

2002 • 163 citations

A metabolome pipeline: from concept to data to knowledge

2005 • 162 citations

Fundamental Concepts in the Design of Experiments

2000 • 162 citations

Sequential Trials, Sequential Analysis and the Likelihood Principle

1966 • 161 citations

Wavelet Denoising of Infrared Spectra

1997 • 161 citations

Genetic programming and data structures: Genetic programming + data structures = automatic programming

1999 • 157 citations

The Central Role of Receiver Operating Characteristic (ROC) Curves in Evaluating Tests for the Early Detection of Cancer

2003 • 154 citations

Modelling biological processes using workflow and Petri Net models

2002 • 153 citations

Closed-Loop, Multiobjective Optimization of Analytical Instrumentation: Gas Chromatography/Time-of-Flight Mass Spectrometry of the Metabolomes of Human Serum and of Yeast Fermentations

2004 • 151 citations

Metabolomics, modelling and machine learning in systems biology – towards an understanding of the languages of cells

2006 • 150 citations

Combinatorial Library Design Using a Multiobjective Genetic Algorithm

2002 • 148 citations

Comparison of Eight Computer Programs for Receiver-Operating Characteristic Analysis

2003 • 143 citations

Genomic Biology

2000 • 143 citations

Cholesterol measures to identify and treat individuals at risk for coronary heart disease

2003 • 142 citations

Evolutionary Multiobjective Clustering

2004 • 132 citations

Matrix method for determining steps most rate‐limiting to metabolic fluxes in biotechnological processes

1987 • 125 citations

The Ensembl Analysis Pipeline

2004 • 124 citations

Multiobjective Optimization: Behavioral and Computational Considerations

1992 • 122 citations

Novel biomarkers for pre-eclampsia detected using metabolomics and machine learning

2005 • 121 citations

A note on using permutation-based false discovery rate estimates to compare different analysis methods for microarray data

2005 • 120 citations

Sample size for FDR-control in microarray data analysis

2005 • 116 citations

Experimental Design: A Chemometric Approach

1994 • 114 citations

Variable Selection in Discriminant Partial Least-Squares Analysis

1998 • 113 citations

Collateral missing value imputation: a new robust missing value estimation algorithm for microarray data

2005 • 106 citations

Further investigation on a comparative study of simulated annealing and genetic algorithm for wavelength selection

1995 • 103 citations

Data Mining Cookbook

2002 • 96 citations

On the optimization of classes for the assignment of unidentified reading frames in functional genomics programmes: the need for machine learning

2000 • 95 citations

Matrix method for determining steps most rate‐limiting to metabolic fluxes in biotechnological processes

2009 • 93 citations

Multiobjective Optimization on a Budget of 250 Evaluations

2005 • 93 citations

Are statins analogues of vitamin D?

2006 • 93 citations

Genomic Computing. Explanatory Analysis of Plant Expression Profiling Data Using Machine Learning

2001 • 91 citations

GMP — good modelling practice: an essential component of good manufacturing practice

1995 • 89 citations

Taverna/myGrid: Aligning a Workflow System with the Life Sciences Community

2007 • 89 citations

Analysis of mass spectral serum profiles for biomarker selection

2005 • 87 citations

Bradford Hill's Principles of Medical Statistics.

1992 • 81 citations

Inference in Bayesian networks

2006 • 80 citations

Application of high-throughput Fourier-transform infrared spectroscopy in toxicology studies: contribution to a study on the development of an animal model for idiosyncratic toxicity

2003 • 79 citations

Inference in Bayesian Networks

2010 • 77 citations

Genotype–phenotype mapping: genes as computer programs

2002 • 74 citations

Classification of human cancer cells by means of capillary gas chromatography and pattern recognition analysis

1981 • 71 citations

Introduction to Graphical Modeling

2001 • 69 citations

Missing-value estimation using linear and non-linear regression with Bayesian gene selection

2003 • 67 citations

Epidemiology: Study Design and Data Analysis

2000 • 67 citations

Predictive Data Mining

2009 • 63 citations

Semi-Supervised Learning with Trees

2003 • 61 citations

Information Retrieval

2004 • 60 citations

Algorithmic Learning

1994 • 59 citations

Metabolomics and machine learning: explanatory analysis of complex metabolome data using genetic programming to produce simple, robust rules.

2002 • 58 citations

Rejoinder by the Author

1965 • 58 citations

Untitled

2002 • 56 citations

Peer Reviewed: Learning Optimization From Nature: Genetic Algorithms and Simulated Annealing

1997 • 51 citations

Quantitative Analysis of Multivariate Data Using Artificial Neural Networks: A Tutorial Review and Applications to the Deconvolution of Pyrolysis Mass Spectra

1996 • 49 citations

Comparative genomic assessment of novel broad‐spectrum targets for antibacterial drugs

2004 • 49 citations

Multiobjective Heuristic Search

1999 • 47 citations

The Role of Modeling in Systems Biology

2006 • 41 citations

Multiplicity-Adjusted Sample Size Requirements

2004 • 41 citations

myGrid and the drug discovery process

2004 • 40 citations

Model selection methodology in supervised learning with evolutionary computation

2003 • 40 citations

Functional genomics: Learning to think about gene expression data

1999 • 37 citations

A medical bioinformatics approach for metabolic disorders: Biomedical data prediction, modeling, and systematic analysis

2005 • 34 citations

Associating phenotypes with molecular events: recent statistical advances and challenges underpinning microarray experiments

2005 • 32 citations

The Role of Modeling in Systems Biology

2006 • 28 citations

Neural Networks for Chemists. Von J. Zupan und J. Gasteiger. VCH Verlagsgesellschaft mbH 1993. 305 S., mit zahlr. Abb. und Tab., geb., DM 68,–.

1994 • 28 citations

Semi-supervised feature selection via multiobjective optimization

2006 • 26 citations

springScape: visualisation of microarray and contextual bioinformatic data using spring embedding and an ‘information landscape’

2006 • 26 citations

The left hand of creation: the origin and evolution of the expanding universe

1994 • 24 citations

Web services and workflow management for biological resources

2005 • 21 citations

ROC Curves for Classification Trees

1994 • 20 citations

Evolutionary Computation for the Interpretation of Metabolomic Data

2003 • 18 citations

Gene functional classification by semi-supervised learning from heterogeneous data

2003 • 18 citations

Mass spectrometric profiling and pattern recognition

1994 • 14 citations

The data handbook (2nd ed.): a guide to understanding the organization and visualization of technical data

1995 • 7 citations

The data handbook

1992 • 3 citations

The Data Handbook

1995 • 3 citations

Deleted Work

1955 • 0 citations