massive simulations of the complete evolution of a physical system – repeated many times over, as parameters of the simulation are varied systematically.

data mining for subtle patterns in vast databases and.

In ﬁeld after ﬁeld, ambitious projects involving large-scale computations are being launched daily.

1 Department of Statistics, Stanford University, Stanford, CA 94305 2 Apple Computer, Cupertino, CA 3 Berkman Center for Internet and Society, Harvard Law School, Cambridge, MA 02138 4, 5, 6, 7, 8 1 The Crisis Massive computation is transforming science. In this article, we review our approach, how the approach has spread over time, and how science funding agencies could help spread the idea more rapidly. We have been practicing reproducible computational research for 15 years and integrated it with our scientiﬁc research, and with doctoral and postdoctoral education. Reproducible computational research, in which the full computational envi- ronment that produces a result is published along with the article, is an important recent development, and a necessary response to this crisis. Un- fortunately, it is error-prone and currently immature: traditional scientiﬁc publication is incapable of ﬁnding and rooting out errors in scientiﬁc computation this must be recognized as a crisis. 15 Years of Reproducible Research in Computational Harmonic Analysis David Donoho 1, 4 Arian Maleki 1, 5 Inam Rahman 2, 6 Morteza Shahram 1, 7 Victoria Stodden 3, 8 ApAbstract Scientiﬁc Computation is emerging as absolutely central to the scientiﬁc method.

Wavelab 10.5