Stochastic optimization of floating-point programs with tunable precision

Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI)

Volumn , Issue , 2014, Pages 53-64

  Schkufza, Eric ^a   Sharma, Rahul ^a   Aiken, Alex ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

64 bit; Binary; Floating point; Markov chain monte carlo; Mcmc; Precision; SMT; Stochastic search; X86; X86 64

Indexed keywords

C (PROGRAMMING LANGUAGE); COMPUTER PROGRAMMING LANGUAGES; OPTIMIZATION; PROGRAM COMPILERS; SEMANTICS; STOCHASTIC SYSTEMS; SURFACE MOUNT TECHNOLOGY;

64-BIT; BINARY; FLOATING-POINT; MARKOV CHAIN MONTE-CARLO; MCMC; PRECISION; STOCHASTIC SEARCH; X86; X86-64;

DIGITAL ARITHMETIC;

EID: 84901600670     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2594291.2594302     Document Type: Conference Paper

References (36)

1. C. Andrieu, N. de Freitas, A. Doucet, and M. I. Jordan. An introduction to MCMC for machine learning. Machine Learning, 50(1-2):5-43, 2003.
2. W. Baek and T. M. Chilimbi. Green: A framework for supporting energy-conscious programming using controlled approximation. In PLDI, pages 198-209, 2010.
3. F. Benz, A. Hildebrandt, and S. Hack. A dynamic program analysis to find floating-point accuracy problems. In PLDI, pages 453-462, 2012.
4. S. Chaudhuri, S. Gulwani, and R. Lublinerman. Continuity and robustness of programs. Commun. ACM, 55(8):107-115, 2012.
5. W.-F. Chiang, G. Gopalakrishnan, Z. Rakamaric, and A. Solovyev. Efficient search for inputs causing high floating-point errors. PPoPP '14, pages 43-52, 2014.
6. P. Collingbourne, C. Cadar, and P. H. J. Kelly. Symbolic crosschecking of floating-point and SIMD code. In EuroSys, pages 315-328, 2011.
7. C. Curtsinger and E. D. Berger. Stabilizer: Statistically sound performance evaluation. In ASPLOS, pages 219-228, 2013.
8. E. Darulova and V. Kuncak. Sound compilation of reals. In POPL, pages 235-248, 2014.
9. F. de Dinechin, C. Q. Lauter, and G. Melquiond. Certifying the floating-point implementation of an elementary function using GAPPA. IEEE Trans. Computers, 60(2):242-253, 2011.
10. L. M. de Moura, N. Bjørner, and C. M. Wintersteiger. Z3. http://z3.codeplex.com/.
11. D. Delmas, E. Goubault, S. Putot, J. Souyris, K. Tekkal, and F. Védrine. Towards an industrial use of FLUCTUAT on safetycritical avionics software. In FMICS, pages 53-69, 2009.
12. J. Geweke. Priors for macroeconomic time series and their application. Technical report, Federal Reserve Bank of Minneapolis, 1992.
13. D. Goldberg. What every computer scientist should know about floating-point arithmetic. ACM Computing Surveys, 23(1):5-48, 1991.
14. S. Gulwani, S. Jha, A. Tiwari, and R. Venkatesan. Synthesis of loop-free programs. In PLDI, pages 62-73, 2011.
15. L. Haller, A. Griggio, M. Brain, and D. Kroening. Deciding floatingpoint logic with systematic abstraction. In FMCAD, pages 131-140, 2012.
16. P. S. Heckbert, editor. Graphics gems IV. Academic Press Professional, Inc., San Diego, CA, USA, 1994.
17. F. Ivancic, M. K. Ganai, S. Sankaranarayanan, and A. Gupta. Numerical stability analysis of floating-point computations using software model checking. In MEMOCODE, pages 49-58, 2010.
18. M. Jha and S. Raskhodnikova. Testing and reconstruction of lipschitz functions with applications to data privacy. Electronic Colloquium on Computational Complexity (ECCC), pages 11-57, 2011.
19. F. Jzquel and J. M. Chesneaux. CADNA: A library for estimating round-off error propagation. Computer Physics Communications, 178 (12):933-955, 2008.
20. K. Lakhotia, N. Tillmann, M. Harman, and J. de Halleux. FloPSy - Search-based floating-point constraint solving for symbolic execution. In ICTSS, pages 142-157, 2010.
21. M. O. Lam, J. K. Hollingsworth, B. R. de Supinski, and M. P. Legendre. Automatically adapting programs for mixed-precision floating-point computation. ICS '13, pages 369-378, 2013.
22. S. Misailovic, D. M. Roy, and M. C. Rinard. Probabilistically accurate program transformations. In SAS, pages 316-333, 2011.
23. G. C. Necula and S. Gulwani. Randomized algorithms for program analysis and verification. In CAV, 2005.
24. A. Podgurski. Reliability, sampling, and algorithmic randomness. TAV4, pages 11-20, New York, NY, USA, 1991. ACM.
25. R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2008. http://www.R-project.org.
26. C. Rubio-González, C. Nguyen, H. D. Nguyen, J. Demmel, W. Kahan, K. Sen, D. H. Bailey, C. Iancu, and D. Hough. Precimonious: Tuning assistant for floating-point precision. In SC, 2013.
27. P. Rümmer and T. Wahl. An SMT-LIB theory of binary floating-point arithmetic. In SMT, 2010.
28. S. Sankaranarayanan, R. M. Chang, G. Jiang, and F. Ivancic. State space exploration using feedback constraint generation and Monte Carlo sampling. In ESEC/SIGSOFT FSE, pages 321-330, 2007.
29. E. Schkufza, R. Sharma, and A. Aiken. Stochastic superoptimization. In ASPLOS, pages 305-316, 2013.
30. R. Sharma, E. Schkufza, B. R. Churchill, and A. Aiken. Data-driven equivalence checking. In OOPSLA, pages 391-406, 2013.
31. S. Sidiroglou-Douskos, S. Misailovic, H. Hoffmann, and M. C. Rinard. Managing performance vs. accuracy trade-offs with loop perforation. In SIGSOFT FSE, pages 124-134, 2011.
32. A. Solar-Lezama, L. Tancau, R. Bod́ik, S. A. Seshia, and V. A. Saraswat. Combinatorial sketching for finite programs. In ASPLOS, pages 404-415, 2006.
33. D. Stott Parker, B. Pierce, and P. R. Eggert. Monte Carlo arithmetic: how to gamble with floating point and win. Computing in Science & Engineering, 2(4):58-68, 2000.
34. E. Tang, E. T. Barr, X. Li, and Z. Su. Perturbing numerical calculations for statistical analysis of floating-point program (in)stability. In ISSTA, pages 131-142, 2010.
35. C. W. Ueberhuber. Numerical computation: Methods, software and analysis. Springer-Verlag, 1997.
36. Z. A. Zhu, S. Misailovic, J. A. Kelner, and M. C. Rinard. Randomized accuracy-aware program transformations for efficient approximate computations. In POPL, pages 441-454, 2012.