Open statistical issues in particle physics

Annals of Applied Statistics

Volumn 2, Issue 3, 2008, Pages 887-915

  Lyons, Louis ^a  

^a NONE

Author keywords

Blind analysis; Combining results; Goodness of fit; Hypothesis testing; Nuisance parameters; P values; Parameter determination; Particle physics; Signal background separation; Upper limits

Indexed keywords

EID: 59349101986     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/08-AOAS163     Document Type: Article

References (57)

1. Aslan, B. and Zech, G. (2004). A multivariate two-sample test based on the concept of minimum energy. J. Stat. Comp. Simul. 75 109
2. Aslan, B. and Zech, G. (2005). Statistical energy as a tool for binning-free multivariate goodness of fit tests, two-sample comparison and unfolding. Nuclear Instruments and Methods A537 626
3. Belikov, J. (2007). ALICE statistical wish-list. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/
4. CDF Statistics Committee (2007). Frequently asked questions. Available at http://www-cdf.fnal.gov/physics/statistics/statistics_faq.html#iptn4
5. Cheung, H. and Lyons, L. (2000). FNAL confidence limits workshop. Available at http://conferences.fnal.gov/CLW/
6. Cousins, R. (1998). Improved central confidence intervals for the ratio of Poisson means. Nuclear Instruments and Methods A417 391-399.
7. Cousins, R. (2007). Annotated bibliography on some papers on combining significances or p-values. Available at arXiv:0705.2209.
8. Cousins, R. D. and Highland, V. L. (1992). Incorporating systematic uncertainties into an upper limit. Nuclear Instruments and Methods A320 331
9. Cox, D. R. (1958). Some problems connected with statistical inference. Ann. Math. Statist. 29 357-372.
10. Cranmer, K. (2007). Progress, challenges and future of statistics at the LHC. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
11. Cuadras, C. M., Fortiana, J. and Oliva, F. (1997). The proximity of an individual to a population with applications to discriminant analysis. J. Classification 14 117-136.
12. Cuadras, C. M. and Fortiana, J. (2003). Distance-based multivariate two sample tests. Available at http://www.imub.ub.es/publications/preprints/pdf/Cuadras-Fortiana.334.pdf
13. Demortier, L. (2005). Bayesian reference analysis. Available at http://www.physics.ox.ac.uk/phystat05/proceedings/files/demortier-refana.ps
14. Demortier, L. (2006). Setting the scene for p-values. Available at www.birs.ca/workshops/2006/06w5054/report06w5054.pdf
15. Demortier, L. (2007). P-values and nuisance parameters. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
16. Drton, M. (2007). Likelihood ratio tests and singularities. Available at http://front.math.ucdavis.edu/0703.5360
17. Feldman, G. J. and Cousins, R. D. (1998). Unified approach to the classical statistical analysis of small signals. Phys. Rev. D 57 3873-3889.
18. Friedman, J. H. (2003). Recent advances in predictive (machine) learning. Available at http://www-stat.stanford.edu/~jhf/ftp/machine.pdf
19. Friedman, J. H. (2005). Separating signal from background using ensembles of rules. Available at http://www.physics.ox.ac.uk/phystat05/proceedings/files/friedman_phystat.pdf
20. Gross, E. (2007). ATLAS and CMS statistical wish-list. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
21. Heinrich, J. (2003a). Coverage of error bars for Poisson data. Available at http://www-cdf.fnal.gov/publications/cdf6438_coverage.pdf
22. Heinrich, J. (2003b). Pitfalls of goodness-of-fit from likelihood. Available at http://www.slac.stanford.edu/econf/C030908/papers/MOCT001.pdf
23. Heinrich, J. (2005). The Bayesian approach to setting limits: What to avoid. Available at http://www.physics.ox.ac.uk/phystat05/proceedings/files/heinrich.ps
24. Heinrich, J. (2007). Review of Banff challenge on upper limits. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
25. Heinrich, J. and Lyons, L. (2007). Systematic errors. Annual Reviews of Nuclear and Particle Science 57 145-169.
26. Heinrich, J. et al. (2004). Interval estimation in the presence of nuisance parameters. 1. Bayesian approach. CDF Note 7117. Available at http://www-cdf.fnal.gov/publications/cdf7117_bayesianlimit.pdf
27. Höcker, A. et al. (2007). TMVA-Toolkit for multivariate data analysis. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
28. James, F., Lyons, L. and Perrin, Y. (2000). Workshop on confidence limits. CERN Yellow Report 2000-05. http://documents.cern.ch/cgi-bin/setlink?base=cernrep&categ=Yellow_Report&id=2000-005#top.
29. Klein, J. R. and Roodman, A. (2005). Blind analysis in nuclear and particle physics. Annual Review of Nuclear and Particle Physics 55 141
30. Linnemann, J. (2007). A pitfall in evaluating systematic errors. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
31. Lyons, L. (1999). Comparing two hypotheses. Available at http://www-cdf.fnal.gov/physics/statistics/statistics_recommendations.html
32. Lyons, L. (2008). Supplement to "Open statistical issues in particle physics." DOI: 10.1214/08-AOAS163SUPP.
33. Lyons, L., Martin, A. and Saxon, D. (1990). On the determination of the B lifetime by combining the results of different experiments. Phy. Rev. D 41 982.
34. Lyons, L., Mount, R. and Reitmeyer, R., eds. (2003). PHYSTAT 20003. eConf C030908, SLAC-R-703. Available at http://www.slac.stanford.edu/econf/C030908/proceedings.html
35. Lyons, L. and Ünel, M. K. (2005). Statistical problems in particle physics, astrophysics and cosmology. Imperial College Press, London. Available at http://www.physics.ox.ac.uk/phystat05/
36. Narsky, I. (2000). Comparison of upper limits. Available at http://conferences.fnal.gov/cl2k/copies/inarsky.pdf
37. Narsky, I. (2006). StatPatternRecognition: A C++ package for multi-variate classification. Available at http://www.hep.caltech.edu/~narsky/SPR/SPR_narsky_chep2006.pdf
38. Neal, R. (2007). Computing likelihood functions when distributions are defined by simulators with nuisance parameters. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
39. Nicolo, D. and Signorelli, G. (2002). Application of strong confidence to the CHOOZ experiment with frequentist inclusion of nuisance parameters. Available at http://www.ippp.dur.ac.uk/old/Workshops/02/statistics/proceedings/signorelli.pdf
40. Particle Data Group (2006). J. Phys. G: Nucl. Part. Phys. 33 1 (see page 14).
41. Prosper, H. B. (2002). Multivariate analysis: A unified perspective. Available at www.ippp.dur.ac.uk/Workshops/02/statistics/papers/prosper_HBPDurham2002.ppt
42. Prosper, H. B., Lyons, L. and De Roeck, A. (2007). PHYSTAT-LHC Workshop at CERN on Statistical Issues for LHC Physics. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
43. Protassov, R. et al. (2002). Statistics: Handle with care. Detecting multiple model components with the likelihood ratio test. Astrophysics J. 571 545-559.
44. Punzi, G. (2003). Sensitivity of searches for new signals and its optimization. Available at http://www.slac.stanford.edu/econf/C030908/papers/MODT002.pdf
45. Punzi, G. (2005). Ordering algorithms and confidence intervals in the presence of nuisance parameters. Available at http://www.physics.ox.ac.uk/phystat05/proceedings/files/Punzi_PHYSTAT05_final.pdf
46. Read, A. L. (2000). Modified frequentist analysis of search results (the CLs method). Available at http://doc.cern.ch/archive/electronic/cern/preprints/open/open-2000-205.pdf
47. Read, A. L. (2004). Presentation of search results-the CLs method. J. Phys. G: Nucl. Part. Phys. 28 2693-2704.
48. Reid, N. (2007). Some aspects of design of experiments. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf
49. Reid, N., Linnemann, J. and Lyons, L. (2006). Workshop on statistical inference problems in high energy physics and astronomy. Available at http://www.birs.ca/birspages.php?task=displayevent&event_id=06w5054
50. Roe, B. P. (2007). Statistical errors in Monte Carlo estimates of systematic errors. Nuclear Instruments and Methods A570 159-164.
51. Rolke, W. A., Lopez, A. M. and Conrad, J. (2005). Limits and confidence intervals in the presence of nuisance parameters. Nuclear Instruments and Methods A551 493-503.
52. Self, S. G. and Liang, K. Y. (1987). Asymptotic properties of maximum likelihood estimators and likelihood ratio test under non-standard conditions. J. Amer. Statist. Assoc. 82 605-610.
53. Sen, B., Walker, M. and Woodroofe, M. (2008). On the unified method with nuisance parameters. Statist. Sinica. To appear.
54. Trotta, R. (2008). Bayes in the sky: Bayesian inference and model selection in cosmology. Contemporary Physics 49 71-104.
55. Whalley, M. and Lyons, L., eds. (2002). Advanced statistical techniques in particle physics, Durham IPPP/02/39. Available at http://www.ippp.dur.ac.uk/old/Workshops/02/statistics/proceedings.shtml
56. Wilks, S. S. (1938). The large-sample distribution of the likelihood ratio for testing composite hypotheses. Ann. Math. Statist. 9 60-62.
57. Xie, Y. (2007). LHCb statistical wishlist. Available at http://phystat-lhc.web.cern.ch/phystat-lhc/2008-001.pdf