Setting a standard for electricity pilot studies

Energy Policy

Volumn 62, Issue , 2013, Pages 401-409

  Davis, Alexander L ^a   Krishnamurti, Tamar ^a   Fischhoff, Baruch ^a   Bruine de Bruin, Wandi ^a,b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b UNIVERSITY OF LEEDS   (United Kingdom)

Author keywords

Dynamic pricing; In home display; Smart thermostat

Indexed keywords

ATTRITION RATE; AUTOMATED DEVICE; DYNAMIC PRICING; ELECTRICITY USE; GENERAL POPULATION; HOME AUTOMATION; METHODOLOGICAL PROBLEMS; RESIDENTIAL ELECTRICITY;

DISPLAY DEVICES; ESTIMATION;

ELECTRICITY;

ELECTRICITY GENERATION; ENERGY EFFICIENCY; META-ANALYSIS; PRICE DYNAMICS; STANDARD (REGULATION);

CANADA; UNITED STATES;

EID: 84884975786     PISSN: 03014215     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.enpol.2013.07.093     Document Type: Article

References (81)

1. Abrahamse W., Steg L., Vlek C., Rothengatter T. A review of intervention studies aimed at household energy conservation. Journal of Environmental Psychology 2005, 25(3):273-291.
2. Allen, D., Janda, K., 2006. The effects of household characteristics and energy use consciousness on the effectiveness of real-time energy use feedback: a pilot study. In: Proceedings of the American Council for an Energy-Efficient Economy Summer Study on Energy Efficiency in Buildings, pp. 7.1-7.12.
3. Altman D., Bland J. Statistics notes. how to randomise. British Medical Journal 1999, 319(7211):703-704.
4. Altman D., Bland J. Treatment allocation in controlled trials. why randomise?. British Medical Journal 1999, 318(7192):1209.
5. Baladi M., Herriges J., Sweeney T. Residential response to voluntary time-of-use electricity rates. Resource and Energy Economics 1998, 20(3):225-244.
6. Barclay S., Todd C., Finlay I., Grande G., Wyatt P. Not another questionnaire! Maximizing the response rate, predicting non-response and assessing non-response bias in postal questionnaire studies of GPs. Family Practice 2002, 19(1):105-111.
7. Battalio R., Kagel J., Winkler R., Winett R. Residential electricity demand. an experimental study. The Review of Economics and Statistics 1979, 61(2):180-189.
8. Bland J., Altman D. Statistics notes. the odds ratio. British Medical Journal 2000, 320(7247):1468.
9. Borenstein, S., Jaske, M., Rosenfeld, A., 2002. Dynamic Pricing, Advanced Metering, and Demand Response in Electricity Markets. Technical Report, University of California Energy Institute UC Berkeley.
10. Brennan R., Prediger D. Coefficient kappa. some uses, misuses, and alternatives. Educational and Psychological Measurement 1981, 41(3):687-699.
11. Callahan C., Hojat M., Gonnella J. Volunteer bias in medical education research. an empirical study of over three decades of longitudinal data. Medical Education 2007, 41(8):746-753.
12. Carleton R., Sanders C., Burack W. Heparin administration after acute myocardial infarction. New England Journal of Medicine 1960, 263(20):1002-1005.
13. CRA, 2005. Impact evaluation of the California Statewide Pricing Pilot. Technical report, Charles River Associates (CRA).
14. Davis A., Krishnamurti T. The problems and solutions of predicting participation in energy efficiency programs. Applied Energy 2013, 111:277-287.
15. Deeks J., Dinnes J., D'Amico R., Sowden A., Sakarovitch C., Song F., Petticrew M., Altman D. Evaluating non-randomised intervention studies. Health Technology Assessment 2003, 7(27):1-179.
16. Dobson, J., Griffin, J., 1992. Conservation effect of immediate electricity cost feedback on residential consumption behavior. In: Proceedings of the 7th American Council for an Energy-Efficient Economy Summer Study on Energy Efficiency in Buildings, pp. 10.33-10.35.
17. Eiden, J., 2009. Investigation into the Effects of Real-time, In-home Feedback to Conserve Energy in Residential Applications. Masters Thesis, University of Nebraska-Lincoln, unpublished.
18. Faruqui, A., Hledik, R., George, S., Bode, J., Mangasarian, P., Rohmund, I., Wikler, G., Ghosh, D., Yoshida, S., 2009. A National Assessment of Demand Response Potential. Technical Report, Government Printing Office, Washington, DC.
19. Faruqui, A., Sergici, 2009a. Connecticut Light and Power (CL&P) Impact Evaluation of CL&P's Plan-it-Wise energy program. Technical Report, Connecticut Light and Power and The Brattle Group.
20. Faruqui, A., Sergici, S., 2009b. BG&E Smart Energy Pricing Pilot (SEPP). Technical Report, Baltimore Gas and Electric Company and The Brattle Group.
21. Fischer C. Feedback on household electricity consumption. a tool for saving energy?. Energy Efficiency 2008, 1(1):79-104.
22. Frank, S., 2008. Hydro One Networks Inc. Time-of-use Pricing Pilot Project Results. Technical Report, Hydro One Networks Inc.
23. Gelman A., Hill J. Data Analysis Using Regression and Multilevel/Hierarchical Models 2007, Cambridge University Press, New York, NY.
24. George, S., Bode, J., Hartmann, B., 2011. PG&E Load Impact Evaluation of Pacific Gas and Electric Company's Time-based Pricing Tariffs. Technical Report, Freeman, Sullivan & Co. and Pacific Gas and Electric Company.
25. Grady D., Herrington D., Bittner V., Blumenthal R., Davidson M., Hlatky M., Hsia J., Hulley S., Herd A., Khan S., Newby L., Waters D., Vittinghoff E., Wenger N. Cardiovascular disease outcomes during 6.8years of hormone therapy. Journal of the American Medical Association 2002, 288(1):49-57.
26. Hammerstrom, D., Ambrosio, R., Carlon, T., DeSteese, J., Horst, G., Kajfasz, R., Kiesling, L., Michie, P., Pratt, R., Yao, M., Brous, J., Chassin, D., Guttromson, R., Jarvegren, O., Katipamula, S., Le, N., Oliver, T., Thompson, S., 2007. Pacific Northwest Gridwise Testbed Demonstration Projects. Part I. Olympic Peninsula Project. Technical Report, Pacific Northwest National Laboratory.
27. Hartling L., Bond K., Vandermeer B., Seida J., Dryden D., Rowe B. Applying the risk of bias tool in a systematic review of combination long-acting beta-agonists and inhaled corticosteroids for persistent asthma. PloS One 2011, 6(2):e17242.
28. Heckman J. Sample selection bias as a specification error. Econometrica 1979, 47(1):153-161.
29. Hedges L., Vevea J. Fixed- and random-effects models in meta-analysis. Psychological Methods 1998, 3(4):486-504.
30. Higgins, J., Altman, D., Sterne, J., 2011. Assessing risk of bias in included studies. In: Higgins, J., Green, S., (Eds.), Cochrane Handbook for Systematic Reviews of Interventions (5.1.0). Cochrane Reviews (Chapter 8). Available from http://www.cochrane-handbook.org.
31. Hollis S., Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. British Medical Journal 1999, 319(7211):670-674.
32. Hutton R., Mauser G., Filiatrault P., Ahtola O. Effects of cost-related feedback on consumer knowledge and consumption behavior. a field experimental approach. Journal of Consumer Research 1986, 13(3):327-336.
33. Ibrahim J., Chen M., Lipsitz S., Herring A. Missing-data methods for generalized linear models. Journal of the American Statistical Association 2005, 100(469):332-346.
34. Ioannidis J. Commentary. adjusting for bias: a user's guide to performing plastic surgery on meta-analyses of observational studies. International Journal of Epidemiology 2011, 40(3):777-779.
35. Junghans C., Feder G., Hemingway H., Timmis A., Jones M. Recruiting patients to medical research. double blind randomised trial of "opt-in" versus "opt-out" strategies. British Medical Journal 2005, 331(7522):940-948.
36. Jüni P., Altman D., Egger M. Systematic reviews in health care. assessing the quality of controlled clinical trials. British Medical Journal 2001, 323(7303):42-46.
37. Karlowski T., Chalmers T., Frenkel L., Kapikian A., Lewis T., Lynch J. Ascorbic acid for the common cold. Journal of the American Medical Association 1975, 231(10):1038-1042.
38. KEMA 2006. SDG&E Smart Thermostat Program Impact Evaluation. Technical Report, San Diego Gas and Electric Company and KEMA.
39. King, C., 2010. PowerCents DC Program Final Report. Technical report, Potomac Electric Power Company and eMeter Strategic Consulting.
40. Kjaergard L., Villumsen J., Gluud C. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Annals of Internal Medicine 2001, 135(11):982-989.
41. Kline, B., 2007. Idaho Power 2006 Analysis of the Residential Time-of-day and Energy Watch pilot Programs: Final Report. Technical Report, Idaho Power Company and RLW Analytics.
42. McClelland L., Cook S. Energy conservation effects of continuous in-home feedback in all-electric homes. Journal of Environmental Systems 1979, 9(2):169-173.
43. Miller L., Stewart M. The blind leading the blind. use and misuse of blinding in randomized controlled trials. Contemporary Clinical Trials 2011, 32(2):240-243.
44. Moher D., Hopewell S., Schulz K., Montori V., Gøtzsche P., Devereaux P., Elbourne D., Egger M., Altman D. CONSORT 2010 explanation and elaboration. updated guidelines for reporting parallel group randomised trials. Journal of Clinical Epidemiology 2010, 63:e1-e37.
45. Moher D., Pham B., Jones A., Cook D., Jadad A., Moher M., Tugwell P., Klassen T. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?. The Lancet 1998, 352(9128):609-613.
46. Neenan, B., Robinson, J., 2010. Guidelines for Designing Effective Energy Information Feedback Pilots: Research Protocols. Technical Report, Electric Power Research Institute.
47. Norton, B., 2008. PowerCost Monitor Pilot Program Evaluation. Technical Report, National Grid, NSTAR Electric, Western Massachusetts Electric Company, and Opinion Dynamics Corporation.
48. Orne M. On the social psychology of the psychological experiment. with particular reference to demand characteristics and their implications. American Psychologist 1962, 17(11):776-783.
49. Parker, D., Hoak, D., Cummings, J., 2008. Pilot Evaluation of Energy Savings from Residential Energy Demand Feedback Devices. Technical Report, Florida Solar Energy Center and the US Department of Energy.
50. Parsons H. What happened at Hawthorne?. Science 1974, 183(4128):922-932.
51. Petitti D. Hormone replacement therapy and coronary heart disease. four lessons. International Journal of Epidemiology 2004, 33(3):461-463.
52. Puckett, C., Hennessy, T., 2004. AmerenUE Residential TOU Pilot Study Load Research Analysis: First Look Results. Technical Report, RLW Analytics and AmerenUE.
53. Rosenthal R., Rosnow R. The Volunteer Subject 1975, John Wiley & Sons, Hoboken, NJ.
54. RMI, 2006. Automated Demand Response System Pilot, Final Report. Technical report, Pacific Gas & Electric, Southern California Edison, San Diego Gas & Electric, and the Rocky Mountain Institute (RMI).
55. SBC, 2006. Evaluation of the 2005 Energy-Smart Pricing Plan-Final Report. Technical Report, Community Energy Cooperative and Summit Blue Consulting (SBC).
56. SBC, 2007. Evaluation of the 2006 Energy-Smart Pricing Plan-Final Report. Technical Report, Community Energy Cooperative and Summit Blue Consulting (SBC).
57. Schembri, J., 2008. The Influence of Home Energy Management Systems on the Behaviours of Residential Electricity Consumers: An Ontario, Canada Case Study. Masters Thesis, University of Waterloo, unpublished.
58. Schulz K. Subverting randomization in controlled trials. Journal of the American Medical Association 1995, 274(18):1456-1458.
59. Schulz K. Unbiased research and the human spirit. the challenges of randomized controlled trials. Canadian Medical Association Journal 1995, 153(6):783-786.
60. Schulz K., Chalmers I., Hayes R., Altman D. Empirical evidence of bias. Journal of the American Medical Association 1995, 273(5):408-412.
61. Schulz K., Grimes D. Generation of allocation sequences in randomised trials. chance, not choice. The Lancet 2002, 359(9305):515-519.
62. Seligman C., Darley J., Becker L. Behavioral approaches to residential energy conservation. Energy and Buildings 1978, 1(3):325-337.
63. Sexton R., Johnson N., Konakayama A. Consumer response to continuous-display electricity-use monitors in a time-of-use pricing experiment. Journal of Consumer Research 1987, 14(1):55-62.
64. Shun-Shin M., Thompson M., Heneghan C., Perera R., Harnden A., Mant D. Neuraminidase inhibitors for treatment and prophylaxis of influenza in children. systematic review and meta-analysis of randomised controlled trials. British Medical Journal 2009, 339:b1372-b1381.
65. Sipe, B., Castor, S., 2009. The net impact of home energy feedback devices. In: 2009 Energy Program Evaluation Conference, Portland, pp. 341-351.
66. Spees, K., Lave, L., 2007. Impacts of responsive load in PJM load shifting and real time pricing. Carnegie Mellon Electricity Industry Center Working Paper CEIC-07-02, January 2007.
67. Spiegelhalter D., Best N. Bayesian approaches to multiple sources of evidence and uncertainty in complex cost-effectiveness modelling. Statistics in Medicine 2003, 22(23):3687-3709.
68. Strapp, J., King, C., Talbott, S., 2007. Ontario Energy Board Smart Price Pilot final report. Technical Report, Ontario Energy Board and IBM Global Business Services and eMeter Strategic Consulting.
69. Stukel T., Fisher E., Wennberg D., Alter D., Gottlieb D., Vermeulen M. Analysis of observational studies in the presence of treatment selection bias. Journal of the American Medical Association 2007, 297(3):278-285.
70. Sulyma, I., Tiedemann, K., Pedersen, M., Rebman, M., Yu, M., Power Smart, BC Hydro. 2008. Experimental evidence: a residential time of use pilot. In: American Council for an Energy-Efficient Economy Summer Study on Energy Efficiency in Buildings, pp. 292-304.
71. Thompson S., Higgins J. How should meta-regression analyses be undertaken and interpreted?. Statistics in Medicine 2002, 21(11):1559-1573.
72. Todd, A., Stuart, E., Schiller, S., Goldman, C., 2012. Evaluation, measurement, and verification (EM&V) of Residential Behavior-Based Energy Efficiency Programs: Issues and Recommendations. Technical Report, Lawrence Berkeley National Laboratory.
73. Tune G. Response preferences. a review of some relevant literature. Psychological Bulletin 1964, 61(4):286-302.
74. Turner R., Spiegelhalter D., Smith G., Thompson S. Bias modelling in evidence synthesis. Journal of the Royal Statistical Society. Series A (Statistics in Society) 2009, 172(1):21-47.
75. Tversky A., Kahneman D. Belief in the law of small numbers. Psychological Bulletin 1971, 76(2):105-110.
76. Violette, D., Erickson, J., Klos, M., 2007. Final Report for the MyPower Pricing Segments Evaluation. Technical Report, Public Service Electric and Gas Company and Summit Blue Consulting.
77. Violette, D., Provencher, B., Klos, M., Freeman, R., Steele-Mosey, P., Clark, D., Klos, D., 2010. Ameren Power Smart Pricing 2009 Annual Report. Technical Report, Ameren Illinois Utilities and Summit Blue Consulting.
78. Weisser D. A guide to life-cycle greenhouse gas (GHG) emissions from electric supply technologies. Energy 2007, 32(9):1543-1559.
79. Wolak, F., 2007. Residential Customer Response to Real-Time Pricing: The Anaheim Critical Peak Pricing Experiment. Stanford University, unpublished manuscript.
80. Wooldridge J. Econometric Analysis of Cross Section and Panel Data 2002, MIT press, Cambridge, MA.
81. Yun, T., 2009. Investigating the impact of a minimalist in-home energy consumption display. In: Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems, ACM, pp. 4417-4422.