A citywide experiment testing the impact of geographically targeted, high-pay-off vaccine lotteries.
Journal
Nature human behaviour
ISSN: 2397-3374
Titre abrégé: Nat Hum Behav
Pays: England
ID NLM: 101697750
Informations de publication
Date de publication:
11 2022
11 2022
Historique:
received:
04
11
2021
accepted:
19
07
2022
pubmed:
2
9
2022
medline:
23
11
2022
entrez:
1
9
2022
Statut:
ppublish
Résumé
Lotteries have been shown to motivate behaviour change in many settings, but their value as a policy tool is relatively untested. We implemented a pre-registered, citywide experiment to test the effects of three high-pay-off, geographically targeted lotteries designed to motivate adult Philadelphians to get their COVID-19 vaccine. In each drawing, the residents of a randomly selected 'treatment' zip code received half the lottery prizes, boosting their chances of winning to 50×-100× those of other Philadelphians. The first treated zip code, which drew considerable media attention, may have experienced a small bump in vaccinations compared with the control zip codes: average weekly vaccinations rose by an estimated 61 per 100,000 people per week (+11%). After pooling the results from all three zip codes treated during our six-week experiment, however, we do not detect evidence of any overall benefits. Furthermore, our 95% confidence interval provides a 9% upper bound on the net benefits of treatment in our study.
Identifiants
pubmed: 36050387
doi: 10.1038/s41562-022-01437-0
pii: 10.1038/s41562-022-01437-0
doi:
Substances chimiques
COVID-19 Vaccines
0
Vaccines
0
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1515-1524Informations de copyright
© 2022. The Author(s), under exclusive licence to Springer Nature Limited.
Références
Rodrigues, C. M. & Plotkin, S. A. Impact of vaccines; health, economic and social perspectives. Front. Microbiol 11, 1526 (2020).
doi: 10.3389/fmicb.2020.01526
pubmed: 32760367
pmcid: 7371956
Solís Arce, J. S. et al. COVID-19 vaccine acceptance and hesitancy in low- and middle-income countries. Nat. Med. 27, 1385–1394 (2021).
doi: 10.1038/s41591-021-01454-y
pubmed: 34272499
pmcid: 8363502
Durkee, A. Ohio’s $1 million lottery boosted vaccinations by 45%, gov. says as more states follow suit. Forbes https://www.forbes.com/sites/alisondurkee/2021/05/26/ohio-1-million-lottery-boosted-vaccinations-by-45-gov-says-as-more-states-follow-suit/?sh=151003604bbc (2021).
Steer, J. Ohio Vax-a-Million causes increase in vaccination rate, says health department. FOX8 https://fox8.com/news/coronavirus/ohio-vaccine-lottery/ohio-vax-a-million-causes-increase-in-vaccination-rate-says-health-department/ (2021).
Volpp, K. A hundred bucks or a chance at $1 million: what’s the better vaccine incentive? Washington Post https://www.washingtonpost.com/outlook/2021/05/17/vaccine-lottery-ohio-psychology-incentive/ (17 May 2021).
Waldrop, T. Others have tried free doughnuts, beers and gifts cards. Now, Ohio is betting millions to improve its vaccination rate. CNN https://www.cnn.com/2021/05/13/us/covid-vaccine-incentives/index.html (2021).
Hybrid Hearing on “Building Trust and Battling Barriers: The Urgent Need to Overcome Vaccine Hesitancy” 117th Cong. (testimony of Katherine Milkman) https://coronavirus.house.gov/subcommittee-activity/hearings/hybrid-hearing-building-trust-and-battling-barriers-urgent-need (2021).
Thirumurthy, H., Milkman, K. L., Volpp, K., Buttenheim, A. & Pope, D. G. Association between statewide financial incentive programs and COVID-19 vaccination rates. PloS one. 17, e0263425 (2021).
doi: 10.1371/journal.pone.0263425
Volpp, K. G., Asch, D. A., Galvin, R. & Loewenstein, G. Redesigning employee health incentives—lessons from behavioral economics. N. Engl. J. Med. 365, 388–390 (2011).
doi: 10.1056/NEJMp1105966
pubmed: 21812669
pmcid: 3696722
Loewenstein, G., Asch, D. A. & Volpp, K. G. Behavioral economics holds potential to deliver better results for patients, insurers, and employers. Health Aff. (Millwood) 32, 1244–1250 (2013).
doi: 10.1377/hlthaff.2012.1163
Kessler, J. B. & Zhang, C. Y. Behavioral economics and health. Preprint at NBER https://users.nber.org/~kesslerj/papers/KesslerZhang_BehavioralEconomicsHealth.pdf (2014).
Sunstein, C. R. Probability neglect: emotions, worst cases, and law. Yale Law J. 112, 61–107 (2002).
doi: 10.2307/1562234
Ungemach, C., Chater, N. & Stewart, N. Are probabilities overweighted or underweighted when rare outcomes are experienced (rarely)? Psychol. Sci. 20, 473–479 (2009).
doi: 10.1111/j.1467-9280.2009.02319.x
pubmed: 19399978
Hau, R., Pleskac, T. J. & Hertwig, R. Decisions from experience and statistical probabilities: why they trigger different choices than a priori probabilities. J. Behav. Decis. Mak. 23, 48–68 (2010).
doi: 10.1002/bdm.665
Kahneman, D. & Tversky, A. Prospect theory: an analysis of decision under risk. Econometrica 47, 263–291 (1979).
doi: 10.2307/1914185
Volpp, K. G. et al. Financial incentive–based approaches for weight loss: a randomized trial. JAMA 300, 2631–2637 (2008).
doi: 10.1001/jama.2008.804
pubmed: 19066383
pmcid: 3583583
Patel, M. S. et al. A randomized trial of social comparison feedback and financial incentives to increase physical activity. Am. J. Health Promot. 30, 416–424 (2016).
doi: 10.1177/0890117116658195
pubmed: 27422252
pmcid: 6029434
Patel, M. S. et al. A randomized, controlled trial of lottery-based financial incentives to increase physical activity among overweight and obese adults. Am. J. Health Promot. 32, 1568–1575 (2018).
doi: 10.1177/0890117118758932
pubmed: 29534597
Kimmel, S. E. et al. Randomized trial of lottery-based incentives to improve warfarin adherence. Am. Heart J. 16, 268–274 (2012).
doi: 10.1016/j.ahj.2012.05.005
Asch, D. A. et al. Effect of financial incentives to physicians, patients, or both on lipid levels: a randomized clinical trial. JAMA 314, 1926–1935 (2015).
doi: 10.1001/jama.2015.14850
pubmed: 26547464
pmcid: 5509443
Husain, S. A. et al. Behavioral economics implementation: regret lottery improves mHealth patient study adherence. Contemp. Clin. Trials Commun 15, 100387 (2019).
doi: 10.1016/j.conctc.2019.100387
pubmed: 31198881
pmcid: 6555893
Haisley, E., Volpp, K. G., Pellathy, T. & Loewenstein, G. The impact of alternative incentive schemes on completion of health risk assessments. Am. J. Health Promot. 26, 184–188 (2012).
doi: 10.4278/ajhp.100729-ARB-257
pubmed: 22208418
Chaiyachati, K. H. et al. Improving longitudinal survey participation among internal medicine residents: incorporating behavioral economic techniques and avoiding Friday or Saturday invitations. J. Gen. Intern. Med. 34, 823–824 (2019).
doi: 10.1007/s11606-019-04836-8
pubmed: 30729415
pmcid: 6544584
Vavreck, L. $100 as incentive to get a shot? Experiment suggests it can pay off. New York Times https://www.nytimes.com/2021/05/04/upshot/vaccine-incentive-experiment.html (4 May 2021).
Campos-Mercade, P. et al. Monetary incentives increase COVID-19 vaccinations. Science 374, 879–882 (2021).
doi: 10.1126/science.abm0475
pubmed: 34618594
Prelec, D. The probability weighting function. Econometrica 66, 497–527 (1998).
doi: 10.2307/2998573
Lewis, J. & Simmons, J. P. Prospective outcome bias: incurring (unnecessary) costs to achieve outcomes that are already likely. J. Exp. Psychol. Gen. 149, 870–888 (2020).
doi: 10.1037/xge0000686
pubmed: 31886705
Gonzalez, R. & Wu, G. On the shape of the probability weighting function. Cogn. Psychol. 38, 129–166 (1999).
doi: 10.1006/cogp.1998.0710
pubmed: 10090801
Slovic, P. & Lichtenstein, S. Relative importance of probabilities and payoffs in risk taking. J. Exp. Psychol. 78, 1–18 (1968).
doi: 10.1037/h0026468
Dave, D., Friedson, A. I. & Hansen, B. Association between statewide COVID-19 lottery announcements and vaccinations. JAMA 2, e213117–e213117 (2021).
Brehm, M. E., Brehm, P. A. & Saavedra, M. The Ohio vaccine lottery and starting vaccination rates. AM. J. Health Econ. 8, 000–000 (2022).
doi: 10.1086/718512
Lang, D., Esbenshade, L. & Willer, R. Did Ohio’s vaccine lottery increase vaccination rates? A pre-registered, synthetic control study. J. Exp. Polit. Sci. 1–19 (2021).
Walkey, A. J., Law, A. & Bosch, N. A. lottery-based incentive in Ohio and COVID-19 vaccination rates. JAMA 326, 766–767 (2021).
doi: 10.1001/jama.2021.11048
pubmed: 34213530
pmcid: 8385592
American Community Survey (ACS) (United States Census Bureau, 2019); https://www.census.gov/programs-surveys/acs
Data (Department of Public Health, City of Philadelphia, 2021); https://www.phila.gov/departments/department-of-public-health/data/
Databases, Sales Leads, Email Services, Mailing Lists, Data Analytics & Enhancement (DatabaseUSA, 2021); https://databaseusa.com/
Abadie, A., Diamond, A. & Hainmueller, J. Synthetic control methods for comparative case studies: estimating the effect of California’s Tobacco Control Program. J. Am. Stat. Assoc. 105, 493–505 (2010).
doi: 10.1198/jasa.2009.ap08746
Bertrand, M., Duflo, E. & Mullainathan, S. How much should we trust differences-in-differences estimates? Q. J. Econ. 119, 249–275 (2004).
doi: 10.1162/003355304772839588
Cunningham, S. Causal Inference: The Mixtape Ch. 9 (Yale Univ. Press, 2021).
Dube, A., Kaplan, E. & Naidu, S. Coups, corporations, and classified information. Q. J. Econ. 126, 1375–1409 (2011).
doi: 10.1093/qje/qjr030
MacKinnon, J. G. & Webb, M. D. Randomization inference for difference-in-differences with few treated clusters. J. Econ. 218, 435–450 (2020).
doi: 10.1016/j.jeconom.2020.04.024
Patel, H. I. & Gupta, G. D. A problem of equivalence in clinical trials. Biometr. J. 26, 471–474 (1984).
doi: 10.1002/bimj.4710260502
Lakens, D. Equivalence tests: a practical primer for t tests, correlations, and meta-analyses. Soc. Psychol. Pers. Sci. 8, 355–362 (2017).
doi: 10.1177/1948550617697177
Roberto, C. A. et al. Association of a beverage tax on sugar-sweetened and artificially sweetened beverages with changes in beverage prices and sales at chain retailers in a large urban setting. JAMA 321, 1799–1810 (2019).
doi: 10.1001/jama.2019.4249
pubmed: 31087022
pmcid: 6518342
COVID-19 Vaccinations in the United States, County (Centers for Disease Control and Prevention, 2021); https://data.cdc.gov/Vaccinations/COVID-19-Vaccinations-in-the-United-States-County/8xkx-amqh
Mas-Colell, A., Whinston, M. D. & Green, J. R. Microeconomic Theory (Oxford Univ. Press, 1995).
Lacetera, N., Pope, D. G. & Sydnor, J. R. Heuristic thinking and limited attention in the car market. Am. Econ. Rev. 102, 2206–2236 (2012).
doi: 10.1257/aer.102.5.2206
Rabb, N., Glick, D., Bowers, J., Wilson, K. H. & Yokum, D. Text messages do not increase COVID-19 vaccination four weeks after universal eligibility. Preprint at OSF https://osf.io/cg3nt/ (2021).
Dai, H. et al. Behavioral nudges increase COVID-19 vaccinations. Nature 597, 404–409 (2021).
doi: 10.1038/s41586-021-03843-2
pubmed: 34340242
pmcid: 8443442
COVID-19 Vaccinations (OpenDataPhilly, 2021); www.opendataphilly.org/dataset/covid-vaccinations
Stamm, D. Philly to give $50,000 in cash to residents in COVID ‘Vax Sweepstakes’. NBC 10 Philadelphia https://www.nbcphiladelphia.com/news/coronavirus/philly-giving-away-multiple-50000-cash-prizes-in-vax-sweepstakes/2839533/ (2021).
Wilson, S. Philly Vax Sweepstakes: city giving vaccinated residents a chance to win up to $50K. FOX 29 Philadelphia https://www.fox29.com/news/philadelphia-announces-50000-sweepstakes-for-covid-19-vaccinations (2021).
Philadelphia offers prizes up to $50,000 as incentive for residents to get COVID vaccine. 6ABC https://6abc.com/covid-vaccine-sweepstakes-philadelphia-covid-19-drawing-philly/10759616/ (2021).
CBS3 Staff. 36 fully vaccinated Philadelphians to win up to $50,000 through new Philly Vax Sweepstakes Program. CBS Philadelphia https://philadelphia.cbslocal.com/2021/06/07/philly-covid-19-vaccine-program-sweepstakes/ (2021).
Fabian, K. Philadelphia to give away big bucks in vaccine sweepstakes. PHL17 https://phl17.com/phl17-news/philadelphia-to-giveaway-big-bucks-in-vaccine-sweepstakes/ (2021).
McCrystal, L. Philadelphia residents could now win as much as $50,000 for getting the COVID-19 vaccine. Philadelphia Inquirer https://www.inquirer.com/health/coronavirus/vaccine-sweepstakes-cash-drawing-prize-philadelphia-covid-20210607.html (2021).
Card, D. & Krueger, A. B. Minimum wages and employment: a case study of the fast-food industry in New Jersey and Pennsylvania. Am. Econ. Rev. 84, 772–793 (1994).
Galiani, S. & Quistorff, B. The synth_runner package: utilities to automate synthetic control estimation using synth. Stata J. 17, 834–849 (2017).
doi: 10.1177/1536867X1801700404
Cavallo, E., Galiani, S., Noy, I. & Pantano, J. Catastrophic natural disasters and economic growth. Rev. Econ. Stat. 95, 1549–1561 (2013).
doi: 10.1162/REST_a_00413
Abadie, A., Diamond, A. & Hainmueller, J. Comparative politics and the synthetic control method. Am. J. Polit. Sci. 59, 495–510 (2014).
doi: 10.1111/ajps.12116