Evaluating Diabetes Health Policies Using Natural Experiments

The Natural Experiments for Translation in Diabetes Study
      The high prevalence and costs of type 2 diabetes makes it a rapidly evolving focus of policy action. Health systems, employers, community organizations, and public agencies have increasingly looked to translate the benefits of promising research interventions into innovative polices intended to prevent or control diabetes. Though guided by research, these health policies provide no guarantee of effectiveness and may have opportunity costs or unintended consequences. Natural experiments use pragmatic and available data sources to compare specific policies to other policy alternatives or predictions of what would likely have happened in the absence of any intervention. The Natural Experiments for Translation in Diabetes (NEXT-D) Study is a network of academic, community, industry, and policy partners, collaborating to advance the methods and practice of natural experimental research, with a shared aim of identifying and prioritizing the best policies to prevent and control diabetes. This manuscript describes the NEXT-D Study group’s multi-sector natural experiments in areas of diabetes prevention or control as case examples to illustrate the selection, design, analysis, and challenges inherent to natural experimental study approaches to inform development or evaluation of health policies.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to American Journal of Preventive Medicine
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • CDC
        National diabetes statistical report: estimates of diabetes and its burden in the United States, 2014.
        DHHS; CDC, Atlanta, GA2014
        • CDC
        National Diabetes Prevention Program.
        CDC, Atlanta, GA2012
        • Fendrick A.M.
        Value-based insurance design for diabetes mellitus: approaches to optimal pharmacoeconomic implementation.
        Am J Manag Care. 2010; 16: S314-S322
        • Deakin T.
        • McShane C.E.
        • Cade J.E.
        • Williams R.D.
        Group based training for self-management strategies in people with type 2 diabetes mellitus.
        Cochrane Database Syst Rev. 2005; : CD003417
        • Norris S.L.
        • Lau J.
        • Smith S.J.
        • Schmid C.H.
        • Engelgau M.M.
        Self-management education for adults with type 2 diabetes: a meta-analysis of the effect on glycemic control.
        Diabetes Care. 2002; 25: 1159-1171
        • Chodosh J.
        • Morton S.C.
        • Mojica W.
        • et al.
        Meta-analysis: chronic disease self-management programs for older adults.
        Ann Intern Med. 2005; 143: 427-438
        • Peikes D.
        • Chen A.
        • Schore J.
        • Brown R.
        Effects of care coordination on hospitalization, quality of care, and health care expenditures among Medicare beneficiaries: 15 randomized trials.
        JAMA. 2009; 301: 603-618
        • Bishop C.E.
        • Ryan A.M.
        • Gilden D.M.
        • Kubisiak J.
        • Thomas C.P.
        Effect of an expenditure cap on low-income seniors’ drug use and spending in a state pharmacy assistance program.
        Health Serv Res. 2009; 44: 1010-1028
        • Soumerai S.
        Unintended outcomes of medicaid drug cost-containment policies on the chronically mentally ill.
        J Clin Psychiatry. 2003; 64: 19-22
        • Woolf S.H.
        • Braveman P.
        Where health disparities begin: the role of social and economic determinants—and why current policies may make matters worse.
        Health Aff (Millwood). 2011; 30: 1852-1859
        • McHugh M.D.
        • Carthon J.M.
        • Kang X.L.
        Medicare readmissions policies and racial and ethnic health disparities: a cautionary tale.
        Policy Polit Nurs Pract. 2010; 11: 309-316
        • Wharam J.F.
        • Daniels N.
        Toward evidence-based policy making and standardized assessment of health policy reform.
        JAMA. 2007; 298: 676-679
        • Majumdar S.R.
        • Soumerai S.B.
        The unhealthy state of health policy research.
        Health Aff (Millwood). 2009; 28: w900-w908
        • Shadish W.R.
        • Cook T.D.
        The renaissance of field experimentation in evaluating interventions.
        Annu Rev Psychol. 2009; 60: 607-629
        • West S.G.
        • Duan N.
        • Pequegnat W.
        • et al.
        Alternatives to the randomized controlled trial.
        Am J Public Health. 2008; 98: 1359-1366
        • Craig P.
        • Cooper C.
        • Gunnell D.
        • et al.
        Using natural experiments to evaluate population health interventions: new Medical Research Council guidance.
        J Epidemiol Community Health. 2012; 66: 1182-1186
        • Shadish W.R.
        • Cook T.D.
        • Campbell D.T.
        Experimental and quasi-experimental designs for generalized causal inference.
        xxi. Houghton Mifflin, Boston2001: 623
        • Durlauf S.N.
        • Blume L.
        The New Palgrave Dictionary of Economics. 2nd ed. Palgrave Macmillan, New York2008
        • Petticrew M.
        • Cummins S.
        • Ferrell C.
        • et al.
        Natural experiments: an underused tool for public health?.
        Public Health. 2005; 119: 751-757
        • Callinan J.E.
        • Clarke A.
        • Doherty K.
        • Kelleher C.
        Legislative smoking bans for reducing secondhand smoke exposure, smoking prevalence and tobacco consumption.
        Cochrane Database Syst Rev. 2010; : CD005992
        • Costello E.J.
        • Compton S.N.
        • Keeler G.
        • Angold A.
        Relationships between poverty and psychopathology: a natural experiment.
        JAMA. 2003; 290: 2023-2029
        • Sargent R.P.
        • Shepard R.M.
        • Glantz S.A.
        Reduced incidence of admissions for myocardial infarction associated with public smoking ban: before and after study.
        BMJ. 2004; 328: 977-980
        • Soumerai S.B.
        • Avorn J.
        • Ross-Degnan D.
        • Gortmaker S.
        Payment restrictions for prescription drugs under Medicaid. Effects on therapy, cost, and equity.
        N Engl J Med. 1987; 317: 550-556
        • Baicker K.
        • Taubman S.L.
        • Allen H.L.
        • et al.
        The Oregon experiment—effects of Medicaid on clinical outcomes.
        N Engl J Med. 2013; 368: 1713-1722
        • Ludwig J.
        • Sanbonmatsu L.
        • Gennetian L.
        • et al.
        Neighborhoods, obesity, and diabetes—a randomized social experiment.
        N Engl J Med. 2011; 365: 1509-1519
        • Brown C.A.
        • Lilford R.J.
        The stepped wedge trial design: a systematic review.
        BMC Med Res Methodol. 2006; 6: 54
        • Donner A.
        • Klar N.
        Design and Analysis of Cluster Randomization Trials in Health Research.
        Arnold; Co-published by the Oxford University Press, New York, NY2000[#'?']?> (x, 178 pp)
        • Schmittdiel J.A.
        • Grumbach K.
        • Selby J.V.
        System-based participatory research in health care: an approach for sustainable translational research and quality improvement.
        Ann Fam Med. 2010; 8: 256-259
        • Stokols D.
        Translating social ecological theory into guidelines for community health promotion.
        Am J Health Promot. 1996; 10: 282-298
        • Whittemore R.
        • Melkus G.D.
        • Grey M.
        Applying the social ecological theory to type 2 diabetes prevention and management.
        J Community Health Nurs. 2004; 21: 87-99
        • Bodenheimer T.
        • Wagner E.H.
        • Grumbach K.
        Improving primary care for patients with chronic illness: the chronic care model, Part 2.
        JAMA. 2002; 288: 1909-1914
        • Mangione C.M.
        • Gerzoff R.B.
        • Williamson D.F.
        • et al.
        The association between quality of care and the intensity of diabetes disease management programs.
        Ann Intern Med. 2006; 145: 107-116
      1. Agency for Healthcare Research and Quality. Designing and Implementing Medicaid Disease and Care Management Programs: A User׳s Guide. Rockville, MD: 2008 March 2008. Report No.: AHRQ Publication No. 07(08)-0063.

        • Brown R.
        • Peikes D.
        • Chen A.
        • Schore J.
        15-site randomized trial of coordinated care in Medicare FFS.
        Health Care Financ Rev. 2008; 30: 5-25
        • Chernew M.E.
        • Rosen A.B.
        • Fendrick A.M.
        Value-based insurance design.
        Health Aff (Millwood). 2007; 26: w195-w203
        • Spaulding A.
        • Fendrick A.M.
        • Herman W.H.
        • et al.
        A controlled trial of value-based insurance design—The MHealthy: Focus on Diabetes (FOD) trial.
        Implement Sci. 2009; 4: 19
        • Newlin K.
        • Dyess S.M.
        • Allard E.
        • Chase S.
        • Gail D׳Eramo M.
        A methodological review of faith-based health promotion literature: advancing the science to expand delivery of diabetes education to black Americans.
        J Relig Health. 2011; 51: 1075-1097
        • Schmittdiel J.A.
        • Brown S.D.
        • Neugebauer R.
        • et al.
        Health-plan and employer-based wellness programs to reduce diabetes risk: The Kaiser Permanente Northern California NEXT-D Study.
        Prev Chronic Dis. 2013; 10: E15
        • Duru O.K.
        • Mangione C.M.
        • Chan C.
        • et al.
        Evaluation of the diabetes health plan to improve diabetes care and prevention.
        Prev Chronic Dis. 2013; 10: E16
        • Albu J.
        • Sohler N.
        • Matti-Orozco B.
        • et al.
        Expansion of electronic health record-based screening, prevention, and management of diabetes in New York City.
        Prev Chronic Dis. 2013; 10: E13
        • Kaiser Family Foundation
        Employer health benefits 2013 annual survey.
        The Kaiser Family Foundation and Health Research & Educational Trust, Menlo Park, CA2013
        • Haviland A.M.
        • Marquis M.S.
        • McDevitt R.D.
        • Sood N.
        Growth of consumer-directed health plans to one-half of all employer-sponsored insurance could save $57 billion annually.
        Health Aff (Millwood). 2012; 31: 1009-1015
        • Wharam J.F.
        • Galbraith A.A.
        • Kleinman K.P.
        • Soumerai S.B.
        • Ross-Degnan D.
        • Landon B.E.
        Cancer screening before and after switching to a high-deductible health plan.
        Ann Intern Med. 2008; 148: 647-655
        • Wharam J.F.
        • Landon B.E.
        • Galbraith A.A.
        • Kleinman K.P.
        • Soumerai S.B.
        • Ross-Degnan D.
        Emergency department use and subsequent hospitalizations among members of a high-deductible health plan.
        JAMA. 2007; 297: 1093-1102
        • Wharam J.F.
        • Soumerai S.
        • Trinacty C.
        • et al.
        Impact of emerging health insurance arrangements on diabetes outcomes and disparities: rationale and study design.
        Prev Chronic Dis. 2013; 10: E11
        • Ackermann R.T.
        • Holmes A.M.
        • Saha C.
        Designing a natural experiment to evaluate a national health care-community partnership to prevent type 2 diabetes.
        Prev Chronic Dis. 2013; 10: E12