Advertisement

The Multiple Baseline Design for Evaluating Population-Based Research

      Abstract

      There is a need for pragmatic and rigorous research designs to evaluate the effectiveness of population-based health interventions. The randomized controlled trial (RCT) has limitations in its practicality, ethical appropriateness, and cost when evaluating population-based interventions. Like RCTs, the multiple baseline design can demonstrate that a change in behavior has occurred, the change is a result of the intervention, and the change is significant. Especially important practical advantages over the RCT are that this design requires fewer population groups and communities may act as their own controls. Advantages and methodologic limitations of the multiple baseline design are discussed, and where feasible, strategies to minimize the impact of its limitations are suggested. Recommendations for future research are included.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to American Journal of Preventive Medicine
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Lindholm L.
        • Rosen M.
        What is the “golden standard” for assessing population-based interventions?.
        J Epidemiol Community Health. 2000; 54: 617-622
        • Hingson R.W.
        • Howland J.
        Comprehensive community interventions to promote health: implications for college-age drinking problems.
        J Stud Alcohol Suppl. 2002; 14: 226-240
        • Luepker R.
        • Murray D.
        • Jacobs D.J.
        • et al.
        Community education for cardiovascular disease prevention: risk factor changes in the Minnesota Heart Health Program.
        Am J Public Health. 1994; 84: 1383-1393
        • Vartiainen E.
        • Puska P.
        • Jousilahti P.
        • Korhonen H.
        • Tuomilehto J.
        • Nissinen A.
        Twenty-year trends in coronary risk Factors in North Karelia and in other areas of Finland.
        Int J Epidemiol. 1994; 23: 495-504
        • Winkleby M.A.
        • Taylor C.B.
        • Jatulis D.
        • Fortmann S.P.
        The long-term effects of a cardiovascular disease prevention trial: the Stanford five-city project.
        Am J Public Health. 1996; 86: 1773-1779
        • Pentz M.
        • Dwyer J.
        • MacKinnon D.
        • et al.
        Multicommunity trial for primary prevention of adolescent drug abuse.
        JAMA. 1989; 261: 3259-3266
        • Sanderson C.
        • Haglund B.
        • Tillgren P.
        • et al.
        Effect and stage models in community intervention programmes;and the development of the model for management of intervention programme preparation.
        Health Promot Int. 1996; 11: 143-156
        • Ovretveit J.
        Action evaluation: what is it and why evaluate? Action evaluation of health programmes and changes: a handbook for a user-focused approach. Radcliffe Medical Press, Abingdon, Oxfordshire2002 (1–17)
        • Hancock L.
        • Sanson-Fisher R.
        • Redman S.
        • et al.
        Community actions for cancer prevention: overview of the Cancer Action in Rural Towns (CART) project, Australia.
        Health Promot Int. 1996; 11: 277-290
        • Hancock L.
        • Sanson-Fisher R.W.
        • Perkins J.
        • McClintock A.
        • Howley P.
        • Gibberd R.
        Effect of a community action program on adult quit smoking rates in rural Australian towns: the CART project.
        Prev Med. 2001; 32: 118-127
        • Russell L.B.
        Opportunity costs in modern medicine.
        Health Aff. 1991; 11: 162-169
        • Drummond M.
        • O’Brien B.
        • Stoddart G.
        • Torrance G.
        Methods for the economic evaluation of health care programmes. Oxford University Press, New York1997
        • Wutzke S.
        • Shiell A.
        • Gomela M.
        • Conigrave K.
        Cost effectiveness of brief interventions for reducing alcohol consumption.
        Soc Sci Med. 2001; 52: 863-870
        • Puska P.
        Do we learn our lessons from the population-based interventions?.
        J Epidemiol Community Health. 2000; 54: 562-563
        • Sussman S.
        School-based tobacco use prevention and cessation: where are we going?.
        Am J Health Behav. 2001; 25: 191-199
        • Vartiainen E.
        • Paavola M.
        • McAlister A.
        • Puska P.
        Fifteen-year followup of smoking prevention effects in the North Karelia youth project.
        Am J Public Health. 1998; 88: 81-85
        • U.S. Department of Health and Human Services
        Preventing tobacco use among young people: a report of the Surgeon General. Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health, Atlanta GA1994
        • Thomson E.L.
        Smoking education programs 1960–1976.
        Am J Public Health. 1978; 68: 250-255
        • Augurzky B.
        • Schmidt C.
        The evaluation of community-based interventions: a Monte Carlo study. Institute for the Study of Labor, Bonn2001
        • Kirkwood B.R.
        • Cousens S.N.
        • Victoria C.G.
        • de Zoysa I.
        Issues in the design and interpretation of studies to evaluate the impact of community-based interventions.
        Trop Med Int Health. 1997; 2: 1022-1029
        • Biglan A.
        • Ary D.
        • Wagenaar A.C.
        The value of interrupted time-series experiments for community intervention research.
        Prev Sci. 2000; 1: 31-49
        • Cochrane Effective Practice and Organisation of Care Group
        The data collection checklist. Cochrane Effective Practice and Organisation of Care Group, Ottawa2003
        • Loos C.
        • Oldenburg B.
        • O’Hara L.
        The planning of a community-based program to injury control and safety promotion in a rural community. 2001; 9: 222-228
        • Lavelle J.
        • Hovell M.
        • West M.
        • Wahlgren D.
        Promoting law enforcement for child protection: a community analysis. 1992; 25: 885-892
        • Honnen T.
        • Kleinke C.
        Prompting bar patrons with signs to take free condoms. 1990; 23: 215-217
        • Delgado-Rodriguez M.
        • Llorca J.
        Bias. 2004; 58: 635-641
        • Resnik D.
        • Zeldin D.
        • Sharp R.
        Research on environmental health interventions: ethical problems and solutions. 21. 2005: 69-101
        • Paolo A.
        • Bonaminio G.
        • Gibson C.
        • Partridge T.
        • Kallail K.
        Response rate comparisons of e-mail and mail-distributed student evaluations. 12. 2000: 81-84
        • Deeks J.
        • Dinnes J.
        • D’Amico R.
        • et al.
        Evaluating non-randomised intervention studies.
        Health Technol Assess. 2003; 7: 1-173
        • MacLehose R.
        • Reeves B.
        • Harvey I.
        • SHeldon T.
        • Russel I.
        • Black A.
        A systematic review of comparisons of effect sizes derived from randomised and non-randomised studies.
        Health Technol Assess. 2000; 4: 1-154
        • National Health and Medical Research Council
        How to use the evidence: assessment and application of scientific evidence. National Health and Medical Research Council, Canberra2000
      1. Beller E, Gebski V, Keech A. Randomisation in clinical trials. Med J Aust 177:565–7.

        • Schulz K.
        • Grimes D.
        Generation of allocation sequences in randomised trials: chance, not choice.
        Lancet. 2002; 359: 515-519
        • Robson L.
        • Shannon H.
        • Goldenhar L.
        • Hale A.
        Guide to evaluating the effectiveness of strategies for preventing work injuries: how to show whether a safety intervention really works. U.S. Department of Health and Human Services, Public Health Service, Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health, Cincinnati OH2001
        • Dimitrov D.
        • Rumrill P.
        Pretest-posttest designs and measurement of change.
        Can Fam Phys. 2003; 20: 159-165
        • Campbell D.T.
        • Stanley J.C.
        Experimental and quasi-experimental design for research. Rand McNally College Publishing Company, Chicago1963
        • Grimshaw J.
        • Campbell M.
        • Eccles M.
        • Steen N.
        Experimental and quasi-experimental designs for evaluating guideline implementation strategies.
        Fam Pract Suppl. 2000; 17: S11-S16
        • McGuigan F.J.
        Experimental psychology: methods of research. Prentice Hall, Englewood Cliffs NJ1993
        • Baer D.M.
        • Wolf M.M.
        • Risley T.R.
        Some current dimensions of applied behavior analysis.
        J Appl Behav Anal. 1968; 1: 91-97
        • Barlow D.H.
        • Hersen M.
        Multiple baseline designs.
        in: Goldstein A.P. Krasner L. Single case experimental designs: strategies for studying behavior change. Pergamon Press, New York1984: 210-251
        • Albert P.
        Longitudinal data analysis (repeated measures) in clinical trials.
        Stat Med. 1999; 18: 1707-1732
        • Schmidt C.
        • Bultussen R.
        • Sauerborn R.
        The evaluation of community-based interventions: group randomization, limits and alternatives. Institute for the Study of Labor, Bonn2000
        • Kazdin A.E.
        Statistical analysis for single-case experimental designs.
        in: Goldstein A.P. Krasner L. Single case experimental designs: strategies for studying behavior change. Pergamon Press, New York1984: 285-324
        • Wickizer T.M.
        • Kopjar B.
        • Franklin G.
        • Joesch J.
        Do drug-free workplace programs prevent occupational injuries?.
        Health Serv Res. 2004; 39: 91-110
        • Skog O.
        Alcohol consumption and fatal accidents in Canada 1950–89.
        Addiction. 2003; 98: 883-893
        • Abeyshinghe T.
        • Balasooriya U.
        • Tsui A.
        Small-sample forecasting regression or ARIMA models?.
        J Quant Econ. 2003; 1: 103-113
        • Crosbie J.
        Interrupted time-series analysis with brief single-subject data.
        J Consult Clin Psychol. 1993; 61: 966-974
        • Mullins R.
        • Borland R.
        • Hill D.
        Smoking knowledge, attitudes and behaviour in Victoria: results from the 1990 and 1991 Household Surveys. Victorian Smoking and Health Program, Melbourne, Victoria, Australia1992
        • Beich A.
        • Thorsen T.
        • Rollnick S.
        Screening in brief intervention trials targeting excessive drinkers in general practice: systematic review and meta-analysis.
        BMJ. 2003; 327: 536-542
        • Sackett D.L.
        • Haynes R.B.
        • Tugwell P.
        Clinical epidemiology: a basic science for clinical medicine. Little, Brown and Company, Boston1985
        • Biglan A.
        • Ary D.
        • Koehn V.
        • Levings D.
        Mobilizing positive reinforcement in communities to reduce youth access to tobacco.
        Am J Community Psychol. 1996; 24: 625-638
        • Landrine H.
        • Klonoff E.A.
        • Alcaraz R.
        Asking age and identification may decrease minors’ access to tobacco.
        Prev Med. 1996; 25: 301-306
        • Feighery E.
        • Altman D.G.
        • Shaffer G.
        The effects of combining education and enforcement to reduce tobacco sales to minors.
        JAMA. 1991; 266: 3168-3171
        • Grabosky P.
        • James M.
        Random breath testing in NSW.
        in: Grabosky P. James M. The promise of crime prevention. Australian Institute of Criminology, Griffith, Queensland1995
        • Australian Institute of Health and Welfare
        A guide to Australian alcohol data. Australian Institute of Health and Welfare, Canberra2004
        • Doll R.
        • Peto R.
        • Boreham J.
        • Sutherland I.
        Mortality in relation to smoking: 50 years’ observations on male British doctors.
        BMJ. 2004; 328: 1519
        • Peto R.
        • Lopez A.
        • Boreham J.
        • Thun M.
        • Heath C.J.
        Mortality from tobacco in developed countries: indirect estimation from national vital statistics.
        Lancet. 1992; 339: 1268-1278
        • Holder H.
        Community prevention of alcohol problems.
        Addict Behav. 2000; 25: 843-859
        • Simons J.S.
        • Gaher R.M.
        Attitudes toward alcohol and drug-free experience among college students: relationships with alcohol consumption and problems.
        Am J Drug Alcohol Abuse. 2004; 30: 461-471
        • Mattern J.L.
        • Neighbors C.
        Social norms campaigns: examining the relationship between changes in perceived norms and changes in drinking levels.
        J Stud Alcohol. 2004; 65: 489-493
        • Voas R.B.
        • Holder H.D.
        • Gruenewald P.J.
        The effect of drinking and driving interventions on alcohol-involved traffic crashes within a comprehensive community trial.
        Addiction. 1997; 92: S221-S236
        • Holder H.D.
        • Gruenewald P.J.
        • Ponicki W.R.
        • et al.
        Effect of community-based interventions on high-risk drinking and alcohol-related injuries.
        JAMA. 2000; 284: 2341-2347
        • Hall W.
        British drinking: a suitable case for treatment?331. 2005: 527-528
        • Fishbein M.
        • Ajzen I.
        Belief, attitude, intention, and behavior: an introduction to theory and research. Addison-Wesley, Reading MA1975
        • Lavack A.
        Canadian anti-tobacco campaigns: the past 10 years. Faculty of Business Administration, University of Regina, Regina, Saskatchewan2001
        • Grey A.
        • Owen L.
        • Bolling K.
        A breath of fresh air, tackling smoking through the media. Health Education Authority, London2000
        • McBride N.
        • Midford R.
        • Farringdon F.
        • Phillips M.
        Early results from a school alcohol harm minimization study: the School Health and Alcohol Harm Reduction Project.
        Addiction. 2000; 95: 1021-1042
        • Patten C.
        • Pierce J.
        • Cavin S.
        • Berry C.
        • Kaplan R.
        Progress in protecting non-smokers from environmental tobacco smoke in California workplaces. 4. 1995: 139-144
        • Kratochwill T.R.
        • Levin J.
        Single subject research. Academic Press, New York1978
        • Cook T.D.
        • Campbell D.T.
        Quasi-experimentation: design and analysis issues. Houghton Mifflin, Boston1979
        • Atienza A.A.
        • King A.C.
        Community-based health intervention trials: an overview of methodological issues.
        Epidemiol Rev. 2002; 24: 72-79
        • Weir E.
        Seasonal drinking: let’s avoid the “January effect.”.
        CMAJ. 2003; 169: 1186
        • Carpenter C.
        Seasonal variation in self-reports of recent alcohol consumption: racial and ethnic differences.
        J Stud Alcohol. 2003; 64: 415-418