Impact of a Virtual Reality Curriculum on Human Papillomavirus Vaccination: A Pilot Trial

      Although the strongest predictor of human papillomavirus (HPV) vaccination is a high-quality recommendation, physicians often provide weak recommendations. Thus, the authors developed Virtual Immersive Communication Training on Recommending Immunizations (VICTORI), a virtual reality (VR)‒based intervention that provided physicians the opportunity to deliberately practice recommendation behaviors. VICTORI included VR simulations during which participants counseled caregiver avatars hesitant to vaccinate. Before participation in VICTORI, participants reviewed a smartphone application on recommendation behaviors. A nonrandomized control trial of VICTORI was conducted with licensed and resident physicians. The intervention group completed the application and VICTORI simulations, whereas a comparison group completed only the application. The hypothesis was that HPV vaccination rates would increase for patients in the intervention group. The preintervention period was defined as the 6 months before allocated training (February 1, 2020–July 31, 2020), and the postintervention period was the 6 months after (October 1, 2020–March 31, 2021). The primary outcome was a change in the rates of human papillomavirus vaccine initiation among eligible patients presenting to clinic before and after. Of 142 eligible physicians, 134 (94%) chose to participate, with 93 of /97 (96%) intervention and 30 of 37 (81%) comparison participants completing study protocols. There was a statistically significant increase in patients’ HPV vaccine initiation rates after training within the intervention group (54.3%‒72.4%; 18.1% difference [95% CI=11.0, 25.8]; p<0.001) but not within the comparison group (59.5%‒63.4%; 3.9% difference [95% CI= −11.0, 19.0]; p=0.609). In conclusion, HPV vaccine initiation increased after VR training, and further study is warranted.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to American Journal of Preventive Medicine
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


      1. How many cancers are linked with HPV each year?. Centers for Disease Control and Prevention. Updated December 13, 2021. Accessed September 3, 2020.

        • Pingali C
        • Yankey D
        • Elam-Evans LD
        • et al.
        National, regional, state, and selected local area vaccination coverage among adolescents aged 13–17 years - United States, 2020.
        MMWR Morb Mortal Wkly Rep. 2021; 70: 1183-1190
      2. Immunization and infectious diseases.
        Healthy People 2020, HHS, Office of Disease Prevention and Health promotion, February 6, 2022
        • Dempsey AF
        • O'Leary ST
        Human papillomavirus vaccination: narrative review of studies on how providers’ vaccine communication affects attitudes and uptake.
        Acad Pediatr. 2018; 18: S23-S27
        • Gilkey MB
        • Calo WA
        • Moss JL
        • Shah PD
        • Marciniak MW
        • Brewer NT.
        Provider communication and HPV vaccination: the impact of recommendation quality.
        Vaccine. 2016; 34: 1187-1192
        • Perkins RB
        • Clark JA.
        Providers’ attitudes toward human papillomavirus vaccination in young men: challenges for implementation of 2011 recommendations.
        Am J Mens Health. 2012; 6: 320-323
        • Gowda C
        • Schaffer SE
        • Dombkowski KJ
        • Dempsey AF.
        Understanding attitudes toward adolescent vaccination and the decision-making dynamic among adolescents, parents and providers.
        BMC Public Health. 2012; 12: 509
        • Hughes CC
        • Jones AL
        • Feemster KA
        • Fiks AG.
        HPV vaccine decision making in pediatric primary care: a semi-structured interview study.
        BMC Pediatr. 2011; 11: 74
        • McRee AL
        • Gilkey MB
        • Dempsey AF.
        HPV vaccine hesitancy: findings from a statewide survey of health care providers.
        J Pediatr Health Care. 2014; 28: 541-549
        • Szilagyi PG
        • Humiston SG
        • Stephens-Shields AJ
        • et al.
        Effect of training pediatric clinicians in human papillomavirus communication strategies on human papillomavirus vaccination rates: a cluster randomized clinical trial.
        JAMA Pediatr. 2021; 175: 901-910
        • Brewer NT
        • Hall ME
        • Malo TL
        • Gilkey MB
        • Quinn B
        • Lathren C.
        Announcements versus conversations to improve HPV vaccination coverage: a randomized trial.
        Pediatrics. 2017; 139e20161764
        • Staras SA
        • Vadaparampil ST
        • Livingston MD
        • Thompson LA
        • Sanders AH
        • Shenkman EA.
        Increasing human papillomavirus vaccine initiation among publicly insured Florida adolescents.
        J Adolesc Health. 2015; 56: S40-S46
        • Perkins RB
        • Zisblatt L
        • Legler A
        • Trucks E
        • Hanchate A
        • Gorin SS.
        Effectiveness of a provider-focused intervention to improve HPV vaccination rates in boys and girls.
        Vaccine. 2015; 33: 1223-1229
        • Paskett ED
        • Krok-Schoen JL
        • Pennell ML
        • et al.
        Results of a multilevel intervention trial to increase human papillomavirus (HPV) vaccine uptake among adolescent girls.
        Cancer Epidemiol Biomarkers Prev. 2016; 25: 593-602
        • Dempsey AF
        • Pyrznawoski J
        • Lockhart S
        • et al.
        Effect of a health care professional communication training intervention on adolescent human papillomavirus vaccination: a cluster randomized clinical trial.
        JAMA Pediatr. 2018; 172e180016
        • Zimet G
        • Dixon BE
        • Xiao S
        • et al.
        Simple and elaborated clinician reminder prompts for human papillomavirus vaccination: a randomized clinical trial.
        Acad Pediatr. 2018; 18: S66-S71
        • Fiks AG
        • Grundmeier RW
        • Mayne S
        • et al.
        Effectiveness of decision support for families, clinicians, or both on HPV vaccine receipt.
        Pediatrics. 2013; 131: 1114-1124
        • Fiks AG
        • Luan X
        • Mayne SL.
        Improving HPV vaccination rates using maintenance-of-certification requirements.
        Pediatrics. 2016; 137e20150675
        • Rosen BL
        • Bishop JM
        • Anderson R
        • Real FJ
        • Klein MD
        • Kreps GL.
        A content analysis of HPV vaccine online continuing medical education purpose statements and learning objectives.
        Hum Vaccin Immunother. 2019; 15: 1508-1518
        • Cook DA
        • Hatala R
        • Brydges R
        • et al.
        Technology-enhanced simulation for health professions education: a systematic review and meta-analysis.
        JAMA. 2011; 306: 978-988
        • Bracq MS
        • Michinov E
        • Jannin P.
        Virtual reality simulation in nontechnical skills training for healthcare professionals: a systematic review.
        Simul Healthc. 2019; 14: 188-194
        • Mottelson A
        • Vandeweerdt C
        • Atchapero M
        • et al.
        A self-administered virtual reality intervention increases COVID-19 vaccination intention.
        Vaccine. 2021; 39: 6746-6753
        • Nowak GJ
        • Evans NJ
        • Wojdynski BW
        • et al.
        Using immersive virtual reality to improve the beliefs and intentions of influenza vaccine avoidant 18-to-49-year-olds: considerations, effects, and lessons learned.
        Vaccine. 2020; 38: 1225-1233
        • Ericsson KA
        • Krampe RT
        • Tesch-Römer C.
        The role of deliberate practice in the acquisition of expert performance.
        Psychological Review. 1993; 100: 363-406
        • Real FJ
        • DeBlasio D
        • Beck AF
        • et al.
        A virtual reality curriculum for pediatric residents decreases rates of influenza vaccine refusal.
        Acad Pediatr. 2017; 17: 431-435
        • Lee J
        • Kim H
        • Kim KH
        • Jung D
        • Jowsey T
        • Webster CS.
        Effective virtual patient simulators for medical communication training: a systematic review.
        Med Educ. 2020; 54: 786-795
      3. Unity. Accessed June 14, 2022.

        • Opel DJ
        • Mangione-Smith R
        • Robinson JD
        • et al.
        The influence of provider communication behaviors on parental vaccine acceptance and visit experience.
        Am J Public Health. 2015; 105: 1998-2004
        • Moss JL
        • Reiter PL
        • Rimer BK
        • Brewer NT.
        Collaborative patient-provider communication and uptake of adolescent vaccines.
        Soc Sci Med. 2016; 159: 100-107
        • Opel DJ
        • Heritage J
        • Taylor JA
        • et al.
        The architecture of provider-parent vaccine discussions at health supervision visits.
        Pediatrics. 2013; 132: 1037-1046
        • Donahue KL
        • Hendrix KS
        • Sturm LA
        • et al.
        The effect of provider communication about vaccination on mothers’ willingness to vaccinate their children against HPV and influenza: a randomized trial of illustrated health messaging vignettes.
        J Adolesc Health. 2016; 58 (S117–S117)
        • Rollnick S
        • Miller WR.
        What is motivational interviewing?.
        Behav Cogn Psychother. 1995; 23: 325-334
        • Lockhart S
        • Dempsey AF
        • Pyrzanowski J
        • O'Leary ST
        • Barnard JG.
        Provider and parent perspectives on enhanced communication tools for human papillomavirus vaccine-hesitant parents.
        Acad Pediatr. 2018; 18: 776-782
        • Real FJ
        • Meisman A
        • Rosen BL.
        Usability matters for virtual reality simulations teaching communication.
        Med Educ. 2020; 54: 1067-1068
      4. Academic Pediatric Association and American Academy of Pediatrics in collaboration Kognito™. HPV Vaccine: Same Way Same Day. Apple. Updated March 19, 2018. Accessed June 14, 2022.

        • Real FJ
        • Rosen BL
        • Bishop JM
        • et al.
        Usability evaluation of the novel smartphone application, HPV vaccine: Same Way, Same Day, among pediatric residents.
        Acad Pediatr. 2021; 21: 742-749
      5. Vorderer P, Wirth W, Gouveia FR, et al. MEC Spatial Presence Questionnaire (MEC- SPQ): short documentation and instructions for application. Report to the European Community, project presence: MEC (IST-2001-37661); 2004. Accessed June 14, 2022.

        • Herbst R
        • Rybak T
        • Meisman A
        • et al.
        A virtual reality resident training curriculum on behavioral health anticipatory guidance: development and usability study.
        JMIR Pediatr Parent. 2021; 4: e29518
        • Young D
        • Real FJ
        • Sahay RD
        • Zackoff M.
        Remote virtual reality teaching: closing an educational gap during a global pandemic.
        Hosp Pediatr. 2021; 11: e258-e262
        • Harris PA
        • Taylor R
        • Thielke R
        • Payne J
        • Gonzalez N
        • Conde JG.
        Research Electronic Data Capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support.
        J Biomed Inform. 2009; 42: 377-381
        • Moss JL
        • Reiter PL
        • Rimer BK
        • Ribisl KM
        • Brewer NT.
        Summer peaks in uptake of human papillomavirus and other adolescent vaccines in the United States.
        Cancer Epidemiol Biomarkers Prev. 2016; 25: 274-281
        • R Core Team
        R: A language and environment for statistical computing.
        R Foundation for Statistical Computing, Vienna, Austria2021
        Date accessed: August 3, 2019
        • Bates D
        • Mächler M
        • Bolker B
        • Walker S.
        Fitting linear mixed-effects models using lme4.
        J Stat Soft. 2015; 67: 1-48
        • Kuznetsova A
        • Brockhoff PB
        • Christensen RHB.
        lmerTest package: tests in linear mixed effects models.
        J Stat Soft. 2017; 82: 1-26
        • American Cancer Society
        ACS elimination statement on HPV cancers.
        American Cancer Society, Atlanta, GAJuly 2020 (Accessed June 14, 2022)
      6. Communicating with Families and Promoting Vaccine Confidence. Updated July 30, 2021. Accessed June 14, 2022.

      7. For healthcare professionals. November 1, 2021;
        Date accessed: June 14, 2022
        • Perkins RB
        • Legler A
        • Jansen E
        • et al.
        Improving HPV vaccination rates: a stepped-wedge randomized trial.
        Pediatrics. 2020; 146e20192737
        • Sturm L
        • Donahue K
        • Kasting M
        • Kulkarni A
        • Brewer NT
        • Zimet GD.
        Pediatrician-parent conversations about human papillomavirus vaccination: an analysis of audio recordings.
        J Adolesc Health. 2017; 61: 246-251
        • Bishop JM
        • Real FJ
        • McDonald SL
        • et al.
        Evaluation of HPV vaccine: Same Way, Same DayTM: a pilot study.
        J Health Commun. 2021; 26: 839-845
        • Gayes LA
        • Steele RG.
        A meta-analysis of motivational interviewing interventions for pediatric health behavior change.
        J Consult Clin Psychol. 2014; 82: 521-535
        • Spencer JC
        • Calo WA
        • Brewer NT.
        Disparities and reverse disparities in HPV vaccination: a systematic review and meta-analysis.
        Prev Med. 2019; 123: 197-203