--- title: "How a pilot runs: stages, roles and measures chosen up front" description: "For the champion of an immersive training pilot in Australia or the US: stages from alignment to decision, roles on each side, what Mater and Google measured." canonical: https://peopletechrevolution.com/training/how-a-pilot-runs --- [Training programs](https://peopletechrevolution.com/training) / How a pilot runs # For the person running the pilot: how a pilot runs, stage by stage What each stage decides, who does what on each side, and what you can show at the end. Your questions ## How long, how many staff, what do we provide, what do we get? What a champion asks before committing a roster and a room. Planning a pilot at a wall of notes. ### How long, and how many staff? Agree the timing and the decision criteria together, at alignment. Size recruitment for the evaluation you intend to run, so the measures you chose can be compared before and after. A participant talks it through after the session. ### What do we provide, and what do we get? You provide the room, the people and a facilitator who will run the debrief once trained ([headsets and equipment](https://peopletechrevolution.com/training/headsets-and-equipment) covers IT). You get your own evaluation against the measures chosen up front, and a record of who rehearsed what where you set it up that way: [business case and evaluation](https://peopletechrevolution.com/training/business-case-and-evaluation). The stages ## Each stage ends with a decision Digital NSW: innovation buying is "multiple repeated Source and Manage stages, with decision-gates between each repetition." A pilot follows the same shape. A consultation across a table, tablet between. ### Alignment: name the result up front Your sponsor and champion meet PTR to name the conversation, who has it and the result you want at work. [Kirkpatrick Partners](https://www.kirkpatrickpartners.com/the-kirkpatrick-model/) advise starting with results, "understanding the ‘Why’ and the purpose of the program". Planners review a response plan together. ### Discovery: incidents become the brief Your educators and frontline staff describe the moments that go wrong; PTR writes the scenario brief, as in [designing a scenario and its debrief](https://peopletechrevolution.com/insights/design-de-escalation-scenario-debrief). Comparing scene cards from the VR Library. ### Build or select A [PTR VR Library](https://peopletechrevolution.com/xr/ptr-vr-library) title that fits is selected; where the setting matters, PTR builds the scenario in recreations of your own spaces ([fast builds](https://peopletechrevolution.com/fast-builds), [innovation teams](https://peopletechrevolution.com/work/innovation-teams)). People talk it over in a plain room. ### The session itself: prebrief, practice, debrief [INACSL](https://doi.org/10.1016/j.ecns.2021.08.011): "all simulation-based educational (SBE) activities must include a planned debriefing process." A trained facilitator runs it after the headset comes off; Google allocated 25 minutes to it in every session. Reviewers compare responses on screen. ### Evaluation: the levels named at alignment The [Kirkpatrick Model](https://www.kirkpatrickpartners.com/the-kirkpatrick-model/): reaction, "favorable, engaging, relevant"; learning, "knowledge, skills, attitude, confidence, and commitment"; behaviour, "the critical behaviors" at work; results, "targeted organizational outcomes occur". Instruments: [how to evaluate a pilot](https://peopletechrevolution.com/insights/evaluate-de-escalation-training-pilot). A working build handed across the table. ### Decision: continue, widen or stop Your sponsor reads the evaluation against the result named at alignment. At Mater the decision was to continue: its own facilitators were trained to run the technology across its campuses. Roles on each side ## Who does what Yours: a sponsor who owns the result, a champion who owns the calendar, a facilitator, the staff who rehearse, the keeper of the training record, an IT contact. PTR’s: scenarios, headsets or browser practice, facilitator preparation, the debrief structure, the evaluation instruments ([how we deliver](https://peopletechrevolution.com/training/how-we-deliver)). [A trainer you already work with](https://peopletechrevolution.com/training/for-trainers) can facilitate. A participant rehearses while colleagues watch. A worker holds a tablet between colleagues. A facilitator works through a whiteboard flow. PTR’s published work ## What Mater, Google and Mayo Clinic measured Evaluated by the organisation that ran each program, or by researchers. Inside the Mater build, at a bedside. ### Mater Education, Australia: the client’s own evaluation In its own [closure report](https://peopletechrevolution.com/uploads/docs/people-tech-revolution-mater-immersive-learning-pilot-case-study.pdf), 90% of participants reported an increase in concentration and over 96% wanted more training in VR: [Mater Immersive Learning Pilot](https://peopletechrevolution.com/work/research-evidence/mater-immersive-learning-pilot). An office desk scenario from Google. ### Google, United States: peer reviewed at CHI 2024 Led by Leonie Sanderson, built with Equal Reality, a subsidiary of People Tech Revolution. In the [paper](https://peopletechrevolution.com/uploads/docs/people-tech-revolution-google-vr-inclusion-training-chi-2024.pdf), the 7 trainees who returned the survey gave 82% average agreement it beat standard DEI training and 94% average satisfaction, findings the authors call preliminary: [VR DEI training at Google](https://peopletechrevolution.com/work/research-evidence/vr-dei-training-google-chi-2024). A clinical scenario seen through a headset. ### Mayo Clinic, United States: published research People Tech Revolution built a DEI module for nurse leaders; the [Journal of Nursing Administration](https://doi.org/10.1097/NNA.0000000000001503) paper reports delivery over 4 months, with 593 of 1,131 learners returning the evaluation. The published record covers speaking up, inclusion and nurse leadership; a pilot on another conversation sets its own baseline. [Download the Google research paper PDF](https://peopletechrevolution.com/uploads/docs/people-tech-revolution-google-vr-inclusion-training-chi-2024.pdf) [Download the Mater case study PDF](https://peopletechrevolution.com/uploads/docs/people-tech-revolution-mater-immersive-learning-pilot-case-study.pdf) Where practice fits ## Programs a pilot usually starts with The conversation your staff have most often. Training programs - [Speaking up for safety](https://peopletechrevolution.com/training/speaking-up-for-safety) - [De-escalation](https://peopletechrevolution.com/training/de-escalation) - [Difficult conversations](https://peopletechrevolution.com/training/difficult-conversations) - [Bias & inclusion](https://peopletechrevolution.com/training/bias-and-inclusion) - [Clinical & patient conversations](https://peopletechrevolution.com/training/clinical-and-patient-conversations) - [Directors of Clinical Services](https://peopletechrevolution.com/work/industries/healthcare-medical/directors-of-clinical-services) A conversation across a plain table. ### Start with the result you want to see Tell us the conversation and the team, and we will map the stages with you. [Talk to us](https://peopletechrevolution.com/talk-to-us) or [book a time with our team](https://calendly.com/simon-ptrvr/30min?utm_content=trnpilot). Planning a pilot? [Open the contact form](https://peopletechrevolution.com/training/how-a-pilot-runs#contact) Ask our CEO Simon Lowe’s Digital Twin a question ## Sources Each standard and result at its source. ### [The Kirkpatrick Model](https://www.kirkpatrickpartners.com/the-kirkpatrick-model/) Kirkpatrick Partners The levels; start with results. ### [The innovation buying journey](https://www.digital.nsw.gov.au/delivery/test-and-buy-innovation/innovation-buying-journey) Digital NSW Staged testing with decision gates. ### [Healthcare Simulation Standards: The Debriefing Process](https://doi.org/10.1016/j.ecns.2021.08.011) INACSL, 2021 A planned debrief in every simulation activity. ### [Mater immersive learning pilot](https://peopletechrevolution.com/uploads/docs/people-tech-revolution-mater-immersive-learning-pilot-case-study.pdf) Mater Education evaluation Concentration and demand for more VR training. ### [VR inclusion training at Google (ACM CHI 2024)](https://peopletechrevolution.com/uploads/docs/people-tech-revolution-google-vr-inclusion-training-chi-2024.pdf) Peer-reviewed paper Survey return, agreement, satisfaction, debrief allocation. ### [Promoting nursing diversity, equity and inclusion through virtual reality](https://doi.org/10.1097/NNA.0000000000001503) Journal of Nursing Administration, 2024 Delivery period and evaluation return.