- Open Access
Significance of debriefing methods in simulation-based sedation training courses for medical safety improvement in Japan
SpringerPlus volume 3, Article number: 637 (2014)
Based on the American Society of Anesthesiologists’ Practice Guidelines for Sedation and Analgesia by Non-Anesthesiologists (ASA-SED), a sedation training course aimed at improving medical safety was developed by the Japanese Association for Medical Simulation in 2011. This study evaluated the effect of debriefing on participants’ perceptions of the essential points of the ASA-SED.
A total of 38 novice doctors participated in the sedation training course during the research period. Of these doctors, 18 participated in the debriefing group, and 20 participated in non-debriefing group. Scoring of participants’ guideline perceptions was conducted using an evaluation sheet (nine items, 16 points) created based on the ASA-SED.
The debriefing group showed a greater perception of the ASA-SED, as reflected in the significantly higher scores on the evaluation sheet (median, 16 points) than the control group (median, 13 points; p < 0.05). No significant differences were identified before or during sedation, but the difference after sedation was significant (p < 0.05).
Debriefing after sedation training courses may contribute to better perception of the ASA-SED, and may lead to enhanced attitudes toward medical safety during sedation and analgesia.
Sedation is performed in various medical procedures and examinations. Because most of these procedures are performed in environments which lack monitoring and emergency medication, inappropriate sedation causes various challenges about medical safety (Desai 2008).
In 1993, the American Society of Anesthesiologists published the Practice Guidelines for Sedation and Analgesia by Non-Anesthesiologists (ASA-SED), which was updated in 2002. These guidelines set forth recommendations and cautions for non-anesthesiologists to ensure safe and effective sedation and analgesia. High quality, safe sedation requires preoperative patient examination, confirmation of fasting time, appropriate monitoring, adequate emergency equipment, compliance with drug administration principles, and validation of discharge criteria. Practitioners are also cautioned to be aware that the level of sedation changes under different circumstances (Practice Guidelines for Sedation and Analgesia by Non-Anesthesiologists 96).
In 2011, the Japanese Association for Medical Simulation developed a simulation-based sedation training course (SEDTC), with the goal of improving the safety of sedation and analgesia performed by non-anesthesiologists. Participants in the course are expected to demonstrate (1) appropriate preparation for sedation, (2) appropriate management of drug-induced hypoxia and/or shock, and (3) effective communication skills (Komasawa et al.).
Debriefing and reflection is a vital component of simulation training. Feedback associated with debriefing gives learners the opportunity to think critically about their performance. Learners can deconstruct events and errors that unfold during the scenario, and acquire new information to improve subsequent practice by appropriate debriefing (Aronson 2011; Sawyer et al. 2013).
We hypothesized that debriefing would enhance the perceptions of essential points of the ASA-SED, as well as attitudes toward medical safety and sedation during simulation-based SEDTCs. To this end, we evaluated the effect of debriefing on participants’ perceptions of the essential points of the ASA-SED.
This study was approved by the Institutional Review Board of Hyogo College of Medicine (No.1317), and participation in the course was considered as consent to participate in the study.
Contents of the course are summarized in Table 1. The SEDTC included the following: a lecture introducing the ASA-SED, a discussion and card simulation about several sedatives and analgesics, basic airway management training using a manikin, and scenario-based training using a simulator. A 60-minute lecture summarizing the guidelines was also conducted. After training, participants engaged in a card-based discussion on characteristics and titration methods for sedative and analgesic medications (45 minutes), hands-on emergency airway management practice (including insertion of supraglottic devices such as laryngeal and ventilation masks, 45 minutes), and simulated scenario training (60 minutes). Usually 10 participants per instructor participate in the SEDTC. In the first twelve courses, we did not apply debriefing and discussion and we evaluated the effect of debriefing from 13th courses.
SEDTCs were conducted with or without debriefing in the 13th, 16-19th, and 24th SEDTCs. Debriefing was performed or not in the last scenario-based training utilizing simulator. Conduct of debriefing was decided according to the envelope method. Instruction with debriefing was included in the 13th, 17th, and 19th courses, but not in the 16th, 18th, and 24th courses. The level of perceptions was evaluated for novice doctors (initial trainee doctors) who had less than two years of clinical experience in the Japanese medical system. Their clinical experience is 38 initial trainee doctors (22 males and 16 females, 25.3 ± 2.4 years old) is 0.9 ± 0.4 years. They attended SEDTC for the learning of principles/basics of effective and safe anesthesia.
Debriefing was provided in an ask-tell-ask approach, as follows: 1) students were asked to provide self-reflections about perceived strengths and areas for improvement; 2) faculty provided tailored responses that included specific feedback points based on observations; and 3) faculty asked students about the major take-home points from the debriefing and addressed any additional questions. In the non-debriefing group, participants were given feedback about appropriate action from the instructor.
An evaluation scenario was conducted immediately after the course. Scoring of participants’ guideline perceptions was conducted using an evaluation sheet (nine items, 16 points) that was created based on the ASA-SED (Table 2). We developed this checklist to reflect the each important points of ASA-SED. To avoid bias, the same instructor evaluated the score. The instructor passed the paper to participants which following scenario is written. We did not use this checklist during scenario training during SEDTC.
The evaluation scenario was as follows:
“A 50-year-old woman with body height of 150 cm and body weight of 40 kg underwent removal of multiple colon polyps via lower gastrointestinal endoscopy under sedation. The surgery ended 30 minutes earlier than originally planned. The patient was allergic to both eggs and soybeans. No specific problems were detected during preoperative examination. The patient was instructed to fast, without eating for six hours or drinking for two hours prior to surgery. All points to be confirmed and procedures to be conducted from the time of the patient’s admission until her discharge were spoken aloud. Please go through treatment under sedation. Please ask the instructor if you have any questions regarding the patient’s condition.”
In addition to evaluating participant perceptions of the guidelines, the satisfaction rate of individuals who participated in the course was evaluated using a 100 mm visual analog scale (VAS).
The Mann-Whitney U test was used to compare evaluation scores and the unpaired t-test was used to evaluate VAS scores for course satisfaction. P < 0.05 was considered statistically significant.
A total of 38 novice doctors participated in the SEDTC during the research period, with 18 trainees in the debriefing (D) group, and 20 in the non-debriefing (N) control group. The D group showed significantly higher evaluation scores than the N group, with median scores of 16 points and 13 points, respectively (p < 0.05). No significant differences were identified before or during sedation, but the difference after sedation was significant (p < 0.05). VAS scores for course satisfaction were significantly higher in the D group than in the N group (D group, 90.2 ± 7.0 mm; N group, 85.0 ± 7.9 mm; p < 0.05) (Table 3).
Sedation for procedure is administered to patients from various clinical situations by diverse practitioners (Lichtenstein et al. 2008; Daniels et al. 2013). Sedation includes a continuum of consciousness, progressing through mild, moderate, deep sedation, to general anesthesia. We could not always predict how an individual patient respond to the sedation performed. Though target levels of sedation have been defined, actual depth levels can easily fluctuate. Thus, the ASA-SED recommends that patients be continuously monitored by medical staff who does not directly involve in the procedure. The guideline also recommend that the sedation provider be qualified to rescue patients whose levels of sedation become deeper than initially intended (Practice Guidelines for Sedation and Analgesia by Non-Anesthesiologists 96). One closed claims analysis showed that the most common complication during procedural sedation is respiratory depression due to over-sedation (Desai 2008).
The purpose of the ASA-SED is to allow non-anesthesia doctors to provide their patients with the benefits of sedation while minimizing associated risks. Sedation and analgesia provide two general benefits. First, appropriate sedation allows patients to tolerate unpleasant procedures by relieving discomfort, anxiety, or pain. Second, sedation may expedite procedures that are not particularly uncomfortable, but that require patients to remain still in children and uncooperative adults. However, sedation sometimes result in cardiac or respiratory depression, which should be rapidly detected and appropriately managed in order to minimize the risks of adverse events (Moran et al. 2013). Furthermore, inadequate sedation may induce unnecessary patient discomfort or injury, if associated with a lack of cooperation or adverse physiologic and psychological responses to stress. Providing an appropriate level of sedation is sometimes difficult for non-anesthesiologists, and educational techniques such as simulation-based SEDTCs are important for improved safety management (Practice Guidelines for Sedation and Analgesia by Non-Anesthesiologists 96).
The positive effect simulation training can be maximized when it is closely aligned with the clinical situation or environment (Lorello et al. 2014). For this purpose, simulators have evolved from classic models to simulated virtual worlds (Abdelshehid et al. 2013). Effective debriefing and feedback have been identified as essential components of simulation-based training (Sawyer et al. 2012; Issenberg et al. 2005; McGaghie et al. 2010). The facilitation of simulation debriefings can provide novice doctors opportunity to learn various points by identifying and reflecting on the errors and findings (Naik et al. 2013).
Without debriefing, the level of post-care perceptions was found to be lower, particularly the level of perceptions following sedation. This simulation course provided an influential educational effect via debriefing, and resulted in a high rate of satisfaction. Especially, the consideration toward after sedation showed a marked improvement. Furthermore, debriefing provided not only an influential educational effect, but also a high rate of satisfaction.
Among the sedation phase, debriefing did not significantly improve the evaluation score on ‘before sedation’ and ‘both sedation’. In contrast, debriefing significantly improved evaluation score on ‘after sedation’. This result suggests that initial trainee doctors are difficult to imagine and cultivate their attitude about crisis after sedation. As postoperative complication is various, it may be difficult for novice doctors with small clinical experience about the safety management after sedation. Debriefing may debriefing may help initial trainee doctors for imagine and develop their idea toward post procedure sedation safety (Chung et al. 2013; Schmidt et al. 2013; Allen 2013).
In the present study, we did not evaluate their perception level before SEDTC. In their next study, we would like to consider including a 0-level questionnaire before the SEDTC in order to find out the level of knowledge prior to the study and evaluate the education effect of the course.
Anesthesiologists, who generally have deep understanding of respiratory physiology, airway management, and sedation and analgesia administration, should lead efforts to improve hospital-wide safety management. To achieve this, in addition to educating medical staff about sedation techniques, the sedation system must be reconstructed. For example, those who develop safety systems should also be obliged to monitor and determine standards for discharge. A deep understanding of sedation principles and safety management is important, as is the development of a system for hospital-wide medical safety (Kiersma et al. 2011). We anticipate that SEDTCs will contribute to this goal through the training of non-anesthesiologists.
Debriefing in SEDTCs may contribute to better perceptions of ASA-SED principles, and may lead to enhanced attitudes toward medical safety during sedation and analgesia.
American Society of Anesthesiologists’ Practice Guidelines for Sedation and Analgesia by Non-Anesthesiologists
Sedation training course
Visual analog scale.
Abdelshehid CS, Quach S, Nelson C, Graversen J, Lusch A, Zarraga J, Alipanah R, Landman J, McDougall EM: High-fidelity simulation-based team training in urology: evaluation of technical and nontechnical skills of urology residents during laparoscopic partial nephrectomy. J Surg Educ 2013, 70: 588-595. 10.1016/j.jsurg.2013.04.009
Allen LC: Role of a quality management system in improving patient safety - Laboratory aspects. Clin Biochem 2013, 46: 1187-1193. 10.1016/j.clinbiochem.2013.04.028
Aronson L: Twelve tips for teaching reflection at all levels of medical education. Med Teach 2011, 33: 200-205. 10.3109/0142159X.2010.507714
Chung HS, Dieckmann P, Issenberg SB: It is time to consider cultural differences in debriefing. SB. Simul Healthc 2013, 8: 166-170. 10.1097/SIH.0b013e318291d9ef
Daniels K, Auguste T: Moving forward in patient safety: multidisciplinary team training. Semin Perinatol 2013, 37: 146-150. 10.1053/j.semperi.2013.02.004
Desai MS: Office-based anesthesia: new frontiers, better outcomes, and emphasis on safety. Curr Opin Anaesthesiol 2008, 21: 699-703. 10.1097/ACO.0b013e328313e879
Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ: Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005, 27: 10-28. 10.1080/01421590500046924
Kiersma ME, Plake KS, Darbishire P: Patient safety instruction in US health professions education. Am J Pharm Educ 2011, 75: 162. 10.5688/ajpe758162
Komasawa N, Fujiwara S, Atagi K, Ueki R, Haba M, Ueshima H, Kaminoh Y, Minami T: Effects of a simulation-based sedation training course on non-anesthesiologists’ attitudes toward sedation and analgesia. J Anesth 2014, 28: 785-789. 10.1007/s00540-014-1787-9
Lichtenstein DR, Jagannath S, Baron TH, Anderson MA, Banerjee S, Dominitz JA, Fanelli RD, Gan SI, Harrison ME, Ikenberry SO, Shen B, Stewart L, Khan K, Vargo JJ: Sedation and anesthesia in GI endoscopy. Gastrointest Endosc 2008, 68: 815-826. 10.1016/j.gie.2008.09.029
Lorello GR, Cook DA, Johnson RL, Brydges R: Simulation-based training in anesthesiology: a systematic review and meta-analysis. Br J Anaesth 2014, 112: 231-245. 10.1093/bja/aet414
McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ: A critical review of simulation-based medical education research: 2003-2009. Med Educ 2010, 44: 50-63. 10.1111/j.1365-2923.2009.03547.x
Moran TC, Kaye AD, Mai AH, Bok LR: Sedation, analgesia, and local anesthesia: a review for general and interventional radiologists. Radiographics 2013, 33: E47-E60. 10.1148/rg.332125012
Naik VN, Brien SE: Review article: simulation: a means to address and improve patient safety. Can J Anaesth 2013, 60: 192-200. 10.1007/s12630-012-9860-z
Practice Guidelines for Sedation and Analgesia by Non-Anesthesiologists: An updated report by the American Society of Anesthesiologists Task Force on Sedation and Analgesia by Non-Anesthesiologists. Anesthesiology 96: 1004-1017.
Sawyer Sierocka-Castaneda A, Chan D, Berg B, Lustik M, Thompson M: The effectiveness of video-assisted debriefing versus oral debriefing alone at improving neonatal resuscitation performance: a randomized trial. Simul Healthc 2012, 7: 213-221. 10.1097/SIH.0b013e3182578eae
Sawyer TL, Deering S: Adaptation of the US Army's After-Action Review for Simulation Debriefing in Healthcare. Simul Healthc 2013, 8: 388-397. 10.1097/SIH.0b013e31829ac85c
Schmidt E, Goldhaber-Fiebert SN, Ho LA, McDonald KM: Simulation exercises as a patient safety strategy: a systematic review. Ann Intern Med 2013, 158: 426-432. 10.7326/0003-4819-158-5-201303051-00010
Financial support for this study was provided by the authors’ institutions and departments.
The authors declare that they have no competing interests.
NK, SF, TS, MH, and RU performed study design, conducted the study, data analysis, and wrote the manuscript; YK: conducted the study and data analysis; and TM: study design and manuscript preparation. All authors read and approved the final manuscript.
About this article
Cite this article
Komasawa, N., Sanuki, T., Fujiwara, S. et al. Significance of debriefing methods in simulation-based sedation training courses for medical safety improvement in Japan. SpringerPlus 3, 637 (2014). https://doi.org/10.1186/2193-1801-3-637
- Sedation and analgesia
- Simulation training
- Medical safety