<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "https://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<article article-type="research-article" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
        <journal-meta>
      <journal-id journal-id-type="nlm-ta">ASR</journal-id>
      <journal-id journal-id-type="iso-abbrev">Archives of Surgical Research</journal-id>
      <journal-title-group>
        <journal-title>Archives of Surgical Research</journal-title>
      </journal-title-group>
      <issn pub-type="epub">1233-6133</issn>
      <issn-l>1233-6133</issn-l>
      <publisher>
        <publisher-name>Pakistan Endocrine and Thyroid Surgeons Association (PETSA)</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">PJMS-34-530</article-id>
      <article-id pub-id-type="doi">10.1133139/pjms.343.14345</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Original Investigation</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Revalidating “Mini Surgical Theater Educational Environment Measure (mini-STEEM)”: Is it a Content Valid Instrument?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>Jahangeer</surname>
            <given-names>Ahmad</given-names>
          </name>
        <xref ref-type="aff" rid="StLuke"/>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Hadia</surname>
            <given-names>Baig</given-names>
          </name>
         <xref ref-type="aff" rid="StLuke"/>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Zaitoon</surname>
            <given-names>Zafar</given-names>
          </name>
        <xref ref-type="aff" rid="StLuke"/>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Talat</surname>
            <given-names>Waseem</given-names>
          </name>
        <xref ref-type="aff" rid="StLuke"/>
        </contrib>
      </contrib-group>
      <aff id="StLuke">...</aff>
      <author-notes>
        <fn fn-type="con">
          <p>Department of Surgery, Shalamar Medical and Dental College, Lahore, Pakistan</p>
        </fn>
        <fn>
          <p>Mr Talat Waseem FRCS Eng, FACS,Consultant Surgeon Shalamar Medical and Dental College, Lahore

            <email>twaseem@gmail.com</email></p>
        </fn>
      </author-notes>
      <pub-date date-type="pub" iso-8601-date="1999-03-27" publication-format="print">
        <day>27</day>
        <month>03</month>
        <year>1999</year>
      </pub-date>
      <volume>318</volume>
      <issue>7187</issue>
      <fpage>837</fpage>
      <lpage>841</lpage>
      <history>
        <date date-type="accepted" iso-8601-date="1999-01-29">
          <day>29</day>
          <month>01</month>
          <year>1999</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>Copyright © 1999, British Medical
Journal</copyright-statement>
        <copyright-year>1999</copyright-year>
      </permissions>
      <abstract>
        <p>Operating Room-based student learning is multifactorial and has traditionally been suboptimal.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
      <sec id="sec-1_1">
        <title>Introduction</title>
        <p>Operating Room (OR) based learning experience has traditionally remained challenging owing to complex medical, psychosocial, educational, and administrative factors, and so has its measurement. Recently, mini-STEEM, an abbreviated form of Surgical Theater Educational Experience Measure (STEEM), has been employed to evaluate medical students’ OR-based learning experience. This study aims to assess its content and construct validity in light of an updated extensive literature review. </p>
      </sec>
      <sec id="sec-1_2">
        <title>Methods</title>
        <p>Extensive literature review was done to identify and evaluate various factors affecting students' OR-based learning within the OR-setting. Expert validation of the items was done in light of constructs identified through literature review by 8 experts who had experience both in surgical teaching and medical education. The item content validity index (I-CVI) was assessed. Thematic analysis of the qualitative responses was done to understand the dynamics of validity scores. Factor analysis was performed to see the factor loadings for the items and their model fitness. </p>
      </sec>
      <sec id="sec-1_3">
        <title>Results</title>
        <p>Against previously identified 26 constructs, mini-STEEM items were expert-validated for clarity, relevance, and comprehension. The item content validity index was suboptimal and did not cover all of the dimensions and constructs identified through a previous literature review. Reliability was checked through Cronbach’s alpha (0.779) after piloting through a cohort of students (n=156). Qualitative analysis revealed that mini-STEEM does not cover all of the domains essential for student learning within the OR setting, and does not have adequate representative items to address all elements. Exploratory factor analysis (EFA) showed reasonable loadings; however, the model fitness through confirmatory factor analysis (CFA) was not possible considering low or no representation of most of the themes. </p>
      </sec>
      <sec id="sec-1_4">
        <title>Conclusion</title>
        <p>In light of evolving literature evidence, the content validity of mini-STEEM to assess the quality of medical students' OR-based learning experience remains low, despite having good reliability and construct loadings. </p>
      </sec>
      <sec id="sec-1_5">
        <title>Keywords</title>
        <p>
          <italic>Operating Room; Operation Theater; Learning; Student; Resident; Quality of Learning Experience; Structured Learning; STEEM; </italic>
          <italic>mini-STEEM; Content </italic>
          <italic>validity</italic>
        </p>
      </sec>
    
    <sec id="sec-2">
      <title>Introduction</title>
      <p>The dynamic environment within the Operating Room (OR) provides a real-life venule for medical students’ learning<xref ref-type="bibr" rid="bib1">1</xref> <xref ref-type="bibr" rid="bib2">2</xref>.However, there are many medical, social, ethical, and administrative factors involved, which make learning within the OR setting exigent for teachers and learners both<xref ref-type="bibr" rid="bib2">2</xref> <xref ref-type="bibr" rid="bib3">3</xref>. Recently, many experts in this area have generated a new conceptual framework highlighting various important factors that influence the quality of OR-based student learning<xref ref-type="bibr" rid="bib1">1</xref> <xref ref-type="bibr" rid="bib2">2</xref>.Lyon's model focuses on student-driven learning within the OR, while Roberts et al. stress a more deliberate learning process for the medical students <xref ref-type="bibr" rid="bib3">3</xref> <xref ref-type="bibr" rid="bib4">4</xref>.There is a consensus that the learning process within at large remains opportunistic, unstructured, un-driven, and hence substandard <xref ref-type="bibr" rid="bib1">1</xref> <xref ref-type="bibr" rid="bib2">2</xref>.Consequently, the OR setting's standardized learning process and quality assurance remain the key for enhanced OR learning. </p>
      <p>Nagraj et al. previously proposed the instrument ‘mini-STEEM’ to assess the quality of student learning within the OR environment, which is an abbreviated form of Kevin Cassar’s Surgical Theater Educational Environment Measure<xref ref-type="bibr" rid="bib5">5</xref> <xref ref-type="bibr" rid="bib6">6</xref> .This instrument by Kevin Cassar was primarily designed for the residents and is a reliable and content valid<xref ref-type="bibr" rid="bib6">6</xref>. Recently in multiple systematic literature reviews, many important OR-based learning determinants have been identified, and a more comprehensive conceptual framework has been developed <xref ref-type="bibr" rid="bib1">1</xref> <xref ref-type="bibr" rid="bib2">2</xref> <xref ref-type="bibr" rid="bib7">7</xref>. Mini-STEEM, although reliable with reasonable Cronbach’s alpha value, does not assess all domains which pertain to medical students' learning experience within the OR setting.<sup>12</sup></p>
      <p>In light of an improved understanding of OR-based learning and multiple recent literature reviews that identify many essential domains of student learning within the OR setting, there is a clear need for re-validation of the mini-STEEM. This study aims to assess the content validity, reliability, and construct validity of mini-STEEM. </p>
    </sec>
    <sec id="sec-3">
      <title>Methodology</title>
      
        <p>Following ethical approval from the local institutional review, a board study was conducted, as shown in Figure 1. In the first phase, we relied on the previously published literature evidence<xref ref-type="bibr" rid="bib8">8</xref> <xref ref-type="bibr" rid="bib8">8</xref> <xref ref-type="bibr" rid="bib9">9</xref> .The literature search was conducted on PubMed, ERIC, and Google Scholar. Thematic analysis and review were performed to identify the factors influencing OR-based student learning. Additionally, the study consisted of the analysis of various models and scales currently being used to assess the OR-based student learning<xref ref-type="bibr" rid="bib8">8</xref> <xref ref-type="bibr" rid="bib10">10</xref> <xref ref-type="bibr" rid="bib11">11</xref>.The conceptual framework and previously identified themes were used as reference (Table 1 and Figure 2).  </p>
        <p>“Table 1: Expert Validation of mini-STEEM based on Conceptual Framework”</p>
        <table-wrap id="tbl1">
          <table>
            <tr>
              <td>
                <p>
                  <bold>Themes (5)</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>Subthemes (26)</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>Mini-STEEM Items</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>Representative Qualitative Statements</bold>
                </p>
              </td>
              <td colspan="2">
                <p>
                  <bold>I-CVI</bold>
                </p>
              </td>
            </tr>
            <tr>
              <td rowspan="26">
                <p>
                  <bold>STRUCTURED LEARNING PROCESS</bold>
                </p>
                <p>(Structured Course /Lesson Planning, Content Selection, Delivery, Assessment &amp; Administration)</p>
              </td>
              <td>
                <p>Structured or Opportunistic OR learning </p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2" rowspan="26">
                <p>
                  <italic>“The students prefer a structured and well-planned learning process within operating theatre realm instead of opportunistic learning process—this inventory does not </italic>
                  <italic>adequately assess whether learning is structured or opportunistic”</italic>
                </p>
                <p>
                  <italic>“Like any learning process learning objectives should be formulated prior to lesson and following the convention of medical education should be specific, measurable, attainable, relevant, targeted &amp; time-bound (SMART)…these learning objectives should conform to the  rest of teaching…… students should have room for their own personal learning objectives to promote diversity in learning process—Mini-STEEM does not address these important themes”</italic>
                </p>
                <p>
                  <italic>“The items pertaining to content selection are quite relevant, however they do not represent all of factors influencing this process. For example, it does not assess the process of curricular design and the involvement of students in this whole process. It does assess the ‘briefing’ component of Robert’s “Briefing-Intraoperative Teaching-Debriefing” model however does not appraise the mechanism of intraoperative teaching and debriefing session.”</italic>
                </p>
                <p>
                  <italic>“Mini-STEEM overlooks and does not evaluate the process of assessment or delivery of constructive feedback to the student about their performance in OR learning”</italic>
                </p>
                <p>
                  <italic>“The instrument does not gauge the process of assessment of skills and affective domains of learning.” </italic>
                </p>
                <p>
                  <italic>“In mini-STEEM, theatre sessions reflect a segment of opportunity for learning. The items however have been primarily designed for the residents and it reflects in structure of these items. For example, it may be quite hard to provide opportunity to scrub along with the surgeon and make this a standard considering the increasing number of students and residents. The last three items clearly pertain to residents not medical students.”</italic>
                </p>
              </td>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Design and Communication of Learning Objectives for OR learning </p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Clarity of Learning Objectives</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Feasibility of learning objectives to be realistically achievable </p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Synchronization of the learning objectives with rest of the teaching.</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Importance of Personal Learning Objectives in OR Learning</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Content Selection, delivery, assessment and their alignment to essential aspects of graduate learning </p>
              </td>
              <td>
                <p>Before the operation my trainer discusses the surgical technique planned</p>
                <p>The elective operating list has the right case mix to suit my training</p>
                <p>The variety of emergency cases gives me the appropriate exposure</p>
                <p>On this unit the types of operations performed are too complex for my level*</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0.92</p>
                <p>0.73</p>
                <p>0.75</p>
                <p>0.81</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Optimal student-teacher interaction &amp; opportunities for equal participation </p>
              </td>
              <td>
                <p>I get enough opportunity to assist</p>
                <p>There are enough theatre sessions per week for me to gain the appropriate experience</p>
                <p>The anaesthetists put pressure on my trainer to operate himself to reduce anaesthetic time*</p>
                <p>I am too busy doing other work to go to theatre*</p>
                <p>When I am in theatre, there is nobody to cover the ward*</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0.65</p>
                <p>0.76</p>
                <p>0.63</p>
                <p>0.51</p>
                <p>0.42</p>
              </td>
            </tr>
            <tr>
              <td rowspan="18">
                <p>
                  <bold>QUALITY OF FACULTY &amp;TRAINING</bold>
                </p>
                <p>(Educator Related Factors)</p>
              </td>
              <td>
                <p>Interest of educator </p>
              </td>
              <td>
                <p>My trainer is enthusiastic about teaching</p>
              </td>
              <td colspan="2" rowspan="18">
                <p>
                  <italic>"The first item in this section is quite representative, relevant, and clear in terms of assessing the interest of the teacher, which </italic>
                  <italic>to</italic>
                  <italic> many students, remains a central component."</italic>
                </p>
                <p>
                  <italic>"This section, in terms of the number of items remains under-represented."</italic>
                </p>
                <p>
                  <italic>“</italic>
                  <italic>mini-STEEM</italic>
                  <italic> does not effectively evaluate the importance of teacher’s competence, teaching style, and educator’s preparedness.”</italic>
                </p>
              </td>
              <td colspan="2">
                <p>0.95</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Importance of the educator's behavior and attitude</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Competency of educator</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Importance of teaching style</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Importance of teacher’s preparedness</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td rowspan="13">
                <p>
                  <bold>ORGANIZATIONAL SUPPORT</bold>
                </p>
              </td>
              <td>
                <p>Significance of OR orientation session.</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2" rowspan="13">
                <p>
                  <italic>"The only item of this section is quite representative, but at best would only evaluate environmental readiness to a subjective extent. We need items to assess the provision and use of technology for better visualization of the procedures and synchronization with the simulation lab or simulated-OR based learning."</italic>
                </p>
                <p>
                  <italic>"Orientation session about the working within the theatre, sterilization protocols, patient safety measures, etc. all can be quite helpful."</italic>
                </p>
              </td>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Importance of environmental readiness</p>
              </td>
              <td>
                <p>The atmosphere in theatre is pleasant</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0.87</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Synchronization simulation / Lab activities with OR lessons </p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Importance of adequate visualization in student learning </p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td rowspan="9">
                <p>
                  <bold>PSYCHOSOCIAL MANAGEMENT &amp; TRAINING</bold>
                </p>
              </td>
              <td>
                <p>Impact of anxiety in the OR environment</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2" rowspan="9">
                <p>
                  <italic>“mini-STEEM quite rightly assesses the discrimination based on race—quite valuable items”</italic>
                </p>
                <p>
                  <italic>"It also effectively judges the role of a friendly environment and its impact on student learning."</italic>
                </p>
                <p>
                  <italic>"It does not, however, assess any mechanism to address the issue of intimidation and victimization within the OR environment, the mechanism for </italic>
                  <italic>redressal</italic>
                  <italic> and role of faculty training in this regard."</italic>
                </p>
              </td>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Effect of fear, intimidation, discrimination or victimization in OR learning environment</p>
              </td>
              <td>
                <p>I feel discriminated against in theatre because of my sex*</p>
                <p>I feel discriminated against in theatre because of my race*</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0.83</p>
                <p>0.81</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Impact of feeling welcome in OR</p>
              </td>
              <td>
                <p>The theatre staff are friendly</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0.88</p>
              </td>
            </tr>
            <tr>
              <td rowspan="6">
                <p>
                  <bold>STUDENT’S SELF-REGULATION, MOTIVATION &amp; PARTICIPATION</bold>
                </p>
              </td>
              <td>
                <p>Ability to self-regulate learning in OR</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2" rowspan="6">
                <p>
                  <italic>"According to Lyon's model of OR-based learning, student's capacity to self-regulate is of pivotal importance and is an independent predictor of student's quality of OR experience."</italic>
                </p>
                <p>
                  <italic>"The inventory does not assess student's talent to self-regulate, readiness to participate, and </italic>
                  <italic>motivation to make this learning process more productive."</italic>
                </p>
                <p>
                  <italic>“Likewise, mini-STEEM does not explore the role of student's self-confidence, focus on practicing the motor and affective skills, and pre-operative self-review of the learning material to prime for a more enriched learning experience."</italic>
                </p>
              </td>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Impact of student’s motivation</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Impact of self confidence </p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Student’s Prior Knowledge &amp; Pre-lesson self-review of reading material</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Student's readiness to participate</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Student’s Focus on Practice of skills</p>
              </td>
              <td>
                <p>No representative Item</p>
              </td>
              <td colspan="2"/>
              <td colspan="2">
                <p>0</p>
              </td>
            </tr>
          </table>
        </table-wrap>
        <p>Figure 1: Flow Chart describing the components of study and instrument evaluation</p>
        <fig id="fig1">
          <graphic mimetype="image" mime-subtype="jpeg" xlink:href="image1.jpg"/>
        </fig>
        <p>Figure 2: Factors affecting student learning in Operating Room: A conceptual Framework</p>
        <fig id="fig2">
          <graphic mimetype="image" mime-subtype="jpeg" xlink:href="image2.jpg"/>
        </fig>
        <p>In phase 2, the scale was content validated by 8 experts, and the I-CVI estimation was done as described previously. The qualitative data regarding the mini-STEEM items was subjected to thematic analysis. </p>
        <p>The mini-STEEM scale was piloted among 202 students. The mean item scores and their respective SD has been described in Table 2. Exploratory factor analysis (Principal Component Analysis) was done to check for the construct validity, and Cronbach alpha estimation was done to evaluate the reliability of the constructs (Table 3).</p>
        <p>“Table 2: mini-STEEM Item Scores, Means and SD”</p>
        <table-wrap id="tbl2">
          <table>
            <tr>
              <td>
                <p>
                  <bold>Sr. No</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>Mini-STEEM Items</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>N</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>Min</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>Max</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>Mean</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>Std. Deviation</bold>
                </p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>1</bold>
                </p>
              </td>
              <td>
                <p>My trainer is enthusiastic about teaching.</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>1.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>2.327</p>
              </td>
              <td>
                <p>1.1251</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>2</bold>
                </p>
              </td>
              <td>
                <p>The theatre staff are friendly.</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>1.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>2.535</p>
              </td>
              <td>
                <p>1.2303</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>3</bold>
                </p>
              </td>
              <td>
                <p>There are enough theatre sessions per week for me to gain the appropriate experience.</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>1.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>2.866</p>
              </td>
              <td>
                <p>1.3147</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>4</bold>
                </p>
              </td>
              <td>
                <p>Before the operation my trainer discusses the surgical Technique planned.</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>1.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>2.782</p>
              </td>
              <td>
                <p>1.1642</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>5</bold>
                </p>
              </td>
              <td>
                <p>The elective operating list has the right case mix to suit my training.</p>
              </td>
              <td>
                <p>200</p>
              </td>
              <td>
                <p>1.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>2.770</p>
              </td>
              <td>
                <p>1.0830</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>6</bold>
                </p>
              </td>
              <td>
                <p>The variety of emergency cases gives me the appropriate exposure.</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>1.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>2.896</p>
              </td>
              <td>
                <p>1.2634</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>7</bold>
                </p>
              </td>
              <td>
                <p>I get enough opportunity to assist.</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>3.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>4.213</p>
              </td>
              <td>
                <p>.7722</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>8</bold>
                </p>
              </td>
              <td>
                <p>On this unit the types of operations performed are too complex for my level.*</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>3.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>3.851</p>
              </td>
              <td>
                <p>.7037</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>9</bold>
                </p>
              </td>
              <td>
                <p>The anaesthetists put pressure on my trainer to operate himself to reduce anaesthetic time*</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>3.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>3.955</p>
              </td>
              <td>
                <p>.8364</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>10</bold>
                </p>
              </td>
              <td>
                <p>I feel discriminated against in theatre because of my sex*</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>1.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>3.663</p>
              </td>
              <td>
                <p>1.3985</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>11</bold>
                </p>
              </td>
              <td>
                <p>I feel discriminated against in theatre because of my race*</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>1.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>4.069</p>
              </td>
              <td>
                <p>1.3696</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>12</bold>
                </p>
              </td>
              <td>
                <p>I am too busy doing other work to go to theatre*</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>3.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>4.158</p>
              </td>
              <td>
                <p>.7562</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>
                  <bold>13</bold>
                </p>
              </td>
              <td>
                <p>The atmosphere in theatre is pleasant.</p>
              </td>
              <td>
                <p>202</p>
              </td>
              <td>
                <p>3.0</p>
              </td>
              <td>
                <p>5.0</p>
              </td>
              <td>
                <p>3.995</p>
              </td>
              <td>
                <p>.7498</p>
              </td>
            </tr>
            <tr>
              <td/>
              <td>
                <p>Total</p>
              </td>
              <td/>
              <td>
                <p> </p>
              </td>
              <td>
                <p> </p>
              </td>
              <td>
                <p>44.082</p>
              </td>
              <td>
                <p> </p>
              </td>
            </tr>
          </table>
        </table-wrap>
        <p>“Table 3: Reliability Factor Loadings related toPrincipal Component Analysis of mini-STEEM”</p>
        <table-wrap id="tbl3">
          <table>
            <tr>
              <td colspan="6">
                <p>
                  <bold>Rotated Component </bold>
                  <bold>Matrix</bold>
                  <bold>
                    <sup>a</sup>
                  </bold>
                </p>
              </td>
              <td rowspan="3">
                <p>
                  <bold>Cronbach's Alpha</bold>
                </p>
              </td>
              <td rowspan="3">
                <p>
                  <bold>Cronbach's Alpha Based on Standardized Items</bold>
                </p>
              </td>
              <td>
                <p>
                  <bold>N of Items</bold>
                </p>
              </td>
            </tr>
            <tr>
              <td rowspan="2">
                <p>
                  <bold> </bold>
                </p>
              </td>
              <td colspan="5">
                <p>Component</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td/>
              <td colspan="2">
                <p>1</p>
              </td>
              <td>
                <p>2</p>
              </td>
              <td>
                <p>3</p>
              </td>
              <td>
                <p>4</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>6. The variety of emergency cases gives me the appropriate exposure.</p>
              </td>
              <td colspan="2">
                <p>.740</p>
              </td>
              <td>
                <p>.224</p>
              </td>
              <td>
                <p>-.073</p>
              </td>
              <td>
                <p>.116</p>
              </td>
              <td>
                <p>.737</p>
              </td>
              <td>
                <p>.739</p>
              </td>
              <td>
                <p>5</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>3. There are enough theatre sessions per week for me to gain the appropriate experience.</p>
              </td>
              <td colspan="2">
                <p>.713</p>
              </td>
              <td>
                <p>-.044</p>
              </td>
              <td>
                <p>.056</p>
              </td>
              <td>
                <p>-.002</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>5. The elective operating list has the right case mix to suit my training.</p>
              </td>
              <td colspan="2">
                <p>.671</p>
              </td>
              <td>
                <p>-.117</p>
              </td>
              <td>
                <p>-.018</p>
              </td>
              <td>
                <p>-.132</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>4. Before the operation my trainer discusses the surgical Technique planned.</p>
              </td>
              <td colspan="2">
                <p>.650</p>
              </td>
              <td>
                <p>-.047</p>
              </td>
              <td>
                <p>-.091</p>
              </td>
              <td>
                <p>.048</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>1. My trainer is enthusiastic about teaching.</p>
              </td>
              <td colspan="2">
                <p>.593</p>
              </td>
              <td>
                <p>-.562</p>
              </td>
              <td>
                <p>-.099</p>
              </td>
              <td>
                <p>-.094</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>11. I feel discriminated against in theatre because of my race.</p>
              </td>
              <td colspan="2">
                <p>.126</p>
              </td>
              <td>
                <p>.844</p>
              </td>
              <td>
                <p>-.055</p>
              </td>
              <td>
                <p>.060</p>
              </td>
              <td>
                <p>0.696</p>
              </td>
              <td>
                <p>0.697</p>
              </td>
              <td>
                <p>2</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>10. I feel discriminated against in theatre because of my sex.</p>
              </td>
              <td colspan="2">
                <p>-.005</p>
              </td>
              <td>
                <p>.813</p>
              </td>
              <td>
                <p>.218</p>
              </td>
              <td>
                <p>-.121</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>2. The theatre staff are friendly.</p>
              </td>
              <td colspan="2">
                <p>.463</p>
              </td>
              <td>
                <p>-.548</p>
              </td>
              <td>
                <p>.061</p>
              </td>
              <td>
                <p>.043</p>
              </td>
              <td>
                <p>-</p>
              </td>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>8. On this unit the types of operations performed are too complex for my level.</p>
              </td>
              <td colspan="2">
                <p>.091</p>
              </td>
              <td>
                <p>.010</p>
              </td>
              <td>
                <p>.780</p>
              </td>
              <td>
                <p>.002</p>
              </td>
              <td>
                <p>.537</p>
              </td>
              <td>
                <p>.539</p>
              </td>
              <td>
                <p>3</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>9. The anesthetists put pressure on my trainer to operate himself to reduce anesthetic time.</p>
              </td>
              <td colspan="2">
                <p>.039</p>
              </td>
              <td>
                <p>.137</p>
              </td>
              <td>
                <p>.683</p>
              </td>
              <td>
                <p>.239</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>13. The atmosphere in theatre is pleasant.</p>
              </td>
              <td colspan="2">
                <p>-.341</p>
              </td>
              <td>
                <p>-.020</p>
              </td>
              <td>
                <p>.643</p>
              </td>
              <td>
                <p>.010</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td>
                <p>7. I get enough opportunity to assist.</p>
              </td>
              <td colspan="2">
                <p>.183</p>
              </td>
              <td>
                <p>-.105</p>
              </td>
              <td>
                <p>.000</p>
              </td>
              <td>
                <p>.777</p>
              </td>
              <td>
                <p>.255</p>
              </td>
              <td>
                <p>.255</p>
              </td>
              <td>
                <p>2</p>
              </td>
            </tr>
            <tr>
              <td>
                <p>12. I am too busy doing other work to go to theatre.</p>
              </td>
              <td colspan="2">
                <p>-.211</p>
              </td>
              <td>
                <p>.063</p>
              </td>
              <td>
                <p>.224</p>
              </td>
              <td>
                <p>.683</p>
              </td>
              <td/>
              <td/>
              <td/>
            </tr>
            <tr>
              <td colspan="2">
                <p>Extraction Method: Principal Component Analysis.  Rotation Method: Varimax with Kaiser Normalization.</p>
                <p>a. Rotation converged in 5 iterations.</p>
              </td>
              <td colspan="7">
                <p>
                  <bold>KMO and Bartlett's Test</bold>
                </p>
                <p>Kaiser-Meyer-Olkin Measure of Sampling Adequacy..753</p>
                <p>Bartlett's Test of SphericityApprox. Chi-Square513.116</p>
                <p>df78</p>
                <p>Sig..000</p>
              </td>
            </tr>
          </table>
        </table-wrap>
        <p>The statistical analysis was done in SPSS, and SPSS Amos, and Cronbach alpha estimation, and the content validity index were measured as described previously[11]. </p>
     
    </sec>
    <sec id="sec-4">
      <title>Results</title>
      <p>In the first phase, the literature evidence was explored, and five basic domains of factors affecting the students' learning experience within the OR were identified as tabulated in Table 1. The corresponding conceptual framework has been described in Figure 2. These domains include structured learning process, quality of faculty and training, psychosocial management, organizational support, and students' ability to self-regulate. Based on these 5 themes, 26 different sub-themes were identified, tabulated in Table 1.</p>
      <p>In Phase 2 of this study, mini-STEEM items were content validated by 8 experts. The I-CVI and the corresponding expert analysis of these items have been summarized in Table 1, along with their representative expert quotes.</p>
      <p>Based on literature evidence, the experts consider the structured learning process to be one of the most critical factors influencing the quality of overall learning experience within the OR setting. Mini-STEEM has 9 items to assess the structured learning process, concentrating mostly on the process of content selection and quality of student-teacher interaction. However, these items do not determine structured vs. opportunistic learning, the learning objectives' design and their adequate communication to the students. </p>
      <sec id="sec-4_1">
        <title>STRUCTURED LEARNING PROCESS:</title>
        <p>The structured learning approach provides a framework for students to follow and includes specified preassigned readings, immediate feedback from their tutors following a clinical experience and the use of systematically organized instructional methodologies. This approach is also effective in enforcing the deliberate practice of clinical skills acquisition. </p>
        <p>According to one expert, “<italic>The students prefer a structured and well-planned learning process within the operating theatre realm instead of an opportunistic learning process—this inventory does not adequately assess whether learning is structured or opportunistic."</italic></p>
        <p>For the OR experience to be beneficial, it is of paramount importance that practical learning objectives are formulated and are communicated with the students.The involvement of learners in the formation of learning objectives allows them to recognize the areas where skills need to be acquired. With regard to learning objectives, an expert pointed out that <italic>"like any learning process, learning objectives should be formulated prior to the lesson and following the convention of medical education, should be specific, measurable, attainable, relevant, targeted &amp; time-bound (SMART)…these learning objectives should conform to the rest of teaching…… students should have room for their learning objectives to promote diversity in the learning process—Mini-STEEM does not address these important themes."</italic></p>
        <p>Moreover, another expert stated that <italic>"the items on the content selection are quite relevant; however, they do not represent all of the factors influencing this process. For example, it does not assess the process of curricular design and students' involvement in this whole process. It does assess the 'briefing' component of Robert's "Briefing-Intraoperative Teaching-Debriefing" model; however, it does not appraise the mechanism of intraoperative teaching and debriefing session." </italic>An intraoperative discussion can be developed from the set learning objectives in the briefing session. This model ensures that no operating room encounter goes purposeless for the learner and allows the preceptor and the learner to reflect on and reinforce the lessons learnt.   Not addressing these factors renders the evaluation made by mini-STEEM inadequate.</p>
        <p>Furthermore, an expert commented that<italic> "mini-STEEM overlooks and does not evaluate the process of assessment or delivery of constructive feedback to the student about their performance in OR learning."</italic></p>
        <p>And another stating that <italic>“the instrument does not gauge the process of assessment of skills and affective domains of learning.” </italic></p>
        <p>Surgical residents and medical students differ not only in their degree of knowledge and experience but also in their responsibilities and expectations from the OR encounter. It is therefore, impracticable to assess their needs and influencing factors on the same scale. As stated by an expert <italic>"in mini-STEEM, theatre sessions reflect a segment of opportunity for learning. The items, however, have been primarily designed for the residents, and it reflects in the structure of these items. For example, it may be quite hard to provide the opportunity to scrub along with the surgeon and make this a standard, considering the increasing number of students and residents. The last three items clearly pertain to residents, not medical students." </italic></p>
      </sec>
      <sec id="sec-4_2">
        <title>QUALITY OF FACULTY &amp; TRAINING</title>
        <p>Regarding the statement, “My trainer is enthusiastic about teaching” from mini-STEEM, one expert agreed that <italic>"the first item in this section is quite representative, relevant, and clear in terms of assessing the interest of the teacher, which for many students, remains a central component."</italic></p>
        <p>However, when the subtheme ‘competency of educator’ was questioned, an expert responded that <italic>"this section, in terms of the number of items remains under-represented."</italic></p>
        <p>Another expert observed that <italic>“mini-STEEM does not effectively evaluate the importance of teacher’s competence, teaching style, and educator’s preparedness.”</italic></p>
      </sec>
      <sec id="sec-4_3">
        <title>ORGANIZATIONAL SUPPORT</title>
        <p>The availability of basic and fundamental technology can have a remarkable impact on</p>
        <p> the theater-based learning.  </p>
        <p>It was highlighted by an expert that the statement ‘the atmosphere in the theatre is pleasant’ is<italic> "the only item of this section that is quite representative, but at best would only evaluate environmental readiness to a subjective extent. We need items to assess the provision and use of technology for better visualization of the procedures and synchronization with the simulation lab or simulated-OR based learning."</italic></p>
        <p>It was further added that an<italic> "orientation session about working within the theatre, sterilization protocols, patient safety measures, etc. all can be quite helpful."</italic></p>
      </sec>
      <sec id="sec-4_4">
        <title>PSYCHOSOCIAL MANAGEMENT &amp; TRAINING</title>
        <p>Medical students are subjected to a wide array of stimuli within the OR setting which can trigger a range of mixed emotions. Students must face new challenges whilst overcoming their emotions.  </p>
        <p>According to an expert <italic>"mini-STEEM quite rightly assesses the discrimination based on race—quite valuable items."</italic></p>
        <p>And in addition to that <italic>"it also effectively judges the role of a friendly environment and its impact on student learning."</italic></p>
        <p>Another expert further stated that <italic>"it does not, however, assess any mechanism to address the issue of intimidation and victimization within the OR environment, the mechanism for </italic><italic>redressal</italic><italic> and role of faculty training in this regard."</italic></p>
      </sec>
      <sec id="sec-4_5">
        <title>STUDENT’S SELF-REGULATION, MOTIVATION &amp; PARTICIPATION</title>
        <p>Based on the literature review, it has been seen that students’ attitude and their level of interest and responsiveness determines the drive of the surgeon to teach.    </p>
        <p>It was stated by an expert that <italic>"according to Lyon's model of OR-based learning, a student's capacity to self-regulate is of pivotal importance and is an independent predictor of student's quality of OR experience."</italic></p>
        <p>Regarding mini-STEEM, an expert mentioned that <italic>"the inventory does not assess students' talent to self-regulate, readiness to participate, and motivation to make this learning process more productive."</italic></p>
        <p>And <italic>"likewise, mini-STEEM does not explore the role of students' self-confidence, focus on practicing the motor and affective skills, and pre-operative self-review of the learning material to prime for a more enriched learning experience."</italic></p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Discussion</title>
      <p>Medical students’ learning experience is unique, differs from a resident's learning perspective, and is multifactorial. Previously, experts in this area have identified and prioritized various intermediary items, which regulate the learning process and quality outcomes. Many factors related to the structured learning process, organization, educator, student, and psychosocial domains determine the quality of overall learning experience in the OR setting. Previously, mini-STEEM, an abbreviated version of STEEM, has been used to assess the OR learning process's quality. However, its content validity has been challenged recently, considering expanding dimensions of the OR learning process.</p>
      <p>There is a growing body of literature that directs and indicates the expanding role of a structured learning process despite the difficulties of its implementation within the OR setting. The structured learning process involves careful course planning, delivery process, and assessment involving the psychomotor and affective components apart from the operative learning's cognitive portion. Similarly, educator-related and student-related factors significantly influence the learning process within the OR setting. Teacher's interest, competence, style, and welcoming attitude are independent predictors of quality OR learning. Faculty training in this regard can be pivotal and also provides chances for better student handling within the OR setting. The students' interest, receptive attitude, capacity to self-regulate learning and social handling within the OR can alter the outcomes of the learning process. The organizational support in terms of providing adequate technology and administrative support has additive value. Psychosocial training of the faculty and the students can positively affect the quality of learning process.</p>
    </sec>
    <sec id="sec-6">
      <title>References </title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="bib1">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hexter</surname>
              <given-names>Adam T.</given-names>
            </name>
            <name>
              <surname>O'Dowd-Booth</surname>
              <given-names>Christopher</given-names>
            </name>
            <name>
              <surname>Hunter</surname>
              <given-names>Alistair</given-names>
            </name>
          </person-group>
          <article-title>Factors that influence medical student learning in the operating room</article-title>
          <source>Medical Teacher</source>
          <volume>41</volume>
          <issue>5</issue>
          <page-range>555-560</page-range>
          <pub-id pub-id-type="doi">10.1080/0142159X.2018.1504163</pub-id>
          <issn>1466-187X</issn>
          <year>2019</year>
          <month>5</month>
        </element-citation>
      </ref>
      <ref id="bib2">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Croghan</surname>
              <given-names>Stefanie M.</given-names>
            </name>
            <name>
              <surname>Phillips</surname>
              <given-names>Catherine</given-names>
            </name>
            <name>
              <surname>Howson</surname>
              <given-names>William</given-names>
            </name>
          </person-group>
          <article-title>The operating theatre as a classroom: a literature review of medical student learning in the theatre environment</article-title>
          <source>International Journal of Medical Education</source>
          <volume>10</volume>
          <page-range>75-87</page-range>
          <pub-id pub-id-type="doi">10.5116/ijme.5ca7.afd1</pub-id>
          <issn>2042-6372</issn>
          <year>2019</year>
          <month>4</month>
          <day>23</day>
        </element-citation>
      </ref>
      <ref id="bib3">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Lyon</surname>
              <given-names>Patricia M. A.</given-names>
            </name>
          </person-group>
          <article-title>Making the most of learning in the operating theatre: student strategies and curricular initiatives</article-title>
          <source>Medical Education</source>
          <volume>37</volume>
          <issue>8</issue>
          <page-range>680-688</page-range>
          <pub-id pub-id-type="doi">10.1046/j.1365-2923.2003.01583.x</pub-id>
          <issn>0308-0110</issn>
          <year>2003</year>
          <month>8</month>
        </element-citation>
      </ref>
      <ref id="bib4">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Roberts</surname>
              <given-names>Nicole K.</given-names>
            </name>
            <name>
              <surname>Williams</surname>
              <given-names>Reed G.</given-names>
            </name>
            <name>
              <surname>Kim</surname>
              <given-names>Michael J.</given-names>
            </name>
            <name>
              <surname>Dunnington</surname>
              <given-names>Gary L.</given-names>
            </name>
          </person-group>
          <article-title>The briefing, intraoperative teaching, debriefing model for teaching in the operating room</article-title>
          <source>Journal of the American College of Surgeons</source>
          <volume>208</volume>
          <issue>2</issue>
          <page-range>299-303</page-range>
          <pub-id pub-id-type="doi">10.1016/j.jamcollsurg.2008.10.024</pub-id>
          <issn>1879-1190</issn>
          <year>2009</year>
          <month>2</month>
        </element-citation>
      </ref>
      <ref id="bib5">
        <element-citation publication-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Rabe</surname>
              <given-names>Chantal</given-names>
            </name>
            <name>
              <surname>Backhaus</surname>
              <given-names>Joy</given-names>
            </name>
            <name>
              <surname>Jo</surname>
              <given-names>Peter</given-names>
            </name>
            <name>
              <surname>Koenig</surname>
              <given-names>Sarah</given-names>
            </name>
          </person-group>
          <article-title>Students' perception of the educational environment in the operating theatre: development and psychometric evaluation of a questionnaire</article-title>
          <publisher-name>German Medical Science GMS Publishing House</publisher-name>
          <page-range>DocO13</page-range>
          <pub-id pub-id-type="doi">10.3205/17rime13</pub-id>
          <year>2017</year>
          <month>3</month>
          <day>7</day>
        </element-citation>
      </ref>
      <ref id="bib6">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Cassar</surname>
              <given-names>Kevin</given-names>
            </name>
          </person-group>
          <article-title>Development of an instrument to measure the surgical operating theatre learning environment as perceived by basic surgical trainees</article-title>
          <source>Medical Teacher</source>
          <volume>26</volume>
          <issue>3</issue>
          <page-range>260-264</page-range>
          <pub-id pub-id-type="doi">10.1080/0142159042000191975</pub-id>
          <issn>0142-159X</issn>
          <year>2004</year>
          <month>5</month>
        </element-citation>
      </ref>
      <ref id="bib7">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Shetty</surname>
              <given-names>Shohan</given-names>
            </name>
            <name>
              <surname>Zevin</surname>
              <given-names>Boris</given-names>
            </name>
            <name>
              <surname>Grantcharov</surname>
              <given-names>Teodor P.</given-names>
            </name>
            <name>
              <surname>Roberts</surname>
              <given-names>Kurt E.</given-names>
            </name>
            <name>
              <surname>Duffy</surname>
              <given-names>Andrew J.</given-names>
            </name>
          </person-group>
          <article-title>Perceptions, training experiences, and preferences of surgical residents toward laparoscopic simulation training: a resident survey</article-title>
          <source>Journal of Surgical Education</source>
          <volume>71</volume>
          <issue>5</issue>
          <page-range>727-733</page-range>
          <pub-id pub-id-type="doi">10.1016/j.jsurg.2014.01.006</pub-id>
          <issn>1878-7452</issn>
          <year>2014</year>
          <month>10</month>
        </element-citation>
      </ref>
      <ref id="bib8">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Lyon</surname>
              <given-names>Patricia</given-names>
            </name>
          </person-group>
          <article-title>A model of teaching and learning in the operating theatre</article-title>
          <source>Medical Education</source>
          <volume>38</volume>
          <issue>12</issue>
          <page-range>1278-1287</page-range>
          <pub-id pub-id-type="doi">10.1111/j.1365-2929.2004.02020.x</pub-id>
          <issn>0308-0110</issn>
          <year>2004</year>
          <month>12</month>
        </element-citation>
      </ref>
      <ref id="bib9">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Weinberg</surname>
              <given-names>Daniel</given-names>
            </name>
            <name>
              <surname>Saleh</surname>
              <given-names>Mahdi</given-names>
            </name>
            <name>
              <surname>Sinha</surname>
              <given-names>Yashashwi</given-names>
            </name>
          </person-group>
          <article-title>Twelve tips for medical students to maximise learning in theatre</article-title>
          <source>Medical Teacher</source>
          <volume>37</volume>
          <issue>1</issue>
          <page-range>34-40</page-range>
          <pub-id pub-id-type="doi">10.3109/0142159X.2014.932899</pub-id>
          <issn>1466-187X</issn>
          <year>2015</year>
          <month>1</month>
        </element-citation>
      </ref>
      <ref id="bib10">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Yusoff</surname>
              <given-names>Muhamad Saiful Bahri</given-names>
            </name>
          </person-group>
          <article-title>ABC of Content Validation and Content Validity Index Calculation</article-title>
          <source>Education in Medicine Journal</source>
          <volume>11</volume>
          <page-range>49-54</page-range>
          <pub-id pub-id-type="doi">10.21315/eimj2019.11.2.6</pub-id>
          <year>2019</year>
          <month>6</month>
          <day>28</day>
        </element-citation>
      </ref>
      <ref id="bib11">
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Waseem</surname>
              <given-names>Talat</given-names>
            </name>
            <name>
              <surname>Baig</surname>
              <given-names>Hadia Munir</given-names>
            </name>
            <name>
              <surname>Yasmin</surname>
              <given-names>Raheela</given-names>
            </name>
            <name>
              <surname>Khan</surname>
              <given-names>Rehan Ahmad</given-names>
            </name>
          </person-group>
          <article-title>Exploring Operating Room-Based Student Learning Experience: Perils &amp; Pitfalls? A Narrative Literature Review</article-title>
          <source>Archives of Surgical Research</source>
          <volume>1</volume>
          <issue>1</issue>
          <page-range>38-46</page-range>
          <pub-id pub-id-type="doi">10.48111/2020.01.08</pub-id>
          <issn>2709-6858</issn>
          <year>2020</year>
        </element-citation>
      </ref>
      <ref id="bib12">
        <mixed-citation>2. Croghan SM, Phillips C, Howson W. The operating theatre as a classroom: a literature review of medical student learning in the theatre environment. Int J Med Educ. 2019 Apr 23;10:75–87. </mixed-citation>
      </ref>
      <ref id="bib13">
        <mixed-citation>3. Lyon PMA. Making the most of learning in the operating theatre: student strategies and curricular initiatives. Med Educ. 2003 Aug;37(8):680–8. </mixed-citation>
      </ref>
      <ref id="bib14">
        <mixed-citation>4. Roberts NK, Williams RG, Kim MJ, Dunnington GL. The briefing, intraoperative teaching, debriefing model for teaching in the operating room. J Am Coll Surg. 2009 Feb;208(2):299–303. </mixed-citation>
      </ref>
      <ref id="bib15">
        <mixed-citation>5. Rabe C, Backhaus J, Jo P, Koenig S. Students’ perception of the educational environment in the operating theatre: development and psychometric evaluation of a questionnaire. In German Medical Science GMS Publishing House; 2017. p. DocO13. </mixed-citation>
      </ref>
      <ref id="bib16">
        <mixed-citation>6. Cassar K. Development of an instrument to measure the surgical operating theatre learning environment as perceived by basic surgical trainees. Med Teach. 2004 May;26(3):260–4. </mixed-citation>
      </ref>
      <ref id="bib17">
        <mixed-citation>7. Shetty S, Zevin B, Grantcharov TP, Roberts KE, Duffy AJ. Perceptions, training experiences, and preferences of surgical residents toward laparoscopic simulation training: a resident survey. J Surg Educ. 2014 Oct;71(5):727–33. </mixed-citation>
      </ref>
      <ref id="bib18">
        <mixed-citation>8. Lyon P. A model of teaching and learning in the operating theatre. Med Educ. 2004 Dec;38(12):1278–87. </mixed-citation>
      </ref>
      <ref id="bib19">
        <mixed-citation>9. Weinberg D, Saleh M, Sinha Y. Twelve tips for medical students to maximise learning in theatre. Med Teach. 2015 Jan;37(1):34–40. </mixed-citation>
      </ref>
      <ref id="bib20">
        <mixed-citation>10. Yusoff MSB. ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal. 2019 Jun 28;11:49–54. </mixed-citation>
      </ref>
      <ref id="bib21">
        <mixed-citation>11. Waseem T, Baig HM, Yasmin R, Khan RA. Exploring Operating Room-Based Student Learning Experience: Perils &amp; Pitfalls? A Narrative Literature Review. archivessr. 2020;1(1):38–46. </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>
