Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus

Evan J. Propst; Nikolaus E. Wolter; Stacey L. Ishman; Karthik Balakrishnan; Ashley R. Deonarain; Deepak Mehta; George Zalzal; Seth M. Pransky; Soham Roy; Charles M. Myer; Michele Torre; Romaine F. Johnson; Jeffrey P. Ludemann; Craig S. Derkay; Robert H. Chun; Paul Hong; David W. Molter; Jeremy D. Prager; Lily H.P. Nguyen; Michael J. Rutter; Charles M. Myer; Karen B. Zur; Douglas R. Sidell; Liane B. Johnson; Robin T. Cotton; Catherine K. Hart; J. Paul Willging; Carlton J. Zdanski; John J. Manoukian; Derek J. Lam; Nancy M. Bauman; Eric A. Gantwerker; Murad Husein; Andrew F. Inglis; Glenn E. Green; Luv Ram Javia; Scott Schraff; Marlene A. Soma; Ellen S. Deutsch; Steven E. Sobol; Jonathan B. Ida; Sukgi Choi; Trina C. Uwiera; Udayan K. Shah; David R. White; Christopher T. Wootten; Hamdy El-Hakim; Matthew A. Bromwich; Gresham T. Richter; Shyan Vijayasekaran; Marshall E. Smith; Jean Philippe Vaccani; Christopher J. Hartnick; Erynne A. Faucett

doi:10.1002/lary.28461

Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus

Evan J. Propst, Nikolaus E. Wolter, Stacey L. Ishman, Karthik Balakrishnan, Ashley R. Deonarain, Deepak Mehta, George Zalzal, Seth M. Pransky, Soham Roy, Charles M. Myer, Michele Torre, Romaine F. Johnson, Jeffrey P. Ludemann, Craig S. Derkay, Robert H. Chun, Paul Hong, David W. Molter, Jeremy D. Prager, Lily H.P. Nguyen, Michael J. RutterCharles M. Myer, Karen B. Zur, Douglas R. Sidell, Liane B. Johnson, Robin T. Cotton, Catherine K. Hart, J. Paul Willging, Carlton J. Zdanski, John J. Manoukian, Derek J. Lam, Nancy M. Bauman, Eric A. Gantwerker, Murad Husein, Andrew F. Inglis, Glenn E. Green, Luv Ram Javia, Scott Schraff, Marlene A. Soma, Ellen S. Deutsch, Steven E. Sobol, Jonathan B. Ida, Sukgi Choi, Trina C. Uwiera, Udayan K. Shah, David R. White, Christopher T. Wootten, Hamdy El-Hakim, Matthew A. Bromwich, Gresham T. Richter, Shyan Vijayasekaran, Marshall E. Smith, Jean Philippe Vaccani, Christopher J. Hartnick, Erynne A. Faucett

Research output: Contribution to journal › Article › peer-review

9 Scopus citations

Abstract

Objectives/Hypothesis: Create a competency-based assessment tool for pediatric tracheotomy. Study Design: Blinded, modified, Delphi consensus process. Methods: Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as “keep” or “remove,” and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results: The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as “keep,” and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions: It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence: 5 Laryngoscope, 130:2700–2707, 2020.

Original language	English (US)
Pages (from-to)	2700-2707
Number of pages	8
Journal	Laryngoscope
Volume	130
Issue number	11
DOIs	https://doi.org/10.1002/lary.28461
State	Published - Nov 1 2020

Keywords

Delphi
Objective Structured Assessment of Technical Skill, OSAT, OSATS
Tracheostomy
assessment
education
objective structured assessment of technical skills
tracheotomy

ASJC Scopus subject areas

Otorhinolaryngology

Access to Document

10.1002/lary.28461

Cite this

Propst, E. J., Wolter, N. E., Ishman, S. L., Balakrishnan, K., Deonarain, A. R., Mehta, D., Zalzal, G., Pransky, S. M., Roy, S., Myer, C. M., Torre, M., Johnson, R. F., Ludemann, J. P., Derkay, C. S., Chun, R. H., Hong, P., Molter, D. W., Prager, J. D., Nguyen, L. H. P., ... Faucett, E. A. (2020). Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus. Laryngoscope, 130(11), 2700-2707. https://doi.org/10.1002/lary.28461

Propst, EJ, Wolter, NE, Ishman, SL, Balakrishnan, K, Deonarain, AR, Mehta, D, Zalzal, G, Pransky, SM, Roy, S, Myer, CM, Torre, M, Johnson, RF, Ludemann, JP, Derkay, CS, Chun, RH, Hong, P, Molter, DW, Prager, JD, Nguyen, LHP, Rutter, MJ, Myer, CM, Zur, KB, Sidell, DR, Johnson, LB, Cotton, RT, Hart, CK, Willging, JP, Zdanski, CJ, Manoukian, JJ, Lam, DJ, Bauman, NM, Gantwerker, EA, Husein, M, Inglis, AF, Green, GE, Javia, LR, Schraff, S, Soma, MA, Deutsch, ES, Sobol, SE, Ida, JB, Choi, S, Uwiera, TC, Shah, UK, White, DR, Wootten, CT, El-Hakim, H, Bromwich, MA, Richter, GT, Vijayasekaran, S, Smith, ME, Vaccani, JP, Hartnick, CJ & Faucett, EA 2020, 'Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus', Laryngoscope, vol. 130, no. 11, pp. 2700-2707. https://doi.org/10.1002/lary.28461

@article{f82757aa70cf46ab8dff02a4a1d244e6,

title = "Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus",

abstract = "Objectives/Hypothesis: Create a competency-based assessment tool for pediatric tracheotomy. Study Design: Blinded, modified, Delphi consensus process. Methods: Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as “keep” or “remove,” and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results: The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as “keep,” and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions: It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence: 5 Laryngoscope, 130:2700–2707, 2020.",

keywords = "Delphi, Objective Structured Assessment of Technical Skill, OSAT, OSATS, Tracheostomy, assessment, education, objective structured assessment of technical skills, tracheotomy",

author = "Propst, {Evan J.} and Wolter, {Nikolaus E.} and Ishman, {Stacey L.} and Karthik Balakrishnan and Deonarain, {Ashley R.} and Deepak Mehta and George Zalzal and Pransky, {Seth M.} and Soham Roy and Myer, {Charles M.} and Michele Torre and Johnson, {Romaine F.} and Ludemann, {Jeffrey P.} and Derkay, {Craig S.} and Chun, {Robert H.} and Paul Hong and Molter, {David W.} and Prager, {Jeremy D.} and Nguyen, {Lily H.P.} and Rutter, {Michael J.} and Myer, {Charles M.} and Zur, {Karen B.} and Sidell, {Douglas R.} and Johnson, {Liane B.} and Cotton, {Robin T.} and Hart, {Catherine K.} and Willging, {J. Paul} and Zdanski, {Carlton J.} and Manoukian, {John J.} and Lam, {Derek J.} and Bauman, {Nancy M.} and Gantwerker, {Eric A.} and Murad Husein and Inglis, {Andrew F.} and Green, {Glenn E.} and Javia, {Luv Ram} and Scott Schraff and Soma, {Marlene A.} and Deutsch, {Ellen S.} and Sobol, {Steven E.} and Ida, {Jonathan B.} and Sukgi Choi and Uwiera, {Trina C.} and Shah, {Udayan K.} and White, {David R.} and Wootten, {Christopher T.} and Hamdy El-Hakim and Bromwich, {Matthew A.} and Richter, {Gresham T.} and Shyan Vijayasekaran and Smith, {Marshall E.} and Vaccani, {Jean Philippe} and Hartnick, {Christopher J.} and Faucett, {Erynne A.}",

note = "Publisher Copyright: {\textcopyright} 2019 The American Laryngological, Rhinological and Otological Society, Inc.",

year = "2020",

month = nov,

day = "1",

doi = "10.1002/lary.28461",

language = "English (US)",

volume = "130",

pages = "2700--2707",

journal = "Laryngoscope",

issn = "0023-852X",

publisher = "John Wiley and Sons Inc.",

number = "11",

}

TY - JOUR

T1 - Competency-Based Assessment Tool for Pediatric Tracheotomy

T2 - International Modified Delphi Consensus

AU - Propst, Evan J.

AU - Wolter, Nikolaus E.

AU - Ishman, Stacey L.

AU - Balakrishnan, Karthik

AU - Deonarain, Ashley R.

AU - Mehta, Deepak

AU - Zalzal, George

AU - Pransky, Seth M.

AU - Roy, Soham

AU - Myer, Charles M.

AU - Torre, Michele

AU - Johnson, Romaine F.

AU - Ludemann, Jeffrey P.

AU - Derkay, Craig S.

AU - Chun, Robert H.

AU - Hong, Paul

AU - Molter, David W.

AU - Prager, Jeremy D.

AU - Nguyen, Lily H.P.

AU - Rutter, Michael J.

AU - Myer, Charles M.

AU - Zur, Karen B.

AU - Sidell, Douglas R.

AU - Johnson, Liane B.

AU - Cotton, Robin T.

AU - Hart, Catherine K.

AU - Willging, J. Paul

AU - Zdanski, Carlton J.

AU - Manoukian, John J.

AU - Lam, Derek J.

AU - Bauman, Nancy M.

AU - Gantwerker, Eric A.

AU - Husein, Murad

AU - Inglis, Andrew F.

AU - Green, Glenn E.

AU - Javia, Luv Ram

AU - Schraff, Scott

AU - Soma, Marlene A.

AU - Deutsch, Ellen S.

AU - Sobol, Steven E.

AU - Ida, Jonathan B.

AU - Choi, Sukgi

AU - Uwiera, Trina C.

AU - Shah, Udayan K.

AU - White, David R.

AU - Wootten, Christopher T.

AU - El-Hakim, Hamdy

AU - Bromwich, Matthew A.

AU - Richter, Gresham T.

AU - Vijayasekaran, Shyan

AU - Smith, Marshall E.

AU - Vaccani, Jean Philippe

AU - Hartnick, Christopher J.

AU - Faucett, Erynne A.

PY - 2020/11/1

Y1 - 2020/11/1

N2 - Objectives/Hypothesis: Create a competency-based assessment tool for pediatric tracheotomy. Study Design: Blinded, modified, Delphi consensus process. Methods: Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as “keep” or “remove,” and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results: The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as “keep,” and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions: It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence: 5 Laryngoscope, 130:2700–2707, 2020.

AB - Objectives/Hypothesis: Create a competency-based assessment tool for pediatric tracheotomy. Study Design: Blinded, modified, Delphi consensus process. Methods: Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as “keep” or “remove,” and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results: The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as “keep,” and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions: It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence: 5 Laryngoscope, 130:2700–2707, 2020.

KW - Delphi

KW - Objective Structured Assessment of Technical Skill, OSAT, OSATS

KW - Tracheostomy

KW - assessment

KW - education

KW - objective structured assessment of technical skills

KW - tracheotomy

UR - http://www.scopus.com/inward/record.url?scp=85076720869&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85076720869&partnerID=8YFLogxK

U2 - 10.1002/lary.28461

DO - 10.1002/lary.28461

M3 - Article

C2 - 31821571

AN - SCOPUS:85076720869

SN - 0023-852X

VL - 130

SP - 2700

EP - 2707

JO - Laryngoscope

JF - Laryngoscope

IS - 11

ER -

Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this