“In the current era of outcome-driven performances, the comprehensiveness and diagnostic accuracy of such basic TEE studies should not be ignored.”

Image: J. Fox/S. Shernan, Brigham and Women's Hospital.

Image: J. Fox/S. Shernan, Brigham and Women's Hospital.

A BASIC transesophageal examination is focused on intraoperative monitoring rather than on specific diagnosis. Except in emergent situations, diagnoses requiring intraoperative cardiac surgical interventions or postoperative medical or surgical management must be confirmed by an individual with advanced skills in transesophageal echocardiography (TEE) or by an independent diagnostic technique.1  Certification in basic perioperative TEE requires passing a written test and demonstrating clinical competency. The trainee must provide a case log to show that she or he interpreted at least 100 TEE studies and personally performed at least 50 basic TEE studies under supervision. In this issue of Anesthesiology, Bick et al.2  report an investigation that tested whether a trainee performs comprehensive and clinically meaningfully basic TEE studies.

Teaching the essentials of basic echocardiography is possible via a variety of written and web-based didactic material, tutorials, and conferences, along with acquisition of necessary tactile/dexterity skills by practicing on physical or web-based TEE simulators.3–5  The next step in learning basic echocardiography is to integrate knowledge and manual skills and perform basic TEE studies on real patients. In the typical academic anesthesiology department, the trainee, usually a second- or third-year clinical anesthesiology resident, performs a basic TEE study under the supervision of an attending. This requires the presence of both resident and teacher, usually an attending anesthesiologist who is certified in basic or advanced perioperative TEE, at the same time and location, an activity that may be too costly in manpower needs, i.e., when clinical circumstances are demanding, or the attending anesthesiologist supervises multiple locations. In the current era of outcome-driven performances, the comprehensiveness and diagnostic accuracy of such basic TEE studies should not be ignored. Bick et al.2  addressed this in a creative way.

Electronic Basic TEE Report

The authors constructed an electronic training basic TEE report.6  It contained essential components of a basic TEE study, i.e., global and regional ventricular systolic function, anatomy and function of the cardiac valves, presence of pericardial effusion, aortic dissection, or interatrial communication.7  The resident had to assess all components for the study to be considered complete and uploaded.

Definition of the Competent Candidate

Passing scores for the basic TEE test were set twice. At baseline, a group of expert anesthesiologists, certified in advanced TEE, convened to set the minimum passing score for each component of the basic TEE study. The group adopted the Angoff method,8  whereby the borderline or minimally competent basic TEE practitioner was defined and an estimate of performance was determined. Afterward, the group reconvened to revise the minimum passing scores having considering the residents’ performance in basic TEE.

Performance Evaluation

The diagnostic accuracy of the basic TEE study was automatically compared with the findings of the attending anesthesiologist, who performed an advanced TEE study on the same patient and filed an electronic advanced TEE report on the patient’s electronic medical record. The authors compared how the diagnostic accuracy of the residents’ basic TEE evolved. Overall, the residents’ performance during basic TEE was acceptable, even when the experts’ performance expectations were raised during the second group meeting.

The study by Bick et al.2  is important for all anesthesiologists involved in the clinical practice and/or education of echocardiography at any level.

First, it is manpower efficient. The electronic basic TEE training report can be easily constructed de novo from free access web-based resources.9  It requires some groundwork to prepare the electronic data collection form and link it to the patient’s electronic medical record or a research database. Afterward, it is very easy to collect TEE reports, automatically grade them, and automatically display one’s individual performance against benchmark scores or experts’ findings. This real-time feedback to the student facilitates learning and helps to shift resources to the components graded below expectations.

Second, it is easy to verify whether the performed TEE study addresses all essential components. Every single study is scrutinized and the educational focus is on quality, comprehensiveness, and competence, and not solely on the number of accomplished tasks, similar to how competency in anesthesiology is assessed.10  Likewise, the ability to use acquired knowledge is tested in real-life circumstances. This paradigm can be applicable for echocardiography, i.e., residents training in basic TEE, fellows training in advanced TEE, or even attending anesthesiologists participating in quality assurance processes within a department or group. This may also be applicable for other training topics, such as electrogardiographic interpretation or hemodynamic waveform analysis, as was proven for advanced cardiac life support training11  or auscultation skills.12 

Third, creation of such real-life educational activities will shift learning, training, or quality assurance activities from time-based to result-based performance. For that to happen, a group of experts will always be required to define, and revise, as in the current study, the minimum expectations that warrant a competent clinical performance. Testing for performance should be adjusted based upon the trainee’s actual performance. Deciding a priori benchmark scores to assess diagnostic performance, particularly for life-threatening conditions such as hypotension and cardiovascular instability, will be as important as revising these scores upward if the trainee’s performance consistently exceeds expectations.

The study by Bick et al.2  should be considered a preliminary report only. While the expert group set the minimum passing scores according to the same, well-accepted method that is also used by the National Board of Echocardiography (Raleigh, North Carolina), the number of trainee third-year clinical anesthesiology residents was rather small (n = 12). All basic TEE studies were performed on cardiac surgical patients, with varying pathologies that were known to the trainees. Not all life-threatening basic TEE components, such as venous air or pulmonary embolism or hypovolemia, were evaluated because they could not be matched against the components of the advanced TEE performed by the experts.

The perioperative use and clinical application of echocardiography and ultrasound are essential, from insertion of catheters to monitoring and diagnosing a multitude of cardiac and extracardiac pathologies.13,14  Bick et al.2  offered us a prototype method to measure applied echocardiographic knowledge and link education to performance. Their paradigm is easy to put together and modify for nonechocardiographic topics. It should be adopted so that residents, fellows, and anesthesiologists continue to master the field of echocardiography in particular and anesthesiology and perioperative medicine in general.

Competing Interests

The author is not supported by, nor maintains any financial interest in, any commercial activity that may be associated with the topic of this article.

References

References
1.
Basic PTE®. http://www.echoboards.org/content/basic-pte®. Accessed September 8, 2016
2.
Bick
JS
,
Wanderer
JP
,
Myler
CS
,
Shaw
AD
,
McEvoy
MD
:
Standard setting for clinical performance of basic perioperative transesophageal echocardiography: Moving beyond the written test.
Anesthesiology
2017
;
126
:
718
28
3.
Mitchell
JD
,
Mahmood
F
,
Bose
R
,
Hess
PE
,
Wong
V
,
Matyal
R
:
Novel, multimodal approach for basic transesophageal echocardiographic teaching.
J Cardiothorac Vasc Anesth
2014
;
28
:
800
9
4.
Matyal
R
,
Mitchell
JD
,
Hess
PE
,
Chaudary
B
,
Bose
R
,
Jainandunsing
JS
,
Wong
V
,
Mahmood
F
:
Simulator-based transesophageal echocardiographic training with motion analysis: A curriculum-based approach.
Anesthesiology
2014
;
121
:
389
99
5.
Ferrero
NA
,
Bortsov
AV
,
Arora
H
,
Martinelli
SM
,
Kolarczyk
LM
,
Teeter
EC
,
Zvara
DA
,
Kumar
PA
:
Simulator training enhances resident performance in transesophageal echocardiography.
Anesthesiology
2014
;
120
:
149
59
6.
Harris
PA
,
Taylor
R
,
Thielke
R
,
Payne
J
,
Gonzalez
N
,
Conde
JG
:
Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support.
J Biomed Inform
2009
;
42
:
377
81
7.
Reeves
ST
,
Finley
AC
,
Skubas
NJ
,
Swaminathan
M
,
Whitley
WS
,
Glas
KE
,
Hahn
RT
,
Shanewise
JS
,
Adams
MS
,
Shernan
SK
;
Council on Perioperative Echocardiography of the American Society of Echocardiography and the Society of Cardiovascular Anesthesiologists
:
Special article: Basic perioperative transesophageal echocardiography examination: A consensus statement of the American Society of Echocardiography and the Society of Cardiovascular Anesthesiologists.
Anesth Analg
2013
;
117
:
543
58
8.
Downing
SM
,
Tekian
A
,
Yudkowsky
R
:
Procedures for establishing defensible absolute passing scores on performance examinations in health professions education.
Teach Learn Med
2006
;
18
:
50
7
9.
REDCap. https://www.project-redcap.org. Accessed September 8, 2016
10.
Tetzlaff
JE
:
Assessment of competency in anesthesiology.
Anesthesiology
2007
;
106
:
812
25
11.
Wayne
DB
,
Butter
J
,
Siddall
VJ
,
Fudala
MJ
,
Wade
LD
,
Feinglass
J
,
McGaghie
WC
:
Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice.
J Gen Intern Med
2006
;
21
:
251
6
12.
Wayne
DB
,
Butter
J
,
Cohen
ER
,
McGaghie
WC
:
Setting defensible standards for cardiac auscultation skills in medical students.
Acad Med
2009
;
84
(
10 Suppl
):
S94
6
13.
Mahmood
F
,
Matyal
R
,
Skubas
N
,
Montealegre-Gallegos
M
,
Swaminathan
M
,
Denault
A
,
Sniecinski
R
,
Mitchell
JD
,
Taylor
M
,
Haskins
S
,
Shahul
S
,
Oren-Grinberg
A
,
Wouters
P
,
Shook
D
,
Reeves
ST
:
Perioperative ultrasound training in anesthesiology: A call to action.
Anesth Analg
2016
;
122
:
1794
804
14.
Ramsingh
D
,
Rinehart
J
,
Kain
Z
,
Strom
S
,
Canales
C
,
Alexander
B
,
Capatina
A
,
Ma
M
,
Le
KV
,
Cannesson
M
:
Impact assessment of perioperative point-of-care ultrasound training on anesthesiology residents.
Anesthesiology
2015
;
123
:
670
82