This study developed and evaluated the validity of a bronchoscopy anatomy and theoretical bronchoscopy exam. 19 anatomy and 58 theoretical exam questions, developed by pulmonology experts, were assessed through two Delphi rounds. Both exams were then taken by 53 prepared pulmonology residents. The theoretical exam was also taken by three unprepared groups: novices, intermediates and experts. Using the residents’ data, scoring evidence for the theoretical exam was evaluated using item difficulties and item discrimination indices, and generalization evidence was assessed using Cronbach’s alpha. Extrapolation evidence was obtained by comparing theoretical exam scores across the different groups. Implications evidence for both exams was gathered by evaluating residents’ preparedness, based on exam performance and instructor feedback.