Developing content for pediatric hospital medicine certification examination using practice analysis

OBJECTIVES: The American Board of Pediatrics (ABP) and the Pediatric Hospital Medicine (PHM) subboard developed a content outline to serve as a blueprint for the inaugural certification examination through practice analysis. The systematic approach of practice analyses process is described in the study. METHODS: A diverse, representative panel of 12 pediatric hospitalists developed the draft content outline using multiple resources (publications, textbooks, PHM Core Competencies, PHM fellow's curriculum, etc). The panel categorized practice knowledge into 13 domains and 202 subdomains. By using the ABP database self-defined practicing pediatric hospitalists were identified. Participants rated the frequency and criticality of content domains and subdomains along with providing open-ended comments. RESULTS: In total, 1449 (12.1%) generalists in the ABP database self-identified as pediatric hospitalists, and 800 full-time pediatric hospitalists responded. The content domains that were rated as highly critical and frequently required in practice were weighted more heavily (ie, the percentage of examination questions associated with a domain) than the less critical and less frequently rated. Both community and noncommunity pediatric hospitalists rated domains similarly (P = .943). Subdomain and preliminary weights were rated with similar means and SDs in the majority of topics. CONCLUSIONS: There was concordance in the rating of domain and universal tasks among both community and noncommunity hospitalists. The areas of significant differences, although minor, could be explained by difference in practice settings. The practice analysis approach was structured, engaged the PHM community, reflected the breadth and depth of knowledge required for PHM practice, and used an iterative process to refine the final product.