ENADE and REVALIDA: Content Analysis of Brazilian Medical Program Evaluations

A descriptive study compared the contents of the ENADE 2013 and 2016 exams and the REVALIDA 2015 and 2016 exams against a reference matrix of 46 concentration areas and 749 specific themes. The two editions of ENADE together addressed 241 (32.2%) of the specific themes, while the two editions of REVALIDA addressed 468 (62.5%). The analysis was conducted by Annie Beatriz De Carvalho, who concluded that ENADE demonstrated lower content validity than REVALIDA.

Use Cases

• Compare content coverage between different national medical licensing exams based on the described analysis of concentration areas and themes.
• Assess the reliability of standardized tests based on the reported frequency of topic repetition across exam editions.
• Evaluate the content validity of educational assessments using the methodology of mapping exam items to a reference curriculum matrix.
• Identify gaps in curriculum coverage for medical programs based on the analysis of which concentration areas were not addressed in specific exam years.

Strengths

• Analysis is based on a defined reference framework: the REVALIDA Curriculum Correspondence Matrix (RCCM) with 46 concentration areas and 749 specific themes.
• Provides specific quantitative comparisons: ENADE addressed 241 themes (32.2%) versus REVALIDA's 468 themes (62.5%).
• Examines multiple exam editions (2013, 2015, 2016), allowing for temporal comparison.

Limitations

• Row count and column-level documentation are absent; field semantics must be inferred after download.
• Last update date is unknown; freshness unverified.
• The underlying raw exam item data is not directly available, only the results of the content analysis.

Provenance

Source

Annie Beatriz De Carvalho

Collection Method

Descriptive study involving independent content analysis of exam items by two medical professors, with results consolidated and analyzed via frequency distribution.

Time Range

Covers exams from 2013, 2015, and 2016.

Geography

Brazil