Systematic Mapping Study of Usability and UX Evaluation in GenAI Tools

A systematic mapping study analyzing 54 publications from ACM, IEEE, and Scopus on Usability and User Experience evaluation of Generative AI tools in the post-ChatGPT period. The study examined 2,473 publications and identified substantial documentation gaps and terminological fragmentation. The dataset was created by Rafael Pereira and last updated in May 2026.

Use Cases

• Analyze terminological fragmentation in GenAI evaluation based on the 206 aspects mentioned in the description
• Identify documentation gaps regarding device, interaction type, and model version in GenAI research
• Map the prevalence of solution-proposal studies in the GenAI usability literature based on the single identified instance
• Study publication trends and methodologies from major academic databases (ACM, IEEE, Scopus) on GenAI evaluation

Strengths

• Analysis is based on a systematic review of 2,473 publications from three major academic databases
• Findings are derived from 54 retained and analyzed publications, providing a focused corpus
• Identifies 206 distinct aspects of GenAI evaluation, highlighting the field's complexity

Limitations

• Row count is unknown, which may limit suitability assessment
• Column-level documentation is absent; field semantics must be inferred after download
• The dataset is small in scale at 155.4 KB, indicating limited scope

Provenance

Source

figshare

Collection Method

Systematic Mapping Study of academic publications from ACM, IEEE, and Scopus

Time Range

Post-ChatGPT period (likely 2022 onward)

Freshness

Last updated 2026-05-23 12:10:16; freshness should be verified