Open Domain Oral Disease QA Dataset for LLM Diagnostic Evaluation

A dataset designed to evaluate the diagnostic capabilities of Large Language Models in the domain of oral disease. It was created by Lines and last updated on April 28, 2024. The dataset includes evaluation data for models such as GPT-3.5, GPT-4, Palm2, and Llama2-70B.

Use Cases

• Benchmarking LLM diagnostic accuracy based on oral disease questions mentioned in the description.
• Evaluating model performance comparisons based on the suite of models (GPT-3.5, GPT-4, etc.) referenced.
• Training or fine-tuning models for medical QA tasks in the specific domain of oral health.

Strengths

• Designed for a specific evaluation purpose: assessing LLM diagnostic capabilities for oral disease.
• Includes evaluation data for multiple prominent LLMs: GPT-3.5, GPT-4, Palm2, and Llama2-70B.
• Last updated on April 28, 2024, indicating recent maintenance.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

huggingface

Freshness

Last updated 2024-04-28 03:59:53