Recap Coco 30K: LLaVA-Recaptioned COCO 2014 Validation Images

Llava recaptioned COCO2014 ValSet. This dataset contains 30,000 images from the COCO 2014 validation set, each paired with its original caption and a new caption generated by the LLaVA vision-language model. It was created by UCSC-VLAA for evaluating text-to-image generation models, as detailed in the associated research paper.

Use Cases

• Benchmarking text-to-image generation models based on the availability of original and recaptioned image-text pairs.
• Training or fine-tuning vision-language models using the LLaVA-generated recaptions.
• Analyzing the differences between human-written and model-generated image captions.

Strengths

• Provides a direct comparison between original COCO captions and LLaVA-generated recaptions for 30,000 images.
• Based on the established COCO 2014 validation set, a standard benchmark in computer vision.
• Created for a specific research purpose, detailed in the paper 'What If We Recaption Billions of Web Images with LLaMA-3?'.

Limitations

• Row count is unknown, which may limit suitability assessment.
• Column-level documentation is absent; field semantics must be inferred after download.
• Data may reflect the biases inherent to the source COCO dataset and the LLaVA model used for recaptioning.

Provenance

Source

UCSC-VLAA, derived from the COCO 2014 validation set.

Collection Method

Images from COCO were recaptioned using the LLaVA vision-language model.

Freshness

Last updated 2024-06-12 21:56:33; freshness should be verified.