PVIT-3M: Personalized Visual Instruction Tuning Dataset

PVIT-3M is a dataset of 3 million image-text pairs designed for tuning Multimodal Large Language Models (MLLMs) on personalized visual instruction tasks. It was created by Sterzhang and introduced in the paper "Personalized Visual Instruction Tuning". The dataset was last updated on November 2, 2024.

Use Cases

• Fine-tuning MLLMs to generate responses based on personalized visual inputs.
• Improving model adaptability to individual user needs and preferences using image-text pairs.
• Benchmarking MLLM performance on tasks requiring tailored visual instruction understanding.

Strengths

• Contains 3 million image-text pairs, providing a substantial scale for model training.
• Specifically designed for the novel task of personalized visual instruction tuning.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

Sterzhang via Hugging Face.

Collection Method

Introduced in the academic paper "Personalized Visual Instruction Tuning"; specific collection method is not detailed in the provided input.

Freshness

Last updated 2024-11-02 07:41:57; freshness should be verified.