Traditional Chinese Medicine Multimodal Pre-training Corpus

ShizhenGPT's pre-training dataset contains over 5 billion tokens of Traditional Chinese Medicine text from websites and books, along with a large-scale image-text dataset. The dataset was created by FreedomIntelligence and was last updated in September 2025.

Use Cases

• Pre-training a multimodal LLM on TCM text tokens and image-text pairs.
• Fine-tuning models for TCM-specific tasks using the corpus of over 5B tokens.
• Benchmarking model performance on TCM knowledge using the provided text and image data.

Strengths

• Corpus contains over 5 billion tokens of TCM text.
• Includes a large-scale TCM image-text pre-training dataset.

Limitations

• Specific row counts, column names, and file formats are not provided.
• Potential bias towards the specific TCM websites and books used as sources.

Provenance

Source

FreedomIntelligence

Collection Method

Collected from TCM-related websites and books.

Freshness

Last updated September 2025.