Human Behavior Atlas: 100K+ Multimodal Records for Social Intelligence

Human Behavior Atlas (HBA) is a multimodal benchmark aggregating between 100,000 and 1,000,000 records for psychological and social behavior analysis, published by keentomato. It standardizes diverse behavioral datasets into a single framework for training foundation models on signals like emotion, intent, and sarcasm. The collection spans text, audio, image, and video modalities to support social intelligence tasks.

Use Cases

• Multimodal emotion recognition using video and audio signals
• Sarcasm detection in text and speech for social intelligence benchmarking
• Classification of mental health signals from nonverbal behavioral cues

Strengths

• Multimodal coverage across text, audio, image, and video modalities
• Scale of 100,000 to 1,000,000 records
• Standardized framework for consistent evaluation of social intelligence tasks

Limitations

• Aggregated nature may introduce domain variance between source datasets
• License is specified as 'other', requiring manual verification of usage terms

Provenance

Collection Method

Aggregation and standardization of multiple existing behavioral datasets

Freshness

Last updated February 2026.

Geography

United States