AVCocktail: Audio-Visual Speech Recognition for Multi-Speaker Noisy Environments

AVSRCocktail is an audio-visual speech recognition system designed for cocktail party scenarios. The model, authored by nguyenvulebinh, combines lip reading and audio processing to handle background noise and speaker interference. The dataset was last updated on July 7, -2025.

Use Cases

• Training robust speech recognition models based on combined audio and visual (lip reading) inputs.
• Benchmarking model performance in noisy, multi-speaker environments as described.
• Developing systems for cocktail party scenarios with background noise and speaker interference.

Strengths

• System is designed for challenging acoustic conditions with background noise and speaker interference.
• Model combines lip reading and audio processing, suggesting a multimodal approach.
• Dataset was last updated on July 7, -2025.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

huggingface

Collection Method

Official implementation of 'Cocktail-Party Audio-Visual Speech Recognition' (Interspeech 2025).

Time Range

null

Freshness

Last updated 2025-07-07 14:02:46; freshness should be verified.

Geography

null