Speech and Gesture Synchronization Experiments with Motion Tracking

Five experiments tested hypotheses about the synchronization of speech and gesture. Participants pointed to and named lights while their gesture or speech execution was disrupted using virtual reality and motion tracking. The findings support the interactive view of continuous information exchange between language and action systems.

Use Cases

• Testing models of speech and gesture production based on experimental disruption data.
• Analyzing the timing of speech onset delays when gesture execution is disrupted.
• Investigating gesture prolongation in response to speech disruption.
• Comparing interactive versus ballistic theories of language-action system coupling.

Strengths

• Data originates from five controlled experiments.
• Uses virtual reality and motion tracking technologies for precise measurement.
• Tests two specific theoretical hypotheses (interactive vs. ballistic views).

Limitations

• Row count and dataset size are unknown, which may limit suitability assessment.
• Column-level documentation is absent; field semantics must be inferred after download.
• Last update date is unknown; freshness unverified.

Provenance

Source

Mingyuan Chu, Radboud University Nijmegen

Collection Method

Experimental data collected from participants performing pointing/naming tasks with disruptions.