Presentation
Augmenting First-Person Swarm Teleoperation with Multisensory Feedback
DescriptionThis paper evaluates how multisensory feedback can improve human teleoperation of aerial swarms. Effective oversight in swarm missions requires user interfaces that convey the swarm state and environment information. While Top-Down View (TDV) naturally provides this, it is impractical in real-world contexts. First-Person View (FPV), by contrast, aligns with the distributed nature of swarms but limits awareness of the swarm state. To address this limitation, we designed a multisensory interface that augments an FPV interface with haptic and audio feedback. Specifically, we propose a novel mapping that compresses the complex swarm state into intuitive cues, using key metrics conveyed through a vibrotactile jacket and spatial audio. Through a user study, we show that while TDV perspectives achieve the best performance, multisensory feedback enabled significant performance increases for FPV perspectives. These results suggest that multisensory feedback can effectively mitigate the limitations of FPV perspectives, improving performance and enabling more reliable human-swarm teleoperation.
Event Type
Lecture
TimeThursday, October 22nd3:40pm - 4pm PDT
Location
Similar Presentations