alsoSensory
alsoSensory is a framework and ecosystem for multimodal sensing and processing intended to support AI systems, robotics, and proof-of-concept products. It standardizes interfaces for a broad range of sensing modalities, including cameras, microphones, haptic devices, thermal sensors, and physiological signals, enabling coordinated data collection and analysis.
Central to alsoSensory is a sensor abstraction layer, a multimodal fusion engine, and a privacy and policy
Development and scope: The concept emerged in the early 2020s through collaboration among researchers in human-computer
Applications include autonomous robots, augmented and virtual reality experiences that respond to user actions and state,
Limitations and challenges: Real-time multimodal processing demands substantial compute and bandwidth. Data governance, privacy, and consent