AudioSet 527 Semantic ML & Vertical Shorts Feed
AI sound classification, vertical Trailer Shorts, and instant Wi-Fi preview
Aura 1.2.0 bridges machine learning and mobile audience engagement. Introducing our local Python ML sidecar powered by PANNs 527 physical sound classes, alongside the Aura Mobile vertical Trailer Shorts feed with on-device tactile toggling.
Key Highlights
PANNs 527 Physical Sound Classifier
Isolates physical punches, gunshots, explosions, and tire screeches while actively ignoring music beds and dialogue lines. 100% on-device inference with zero cloud cost.
Vertical Trailer Shorts Feed
Audiences can scroll through action teasers and movie shorts with synchronized Taptic pulses, complete with one-tap tactile mute/unmute.
Bonjour Wi-Fi Companion Pairing
Zero-config mDNS auto-discovery pairs iPhone companion app with Studio desktop across local Wi-Fi in under 0.18ms latency.
Detailed Changelog
AI Haptic Generation
- Integrated PANNs CNN14 neural model with 527 sound event detection classes
- Silero VAD speech detection filter to eliminate false triggers from actor voice tracks
- Automated conversion from audio transient envelopes to Apple .ahap curve points
- Configurable sensitivity threshold sliders for intensity and sharpness scaling
Aura Mobile
- Launched dedicated vertical Trailer Shorts continuous video feed
- Apple Core Haptics dynamic parameter curve actuation on iOS 16+
- Android precision vibration waveform synthesis via Android HapticGenerator API
- Interactive haptic engagement telemetry with privacy-preserving analytics
Studio Authoring
- Direct Wi-Fi pairing dialog with QR code scan and Bonjour discovery
- Real-time playhead synchronization between desktop DAW and mobile companion
- Multi-track timeline support with unlimited undo/redo history
Ready to author and experience tactile cinema?
Download Aura for audiences and Haptic Studio for post-production sound crews.