NeoLightning: A Modern Reimagination of Gesture-Based Sound Design
Journal:
arXiv
Published Date:
May 15, 2025
Abstract
This paper introduces NeoLightning, a modern reinterpretation of the Buchla
Lightning. NeoLightning preserves the innovative spirit of Don Buchla's "Buchla
Lightning" (introduced in the 1990s) while making its gesture-based interaction
accessible to contemporary users. While the original Buchla Lightning and many
other historical instruments were groundbreaking in their time, they are now
largely unsupported, limiting user interaction to indirect experiences. To
address this, NeoLightning leverages MediaPipe for deep learning-based gesture
recognition and employs Max/MSP and Processing for real-time multimedia
processing. The redesigned system offers precise, low-latency gesture
recognition and immersive 3D interaction. By merging the creative spirit of the
original Lightning with modern advancements, NeoLightning redefines
gesture-based musical interaction, expanding possibilities for expressive
performance and interactive sound design.
