Neuro-Art with BrainSigns and Myndek at Videocittà Festival
I had the privilege of showcasing my real-time Neuro-Art system at the Videocittà festival in Rome, a vibrant celebration of digital and audiovisual arts. This groundbreaking project was presented as part of NFTcc’s installations, where interaction design, TouchDesigner, AI, and NeuroArt came together in an inspiring fusion of technology and creativity.
Art That Responds to the Mind
Participants at Videocittà created Neuro-Art that evolved in real-time, reflecting their cognitive and emotional states. The system harnessed the advanced MindTooth EEG device from BrainSigns, capturing indicators of mental workload and stress. These inputs were fed into a real-time text-to-image generation model, producing visuals that transformed dynamically as the participants engaged with the experience.
The ability to visualize these brainwave-driven changes created an intimate and deeply personal connection between participants and their artwork. Each creation was unique, shaped by the participant’s mental and emotional landscape.
Immersive Art in VR
In collaboration with Myndek, we elevated the experience by integrating a VR environment where participants could view their creations. This virtual art gallery allowed them to capture snapshots of their real-time artworks, placing them in the picture frames of an immersive digital space. This seamless blend of Neuro-Art and VR brought a new dimension to self-reflection and interactive art.
RAPTURE: Art Beyond the EEG
The system can also operate without EEG input, utilizing video inputs and prompts to generate visuals in real time. I call this mode RAPTURE (Real-time Ai Performance Transformation and User-Responsive Experience), and it’s designed for performances where live transformations enhance the atmosphere. At Videocittà, I tested several refinements to the engine, including tweaks to image size, compression ratios, and new dynamic features, pushing the system’s capabilities even further.
Pushing Neuro-Art Forward
Participating in Videocittà was an incredible opportunity to advance the research and development of Neuro-Art. Working with NFTcc, BrainSigns, and Myndek, we explored how cutting-edge technology can intersect with artistic expression to create deeply personal and transformative experiences.
Special thanks to NFTcc for curating such a rich and inspiring installation, and to BrainSigns and Myndek for their collaboration and support in bringing this vision to life.
Looking Ahead
The success of the Neuro-Art system at Videocittà is just the beginning. I’m excited to continue refining the system, incorporating new features like OpenPose and ControlNet for live transformations, and delving deeper into LoRA training to expand the creative potential. The possibilities for combining art, technology, and human experience are endless, and I’m thrilled to be part of this journey.
Stay tuned for more updates as we continue to push the boundaries of Neuro-Art!