Biophonic

Biophonic is an augmented reality artwork created during the EdgeCity Lanna art residency in Chiang Mai, Thailand in the fall of 2024. This mobile AR experience invites users to engage in a collaborative, sensory dialogue with a responsive digital plant form—an imaginative exploration of communication between humans and the natural world.

Communication is the foundation of all collaboration, yet it’s often missed or misunderstood. Imagine a world where we could bridge this gap and communicate with the living beings around us. Plants, for example, communicate primarily through chemical signals, sharing information about their environment and needs. What if technology could help us understand and translate these messages? If we could truly listen to the natural world, we might unlock new possibilities for co-creating a future where humans and nature thrive in harmony.

As users interact with the AR plant through voice and proximity, they co-create a living melody. The plant listens and responds—changing its shape, color, and sound. Over time, the boundaries between human and plant begin to dissolve, with each form subtly morphing into the other. Biophonic is both an artistic meditation and a speculative vision of interspecies empathy, powered by immersive technology.

[ View in XR ]

Creative Direction

2D/3D Design

AR Design/Dev

Animation

Decorative background

Inspiration & Creative Process

The concept for Biophonic began with a hand-drawn illustration in Procreate—an imagined hybrid of human and plant, communicating through sound waves and color bursts. This visual served as the foundation for a speculative future where technology enables interspecies dialogue, and where humans and plants co-create shared experiences through sensory exchange.

From there, I brought the concept into 3D using Gravity Sketch in virtual reality, where I sculpted the initial forms of the plant-human hybrid. I then refined the models and created animations in Blender, crafting organic motions that reflected the slow, intelligent way plants move and adapt. For the visual effects and 2D overlays, I used After Effects to animate elements like chemical signals and interface motifs. The soundscape—a mix of ambient tones and reactive musical phrases—was composed and edited in Reaper. Finally, I built the augmented reality experience in Lens Studio, integrating all the assets and scripting interactivity, materials, and logic.

This project was an opportunity to explore themes of interconnection and empathy, using a multi-tool, multi-discipline pipeline to create an immersive world where communication extends beyond the human.

Process Overview

  • Initial concept sketching and visual development in Procreate (iPad)
  • 3D sculpting and form exploration in Gravity Sketch (VR)
  • Modeling, rigging, and animation in Blender
  • 2D animation and effects in After Effects
  • Sound design and composition in Reaper
  • AR development and interactivity scripting in Lens Studio

Technological Features

Biophonic integrates several advanced AR features, allowing users to interact in real time with the environment and the plant entity:

  • 3D hand tracking
  • Proximity-based behavior triggers
  • Audio-reactive materials and morphing models
  • Weather data integration for location-specific changes
  • Single plane surface tracking for mobile AR anchoring

Decorative background