Skip to content

Nature Computer Interaction

System Architecture

diagram System diagram

Behavioral Logic

The system operates through a layered behavioral structure combining environmental states and biological modulation.

Environmental Baseline (Soil Moisture)

Soil moisture defines the primary breathing mode of the artificial organism.

Three states determine distinct pneumatic patterns:

  • DRY — short, tense cycles with higher pressure peaks and nervous gaps.
  • OK — symmetrical inhale/exhale rhythm with smooth easing curves and stable pauses.
  • WET — slower inflation followed by irregular deflation, resembling saturation and dripping.

Each state modifies the internal pump timing, pressure amplitude, and pause structure.

Soil moisture therefore shapes the temporal and structural character of respiration.

Biological Accent (Heartbeat)

When a heartbeat is detected, it does not replace the environmental state.

Instead, each beat introduces a temporary pressure accent layered over the ongoing breathing cycle.

The pulse generates:

  • A short sinusoidal envelope
  • A dynamic pressure boost proportional to signal intensity
  • Mode-dependent amplification (stronger in DRY, softer in WET)

The resulting motion is a hybrid rhythm:

  • Environmental condition defines the base respiration.
  • Human heartbeat introduces transient dynamic modulation.

The system becomes a shared temporal structure rather than a hierarchical override.

Multimodal Expression

Pneumatic Expression

Breathing embodies the layered behavioral logic.

Environmental states determine the structure and intensity of inflation cycles, while heartbeat introduces momentary pressure accents. The pneumatic body becomes the primary site where biological and environmental data are physically materialized.

Light Expression

The LED system operates as a parallel visual translation of environmental and biological signals.

Soil moisture defines the base chromatic state:

  • DRY → 🟡 warm yellow tones
  • OK → 🟢🔵 green–cyan gradient
  • WET → 🟣 purple/violet spectrum

When a heartbeat is detected, a ❤️ red wave propagates across the strip, its amplitude proportional to signal intensity.

Light therefore mirrors the breathing logic while introducing an additional rhythmic dimension.

Sonic Expression

The system includes a generative sonic component developed in Pure Data.

Audio parameters are modulated through two parallel data streams:

  • Environmental and physiological data transmitted from Arduino (soil moisture, heartbeat detection, IR intensity).
  • Bioelectrical signals captured by the Pocket Scion device and received via OSC.

These data sources are not hierarchical; they coexist and simultaneously influence the sonic environment.

Visual Expression