Sensor Fusion Architecture

Visual fusion belongs in Fensalir over current Mimir runtime buffers.

Live Flow

flowchart TD
    A["direct camera drivers"] --> B["Mimir.Runtime video buffers"]
    C["Leap stereo IR driver"] --> B
    B --> D["native reservoir handles"]
    D --> E["Fensalir GPU feature extraction"]
    E --> F["cross-view matching + flow"]
    F --> G["surface/material claims"]
    G --> H["brush/splat render budget"]
    H --> I["Spout2/program video"]

Invariants

  • Device timestamps beat arrival timestamps when available.
  • Leap is the first timing-camera candidate.
  • Process capture is a bridge edge, not the local six-camera foundation.
  • Fensalir owns GPU extraction, fusion, material fitting, and render budgeting.
  • Runtime buffers own retention and stream health, not scene reconstruction.

Next Cut

Implement one concrete direct capture driver, feed MimirVideoFrameDescriptor samples into MimirVideoCaptureDriverSource, and measure sustained cadence over the default five-second window.