vrr/airi
2
0
Fork 0
mirror of https://github.com/moeru-ai/airi.git synced 2026-05-20 01:21:07 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 8
airi/packages/model-driver-mediapipe
History
Exact
Neko Ayaka 92d87833be
chore(deps): bump dependencies
2026-02-26 18:33:52 +08:00
..
references feat(model-driver-mediapipe): integrate MediaPipe as a motion capture tool (#828) 2025-12-30 12:11:08 +08:00
src feat(model-driver-mediapipe): integrate MediaPipe as a motion capture tool (#828) 2025-12-30 12:11:08 +08:00
tasks chore(model-driver-mediapipe): streamline asset prep with retries (#902) 2026-01-07 19:22:32 +08:00
AGENTS.md feat(model-driver-mediapipe): integrate MediaPipe as a motion capture tool (#828) 2025-12-30 12:11:08 +08:00
package.json chore(deps): bump dependencies 2026-02-26 18:33:52 +08:00
README.md feat(model-driver-mediapipe): integrate MediaPipe as a motion capture tool (#828) 2025-12-30 12:11:08 +08:00
tsconfig.json feat(model-driver-mediapipe): integrate MediaPipe as a motion capture tool (#828) 2025-12-30 12:11:08 +08:00

README.md

@proj-airi/model-driver-mediapipe

Single-person motion capture workshop package.

Goal

Provide a minimal closed loop that stage-web can consume:

camera frame → MediaPipe Tasks Vision → PerceptionState → canvas overlay

Where to try it

  • Devtools page: apps/stage-web/src/pages/devtools/model-driver-mediapipe.vue
  • Menu entry: Settings → System → Developer → “MediaPipe Workshop”

Key files

  • packages/model-driver-mediapipe/src/types.ts: middle-layer contract (PerceptionState)
  • packages/model-driver-mediapipe/src/engine.ts: scheduler + dropped-frame policy + state merge
  • packages/model-driver-mediapipe/src/backends/mediapipe.ts: @mediapipe/tasks-vision integration
  • packages/model-driver-mediapipe/src/utils/overlay.ts: canvas overlay renderer

Backend assumptions

  • Single person (maxPeople: 1)
  • Running mode: VIDEO
  • Landmarks are normalized (x/y in [0..1]) and drawn onto the overlay canvas

Docs

Keep upstream docs/snippets in packages/model-driver-mediapipe/references/.

The minimal API surface this package uses is summarized in:

  • packages/model-driver-mediapipe/references/tasks-vision-api.md