Skip to content

Mocap follow-up: activate SAM 3D Body quality backend for --body #920

Description

@fernandotonon

Follow-up to #869 (shipped in PR #909).

Body capture currently uses the MediaPipe Pose + PoseIKSolver + canonical retarget path (--algo pose-ik, the default and only active backend). The SAM 3D Body "quality" backend is dispatched in code but falls back to Pose-IK because its checkpoints are HF-gated (Meta SAM License access pending). This was the planned degradation (epic #869 risk #3).

To activate:

  • Obtain SAM 3D Body checkpoint access; confirm the SAM License permits rehosting the converted ONNX on the fernandotonon/QtMeshEditor-models HF repo (record the verdict in THIRD_PARTY_AI_MODELS.md).
  • Export to ONNX (a community C++ port exists: AmmarkoV/SAM3DBody-cpp) and host under mocap/body/ (or similar).
  • Flip the dispatch in MocapRecorder/MocapCLI so --algo sam3dbody uses the real backend; the fallback + algorithmUsed/fallbackReason reporting already exists.
  • Add a catalog entry in AIModelCatalog (the mocap face/body entries are the pattern).

No architectural change needed — the plumbing is complete; this is model hosting + dispatch enablement.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions