Keypoints & events

Use usePoseTracker inside PoseTrackerProvider to subscribe to typed events. Without an API key you get keypoints-only mode. WebView hosts listen to postMessage instead — WebView messages.

Keypoints (free)

import {
  PoseTrackerProvider,
  WebViewPoseView,
  usePoseTracker,
} from '@pose-tracker/react-native-pose-estimation';

function CameraScreen() {
  usePoseTracker({
    onKeypoints: (e) => {
      // e.keypoints: 17 COCO joints · e.score · e.timestampMs
      console.log(e.keypoints.length, e.score);
    },
  });

  return <WebViewPoseView style={{ flex: 1 }} drawSkeleton />;
}

export function App() {
  return (
    <PoseTrackerProvider>
      <CameraScreen />
    </PoseTrackerProvider>
  );
}

KeypointsEvent shape:

Field	Type	Meaning
`type`	`'keypoints'`	Event kind
`keypoints`	`Keypoint[]`	17 joints (name, x, y, score, …)
`score`	`number`	Mean pose confidence
`timestampMs`	`number`	Frame time

Input sources

Default is live camera. For uploaded media, the host app picks a file and passes:

<WebViewPoseView source="image" sourceUri={uri} style={{ flex: 1 }} />
<WebViewPoseView source="video" sourceUri={uri} style={{ flex: 1 }} />

Web: pt.setSource({ type: 'image' | 'video', src }) then start() / analyze(). Full guide (CORS, content://, React, script tag): Media sources.

Useful `WebViewPoseView` props

Prop	Default	Notes
`drawSkeleton`	`true`	Overlay inside the WebView
`coldStart`	`'full'`	`'basic'` = model only (no camera)
`loadingText`	`"AI Loading"`	Boot overlay label
`position`	`'front'`	`'front'` \| `'back'`
`showWatermark`	plan-derived	Shown for keyless / free; hidden for paid

Full table: WebViewPoseView.

More typed callbacks

Available on usePoseTracker({ ... }) when the paid engine is active (API key):

onCounter — count, optional formScore (score, average, grade)
onAngles, onPosture, onProgression, onRecommendations
onFormScore, onExerciseSummary
Jump events (onJumpResult, …)

Without a key, business events are not emitted — only keypoints (and init / error / quality signals). Full catalog (shapes + error codes): Events.

Classic `onMessage` (optional)

For WebView parity with snake_case payloads (current_count, form_score):

usePoseTracker({
  onMessage: (msg) => {
    if (msg.type === 'counter') {
      // msg.current_count · msg.form_score?.grade
    }
  },
});

Prefer typed callbacks for new apps.

Optional API key + exercise · Events catalog · SDK quickstart

For LLMs: Free keypoints via usePoseTracker({ onKeypoints }) on the SDK. WebView equivalent is type: "keypoints" with joints in data. https://docs.posetracker.com/keypoints

Start here

WebView integration

SDK integration

Reference

Advanced (SDK)

AI & agents

Keypoints (free)

Input sources

Useful `WebViewPoseView` props

More typed callbacks

Classic `onMessage` (optional)

Next

​Keypoints (free)

​Input sources

​Useful WebViewPoseView props

​More typed callbacks

​Classic onMessage (optional)

​Next

Keypoints (free)

Input sources

Useful `WebViewPoseView` props

More typed callbacks

Classic `onMessage` (optional)

Next