What is Lumaris?
Lumaris is a real-time AR makeup SDK built specifically for video calls. It renders makeup, AR masks, and accessories on a user's face, on-device, and publishes the filtered frame directly onto the call's own video track — so the person being called sees the finished look, not a raw camera feed with an overlay only the sender can see.
The problem it solves
Most face-filter SDKs are built for one-way content — selfies, short videos, live-streaming — where the person applying the filter is also the only one watching it back. A two-way video call is a different problem: the filtered frame has to leave the device, travel through a call provider's pipeline, and arrive intact on someone else's screen, in sync with audio, with no visible seam between how it looks to you and how it looks to them. Lumaris is built around that constraint from the ground up, not adapted to it afterward.
How it works, at a high level
- Camera capture, face tracking, and rendering all happen locally on the caller's own device — no frame is ever uploaded anywhere to be processed.
- The rendered frame is published as a custom video track through the call provider's own SDK (Agora today), so it behaves like any other video track the provider already knows how to transmit, record, and recover after a dropped connection.
- Audio is captured and time-aligned with the rendered video, so lips and voice stay in sync even though the video pipeline does real work on every frame.
Performance
In on-device testing on mid-range Android hardware, Lumaris processes each frame — face tracking plus rendering — in well under 50ms, comfortably inside a single frame's budget at 30fps. Numbers vary by device and by how many effects are active at once; we don't publish one blanket benchmark because we haven't tested broadly enough yet to stand behind one.
What Lumaris supports today
- Android
- Native Kotlin SDK
- iOS
- Native Swift SDK
- Flutter
- Cross-platform SDK
- React Native
- Cross-platform SDK
- Call provider
- Agora, via custom video and audio tracks
What you get
- A makeup and accessory engine your users build their own look with — foundation, blush, eyeshadow, lipstick, plus AR masks and accessories like glasses and earrings.
- A handful of function calls to wire it into a call screen you already have — Lumaris doesn't ask you to change how you join a channel or manage your call UI.
- On/off and look-switching controls your own UI drives live, mid-call.
That's the shape of it. The SDK Setup section walks through actually wiring it in, platform by platform.