Longpipe

Open-source video effects SDK for the browser. Real-time virtual backgrounds and portrait matting on WebGPU with a WebGL2 fallback.

What it does

Wraps neural matting + compositing into a single class. Hand it a MediaStream, get a MediaStream back with the effect applied. Runs in a worker by default; audio passes through unchanged.

Quick links

• Getting started — install + your first effect
• API reference — EffectsPipeline options
• Backgrounds — accepted background formats
• Presets & autotune — model size knobs
• Self-hosting weights — point at your own CDN

Status

Early but functional — published on npm, with real-time matting and temporal stability (a ConvGRU head) that benchmarks well against MediaPipe. Still planned: additional decoder/task heads on the shared encoder, and audio denoising. Expect rough edges. Issues + PRs welcome on GitHub.