Longpipe

Open-source video effects SDK for the browser. Real-time virtual backgrounds and portrait matting on WebGPU with a WebGL2 fallback.

What it does

Wraps neural matting + compositing into a single class. Hand it a MediaStream, get a MediaStream back with the effect applied. Runs in a worker by default; audio passes through unchanged.

Quick links

• Getting started — install + your first effect
• API reference — EffectsPipeline options
• Backgrounds — accepted background formats
• Presets & autotune — model size knobs
• Self-hosting weights — point at your own CDN

Status

This is v0.0.1. The matting model is solid and benchmarks well against MediaPipe; everything around it (temporal stability, additional decoder heads, audio denoising) is planned but not built. Expect rough edges. Issues + PRs welcome on GitHub.