Research and implementation of WebGPU-based neural rendering, spatial/temporal upscaling, and stereoscopic processing for high-bitrate live video.
Architecture & Roadmap
Technology Tests
Validate multi-bitrate stream decoding and network stability up to 80Mbps using HLS.js.
Stage 1 · HLS · IngestHigh-performance zero-copy video ingest using importExternalTexture and compute-ready pipeline.
Stage 1 · WebGPU · Zero-CopyPOC: Runtime Slang-to-WGSL compilation for dynamic compute pipeline generation.
Stage 1 · Slang · WASMRec. 709 RGB to YUV conversion and bicubic chroma interpolation for neural pipeline optimization.
Stage 2 · Slang · YUVEMA-based background modeling and foreground masking using Slang compute shaders.
Stage 2 · Compute · EMAReal-time horizontal disparity search for depth extraction from parallel 3m baseline stereo streams.
Stage 3 · Slang · StereoProjective warping to align the secondary camera view (Right Eye) to the primary view (Left Eye).
Stage 3 · Slang · GeometrySynthetic motion vector generation via mask-restricted block matching for temporal accumulation.
Stage 4 · Slang · Vectors6-layer Convolutional Neural Network for high-performance luminance upscaling and detail enhancement.
Stage 4 · Slang · CNNDLSS-style sample re-projection and historical blending using synthetic motion vectors and anti-ghosting clamps.
Stage 4 · Slang · ReconstructionCross-scale parallax fusion utilizing the secondary camera's sub-pixel data to resolve occlusions and boost detail.
Stage 4 · Slang · FusionInteractive playground for Slang-based video processing kernels using Tutorial Engine.
Playground · Video