Depth-First Autonomy: Multi-Baseline Stereo fused with Openpilot
VDSX Stereo 4 delivers dense, explainable 3D from 4 synchronized cameras (near + far baselines), fused with Openpilot's world-model planner. Ship faster with an OEM-ready SDK, hardware kits, and VDSX Cloud for fleet learning.
Runs on NVIDIA Jetson Orin Nano/NX • CUDA/TensorRT • GMSL2 or CSI camera stacks
┌───────────────────────────────────────┐
│ Quad Cameras (multi-baseline, HDR/NIR)│
└┬───────────────┬───────────────┬──────┘
│ │ │
▼ ▼ ▼
VDSX Stereo Engine → Dense Depth + Confidence + Flow
│
▼
VDSX → Openpilot Bridge (gRPC/ZMQ)
│
▼
World-Model Planner (0.10)
│
▼
CAN / Actuation
Multi-Baseline Stereo
Two baselines (short + long) cover 0.3–50+ m with high confidence, robust to glare, night, and motion.
- 4× synchronized cams (HDR/NIR/polarization options)
- Confidence-weighted fusion (near + far)
- Flow-assisted stabilization at speed
Planner Validation
Depth-verified trajectories: cross-check world-model predictions with real geometry.
- Explainable AI layer for safety cases
- Automatic outlier suppression
- Realtime calibration monitoring
OEM-Ready Stack
SDK + hardware kits + cloud logging for fleet learning.
- Jetson Orin Nano/NX reference images
- CAN (Panda) advisory channel
- OTA, metrics, and audit hooks
How VDSX compares
| Capability | Traditional Stereo | VDSX Stereo 4 |
|---|---|---|
| Depth Coverage | 1–30 m typical | 0.3–50+ m via multi-baseline fusion |
| Lighting Robustness | Struggles with glare/night | HDR/NIR options + polarization assist |
| Motion/Speed | Jitter at high ego-motion | Flow-guided stabilization |
| Calibration | Manual, drifts | Self-check reprojection + EKF assist |
| Planner Integration | Separate systems | Openpilot 0.10 bridge (advisory HUD + CAN) |
| Cloud & Data | Ad hoc | VDSX Cloud fleet logging + labeling |
All ranges/FPS depend on optics, baseline, exposure, platform power, and configuration.
VDSX Autonomy SDK (OEM)
Everything you need to evaluate and integrate depth-first autonomy: Jetson runtime images, Openpilot bridge, calibration tools, and a web-based HUD.
Integration Modes
- Companion (fastest): VDSX HUD + advisory CAN; no planner surgery.
- Native camera bridge: Replace/complement camera ingest for deeper fusion.
- Fleet mapping: Record depth, RGB, semantics to VDSX Cloud.
Start companion mode for quickest trials; move to native bridge after validation.
Reference Hardware
Compute
- Jetson Orin Nano/NX (8–16GB)
- CUDA / TensorRT / JetPack 5/6
- NVMe for high-rate logging
Cameras
- 4× MIPI or GMSL2 (PoC)
- Mixed modalities: HDR/NIR/polarization
- Hardware sync via deserializer
I/O & Power
- Dual GbE / USB3 / Wi-Fi/BT
- 9–36V input (vehicle power)
- CAN (Panda) for advisories
We provide a bill-of-materials and flashing scripts for our reference designs.
VDSX Cloud
Secure fleet logging, analytics, and 3D labeling. Curate datasets for model training and regression testing.
- Encrypted uploads, device auth, OTA
- Depth/RGB/event timelines, map views
- 3D labeler (instances, lanes, drivable)
- Export to training pipelines
Data & Privacy
- Project-scoped encryption keys
- PII minimization and masking tools
- Audit logs and retention policies
On-prem or private cloud options available.
Starter (POC)
For pilot vehicles and lab validation.
- 1–3 dev seats
- Jetson images & SDK
- Companion HUD + CAN advisories
- Email support
$4,900 one-time + $199/mo
OEM Eval
For fleet trials and benchmarks.
- Up to 10 vehicles
- Cloud logging & 3D labeler
- Priority support & integration help
- Optional on-prem
$19,900 + $999/mo
Enterprise
Full licensing & custom terms.
- Unlimited vehicles
- Custom SLAs & security review
- Native bridge & planner validation
- Dedicated success engineer
Let's discuss
Pricing shown for illustration—final quotes depend on scope, data volume, and support level.
FAQ
Do we have to modify Openpilot to try VDSX?
No. Start with the companion/HUD mode (advisory only). You can later adopt the native camera bridge after validation.
What FPS and range should we expect?
Typical configs provide dense, high-confidence depth from ~0.3–50+ m. FPS depends on resolution and models; we support adaptive scheduling for higher responsiveness when needed.
Which cameras are supported?
CSI or GMSL2 pipelines on Jetson (e.g., IMX519/477/490 families). We supply reference drivers and tested BOMs.
Can we run this fully offline?
Yes. All perception and planning bridges run on-device. Cloud sync is optional.
Talk to our team
Request OEM SDK access, hardware BOMs, or a live demo drive.
Security & Compliance
- Device signing and OTA policies
- Encrypted logs & access controls
- Private cloud / on-prem options
- Safety evidence hooks for SOTIF / ISO 21434
We work with your IT and safety teams during evaluation.