Ai Automation Engineer, Real-World Test Lab
- Countries
- USA, Hybrid
- Job Types
- software & tech, operations
- Experience
- mid
- Organization Types
- startups
- Location
- San Francisco - Hybrid
- Posted Date
- Company
- Niantic Spatial
- Salary
- $158.4K – $210K • Offers Equity • Offers Bonus
AI Summary
Job Description
Design and own end-to-end automation for real-world test lab evaluations, ensuring consistency and speed. Automate agent-driven workflows, convert manual experiments to standing protocols, and produce actionable diagnostics for failures. Ensure data reproducibility and comparability across product versions and conditions.
Hard Requirements
- Built and maintained production-grade automation or test infrastructure
- Experience evaluating systems with correctness graded by quality, accuracy, or latency thresholds
- Strong Python skills (orchestration, CI pipelines, cloud storage, reproducible environments)
- Experience with backend services and APIs
- Ability to write clear technical findings
- Bachelor's degree in a relevant field or equivalent experience
Soft Requirements
- Built agent-based or LLM-driven automation
- Worked on evaluation or benchmarking for computer vision, 3D reconstruction, or spatial systems
- Instrumented dashboards or scorecards for leadership decisions
- Operated data provisioning or registry infrastructure