Technical Lead Manager, Ml Dataset Platform
- Countries
- Hybrid, Remote, USA, Canada
- Job Types
- software & tech
- Experience
- managers
- Organization Types
- transportation & mobility, robotics, startups
- Location
- San Francisco - Pittsburgh - Toronto - Hybrid - Remote
- Posted Date
- Company
- Waabi
- Salary
- USD200,000 - USD280,000 yearly
AI Summary
Job Description
Lead and manage the ML Dataset Platform team as technical lead and people manager, setting roadmap, hiring, and mentoring. Define APIs, tools, and storage formats for versioned, traceable ML datasets, build scalable dataset tooling, own dataloading tools, streamline multi-cloud data access, ensure data lineage, and drive adoption across ML teams.
Hard Requirements
- Deep ML dataset experience: large-scale data infrastructure for ML training (storage formats, versioning, ETL, dataloading), petabyte-scale sensor/multimodal data
- Strong Python skills and comfort with PyTorch training loops
- Strong software engineering fundamentals; distributed systems, cloud storage, data processing frameworks (Spark, Ray, Beam)
- Proven technical leadership of platform/infrastructure used by multiple teams, defining APIs and driving adoption
- People leadership: managed or tech-led engineers including hiring and mentoring
- Strong communication, consensus building, and delivery in fast-paced environments
Soft Requirements
- ML data infrastructure experience in autonomous driving or robotics (multi-sensor logs, LiDAR, camera, HD maps)
- Experience with columnar/tensor storage formats (Parquet, Lance, WebDataset, Zarr) and dataset versioning tools
- Experience with multi-cloud or hybrid training environments
- Experience with data lineage, metadata catalogs, or feature-store systems