As a Staff Applied Scientist, Autonomy Evaluation, you will build the world's most advanced evaluation of AV driving capabilities and stack with the end goal of achieving and maintaining superhuman levels of performance across all criteria by developing high quality metrics and actionable insights throughout the full development lifecycle. You drive impact focused projects that address the everyday challenges that our AV's face on urban roads- ones that do not have standard solutions available.
What you'll be doing:
As a tech lead, you will demonstrate your leadership by:
- Defining success criteria from ambiguous problem statements
- Driving evaluation strategies and roadmaps, leading the development, monitoring and analysis of safety, roadcraft and compliance metrics for core autonomous capabilities
- Ensuring comprehensive validation of AV performance with high fidelity signals
- Streamlining testing and road monitoring process in collaboration with AV Engineers to build a fast feedback loop to AV model development
- Mentoring fellow Data Scientists and fostering a positive, collaborative work environment
- Role-modeling a positive, humble and growth-oriented attitude
As an individual contributor, you will be responsible for:
- Building high quality data miners and metrics that serves testing, road monitoring, and model training
- Analyzing AV performance data to extract insights and opportunities for optimization.
- Developing new methodologies, e.g., machine learning based approaches, to scalably improve the quality of metrics
- Testing and deploying your methods in our simulation environment
- Collaborating with AV Software Engineers, Systems Engineers, Test Engineers along with Product Management and other stakeholders to build shareable tools, methods, and dashboards
- Converting insights into actionable recommendations for AV software development and launch readiness decisions, and succinctly communicate these findings to partners and leadership
What you must have:
- A Masters or PhD degree or equivalent experience in Robotics, Transportation, Industrial Engineering, Operation Research or other relevant industry experience
- 5+ years post-academic experience in evaluating large models, data science, machine learning, or a closely-related field
- A track record of leading multi-functional initiatives and collaborating with engineering and product teams
- Strong software engineering foundation and proficiency in production-environment coding and best practices
- Proficiency in SQL and Python
- Experience designing, training, and critically analyzing machine learning models for big data
- Solid statistical foundations, familiarity with hypothesis testing, statistical power, and common biases in data
- Experience designing, developing and maintaining automated reporting tools for management and other partners
- Creative, inventive, and passionate about seeking new solutions to problems and opportunities
- 3+ years of experience mentoring other data scientists
Bonus Points!
- Experience in the autonomous driving industry
- Experience in C++
The salary range for this position is $183,600 - $270,000. Compensation will vary depending on location, job-related knowledge, skills, and experience. You may also be offered a bonus, long-term incentives, and benefits. These ranges are subject to change.
