Mission Summary
We are seeking a talented Principal Engineer to lead a team by building, improving, and maintaining robust large scale data processing and transformation pipelines. The team is responsible for building scalable pipelines to perform extraction of information from AV (autonomous vehicle) logs, transformation of data into different formats that can be consumed by downstream services, and for building interfaces to enable easy access to the data. We deal with data on the petabyte scale and provide critical functions to improve the development of a reliable AV. This is a hands-on role with people management responsibilities.
If you are a strong hands-on individual contributor and have a passion to oversee a small team of engineers, we encourage you to apply!
What You'll Be Doing
- Lead and provide mentorship to a team of engineers both technically and professionally
- Manage and drive team timelines, project commitments, and roadmap deliverables
- Work closely with users, leadership, and stakeholders to align and coordinate product design, project execution, and operational usage in setting and achieving objectives and key results.
- Design, build, and maintain scalable data processing and access with cloud ETL technology.
- Implement interfaces to enable self service data pipelines
- Write high quality, maintainable code to process terabytes of data
- Lead and champion high-level system design and quality code reviews/technical contributions.
- Ability to take a strong sense of ownership and responsibility for mentoring engineers
What We're Looking For
- 5+ years of professional experience as a data engineer or data pipeline engineer
- BS or MS in Computer Science or related field
- Expertise with Python programming
- Expertise with AWS services and solutions (EKS, Lambda, ETL)
- Experience with distributed system design and development
- Experience leading projects from end to end, designing and delivering and production stages
- Strong written and oral communication skills
- Comfortable working in a fast-paced, continuous delivery environment
Bonus Points (not required):
- Experience with Infrastructure Monitoring
- Experience working in cross-functional development teams
- Experience working with microservices
- Experience with people management
