About the team:
Our Engineering team is fast-growing and highly focused on having an impact in building highly scalable and reliable data processing pipelines.
Engineers on this team build out data processing modules for both the internal and external products. These are not standard crud apps but advanced workflow, data visualization and business intelligence systems designed for Forma.ai’s specific needs.
This team is tightly integrated and works closely with various internal departments on a day-to-day basis to build features and solve problems effectively.
What you'll be doing:
Forma’s data platform takes in a large volume of data and variable data points to process them according to a highly-configurable rules engine.
Reporting to the Manager of Data Platform, the Staff Backend Engineer will play a critical role in the evolution of our next-generation Databricks/Spark based data platform. You will be part of the efforts to scale our eco-system which processes ever-increasing volumes of data. You'll be expected to be a technical leader in the team, helping to design and implement scalable and maintainable solutions and highlight tradeoffs in designs. You should be the type of person that makes every piece of code they touch better. You may be asked to work on custom customer-specific extensions or features.
What skills / traits are we looking for:
- Prior experience designing and building complex backend solutions. We use Python, but the language is less important than the skillset
- Solid background in schema design and data modelling, SQL and ideally some NoSQL solutions
- Excellent written and verbal communication skills
- Has a history of reducing ownership cost and improve reliability and observability in a product
- Deep appreciation for building end-to-end customer facing products with a strong sense of customer empathy
- Interest in being involved in Forma.ai’s product direction along with contributing to establishing best development practices and processes from design to deployment and maintaining our software solution
- Thrive in a detail-oriented collaborative environment with Product, Engineers, and Analytics teams
- Spark, or other ETL tools / frameworks a big plus
Technologies we use:
- Backend: Python, Django, Postgres
- Data Orchestration: Databricks/Spark, Dagster
- Infrastructure: AWS, Docker, GitHub Actions
