About the Engineering Team:
Our Engineering team lies at the core of the value we offer to our customers. We solve complex problems by working not only within our squads, but also by working collaboratively with other teams across the organisation. Our company tech stack includes .Net Core (C#), Python, MS SQL Server, Elastic Search, and more. If you are excited by solving complex technical challenges, this is the right place for you! We are in a process of moving towards distributed data on cloud platforms and have challenging opportunities in optimizing both bulk and real-time processing!
Detection Squad
What you’ll do
- Define, design and drive software architecture in partnership with software engineers to enable quick and easy consumption of data
- Understanding how the Data Model and ETL Mapping transforms through the software framework
- Improve, deliver, maintain and support new & existing features in our customer products
- Contribute to Shift’s new technologies adoption by monitoring technological development, driving research and building POCs
- Provide technical guidance to peer engineers and help them to upskill
- Actively Document and Diagram the technical design and architecture.
What you bring...
- You have at least 4 years of experience in software development
- You have strong coding skills: solid experience with Python would be ideal, but any other OOP language is ok!
- Apache Spark a must, with experience debugging, hardening and optimising pipelines
- 3+ years of SQL database, CosmosDB/MongoDB
- 3+ years experience in custom ETL design, implementation and maintenance
- 3+ years experience with Data Modeling
- You have a good understanding of distributed data systems
- You understand data warehousing concepts, have experience in resolving performance and scalability issues on data pipelines
- Bonus Experience with stores: feature store, vector database,
- Nice to have: OLAP db, GraphDB, Databricks DBT / SQL mesh (Niche) ML Ops
- You are used to work closely with cross-functional teams including data scientists or engineers
- You can communicate clearly in English
Recruitment Process
- HR Screening
- Technical Screening with a software architect
- Second Technical screening with a Data Engineer
- Final Round with Hiring Manager
#LI-BA1 #LI-ONSITE #LI-HYBRID
