Company Description
AGSI was incorporated in April 2016. We are committed to supporting the goals of Arch divisions through exceptional service delivery. We pride ourselves on maintaining flexibility and responsiveness to adapt to business unit and industry demands while focusing on sound project management. We are dedicated to growing and developing our employees as we build strong teams with strategic leadership.
Job Description
Data Engineer will work closely with the rest of the product team and business peers to Strategic Analytics is a growing team at Arch. The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools and languages. This includes the following cloud based technologies: Databricks, Snowflake, Spark, Python and Azure Data Factory. As a key member of the Strategic Analytics team, you will advance our data engineering capabilities helping the team analyze data faster.
Qualifications
- Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability
- Perform data manipulation and transformation using SQL and Python
- Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines
- Discover and explore new sources of data with curiosity and creativity
- Create and maintain optimal data pipeline architecture
- Author detailed and comprehensible documentation of data pipelines and technical solutions
- Ensure data quality and completeness
TECHNICAL SKILLS Proficiency Level Required (R) /Optional (O)
SQL 4 R
Relational SQL databases 3 R
Data integrations services (SSIS, Azure Data Factory, etc.)
2 R
Microsoft Excel 3 R
Python, Scala, C++, Java or similar 2 O
Snowflake or other cloud-based data warehouse 3 O
NoSQL databases / unstructured data 2 O
Azure cloud services 1 O
- Advanced working SQL knowledge and experience working with relational databases, query authoring
- A successful history of manipulating, processing and extracting value from large, disconnected datasets
- Ideally, 3+ years of experience in a Data Engineer role or equivalent using SQL and/or Python
- Good organizational skills and attention to detail
- Excellent critical thinking skills to flag complex data challenges
- Experience with cloud technologies and Python is a plus
- Comfortable working in fast paced, highly collaborative environment
- Ability to effectively communicate to different target audiences
Additional Information
- BS in Computer Science, Information Technology degree, Data Analytics or equivalent
