Note: The job is a remote job and is open to candidates in USA. Confidential company is seeking a Data Engineer for a 12+ month remote engagement based in Chicago, Illinois. The role focuses on designing and maintaining data pipelines, analyzing and transforming raw data, improving data quality and reliability, and supporting scalable data infrastructure. The engineer will collaborate with cross-functional stakeholders and identify process improvements through automation and root cause analysis.
Responsibilities
- Create and maintain optimal data pipeline architecture
- Analyze and organize raw data
- Write pseudo code
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Experience supporting and working with cross-functional teams in a dynamic environment
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management
Skills
- 5+ years of experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field
- Very good knowledge in
- SQL (7+ out of 10)PySpark
- Databricks on Azure (7+ out of 10)
- (7+ out of 10)
- SparkSQL (7+ out of 10)
- Azure/ADLS (7+ out of 10)
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- Great numerical and analytical skills
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Experience supporting and working with cross-functional teams in a dynamic environment
- U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time
- Data engineering certifications/Azure is a plus
Benefits
- Remote work arrangement in Chicago, IL
Company Overview