Note: The job is a remote job and is open to candidates in USA. ContractStaffingRecruiters.com is seeking a Lead Data Engineer with experience delivering complex data solutions. The role involves translating business objectives into data requirements, designing and developing scalable data products and ETL processes, and supporting data transformation and distribution across systems. The position also provides architectural oversight, database development, cloud technology integration, testing, and project documentation.
Responsibilities
- This person will be responsible for supporting data transformation and distribution to end consumers. Candidate will assist with requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products
- Work with the Business Intelligence team and operational stakeholders to translate objectives into success metrics, system qualities, data requirements, and acceptance criteria that engineering teams can execute
- Serve as the primary subject matter expert for data, analytics, and integration needs across assigned business domains, translating business requirements into repeatable, executable design patterns and system qualities
- Partner closely with Data Product Managers, Architects, and Engineering teams to identify integration opportunities, select appropriate tools, and define shared data, interfaces, and data flows
- Provide architectural and design oversight through planning, execution, and operations to ensure alignment with enterprise standards and successful implementation
- Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes
- Design and develop database objects, tables, stored procedures, views, etc
- Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
- Understands the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake
- Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
- Maintain comprehensive project documentation
- Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members
Skills
- Experience in projects emphasizing complex data solutions
- Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members
- Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT
- Database platforms such as: Oracle, SQL Server, MySQL
- Big data concepts and technologies such as Synapse & Databricks
- AWS and Azure cloud computing
Company Overview