Note: The job is a remote job and is open to candidates in USA. ContractStaffingRecruiters.com is seeking a Lead Data Engineer to support complex data solution projects. The role is hands-on and focuses on data transformation and distribution, requirements analysis, process-flow design and development, testing, integration, architecture, and scalable data solutions across multiple systems and sources.
Responsibilities
- This person will be responsible for supporting data transformation and distribution to end consumers
- Candidate will assist with requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products
- Work with the Business Intelligence team and operational stakeholders to translate objectives into success metrics, system qualities, data requirements, and acceptance criteria that engineering teams can execute
- Serve as the primary subject matter expert for data, analytics, and integration needs across assigned business domains, translating business requirements into repeatable, executable design patterns and system qualities
- Partner closely with Data Product Managers, Architects, and Engineering teams to identify integration opportunities, select appropriate tools, and define shared data, interfaces, and data flows
- Provide architectural and design oversight through planning, execution, and operations to ensure alignment with enterprise standards and successful implementation
- Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes
- Design and develop database objects, tables, stored procedures, views, etc
- Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
- Understands the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake
- Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
- Maintain comprehensive project documentation
- Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members
Skills
- Experience in projects emphasizing complex data solutions
- Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members
- Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT
- Database platforms such as: Oracle, SQL Server, MySQL
- Big data concepts and technologies such as Synapse & Databricks
- AWS and Azure cloud computing
Company Overview