Note: The job is a remote job and is open to candidates in USA. Baldwin Group Colleague, Inc. is hiring a Senior Data Engineer to design and manage data systems, pipelines, and data management tools. The role leads data pipeline projects and builds, documents, tests, and maintains pipelines across internal and external data sources and platforms.
Responsibilities
- Collaborate with data architect, analysts, and stakeholders to identify and document needs/requirements for data pipelines and process automation
- Design, build, document, test, and maintain data pipelines using industry best practices
- Performs ETL, ELT operations in accordance with enterprise data governance and security standards
- Develop data quality and governance process to ensure the accuracy and quality of the data through inspection, validation, processing, anomaly detection
Skills
- Detail oriented and proactive in taking measures to avoid or mitigate issues
- Excellent understanding of computer systems, integrations, databases, and data storage systems
- Understanding of agile data engineering concepts and processes
- Ability to capture and document business processes and requirements and work with colleagues to create functional requirements
- Ability to work with clients to translate business needs to technical solutions
- Ability to provide guidance, mentoring, and training for peers
- Exceptional interpersonal skills and ability to effectively communicate with teams across the entire organization
- Proficiency in Microsoft Office Suite (Word, Excel, PowerPoint, Outlook)
- Ability to learn any other appropriate program or software system used by the firm as necessary
- 5-7 years of relevant experience required
- BA/BS in relevant discipline required
- Vast experience with multiple development methodologies
- Experience of building large, complicated data pipelines cross different platforms, data sources, data structures
- Experience of working with relational databases such as SQL Server, Oracle, etc., and SQL scripting
- Experience with Power BI
- Experience of cloud platforms (like AWS, Azure, GCP) and its ETL tools and techniques of sourcing, maintaining, and updating data, data warehousing, data cleansing & transformation, etc
- Programming experience in Python, Spark, and other similar languages
- Advanced programming knowledge and experience with large-scale processing engines are required, as well as a deeper understanding of database security and compliance tools
Benefits
- Remote work (US).
Company Overview