Note: The job is a remote job and is open to candidates in USA. Highmark Health is a healthcare organization seeking a Big Data Engineer to design, build, and maintain enterprise data solutions. The role focuses on developing ingestion pipelines, transformations, data delivery frameworks, data governance processes, and MLOps capabilities across cloud, big data, and traditional data platforms.
Responsibilities
- In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms
- Work with internal and external platforms and systems to connect and align on data sourcing, flow, structure, and subject matter expertise. Work with business stakeholders and strategic partners to implement and support operational and analytic platforms. This may include products purchased by the organization that must be ingested or modeled/derived data maintained by enterprise platforms and data consumers
- Working across multiple, disparate systems and platforms, code, test, implement, and maintain scalable and extensible frameworks that support data engineering services
- Align with security, data governance and data quality programs by contributing to assigned components of metadata management, data quality management, and the application of business rules. Develop and maintain associated data engineering processes and participate in required operating procedures as part of the enterprise’s overall information management activities. Includes data cleansing, standardization, technical metadata documentation, and the de-identification and/or tokenization of data
- Maintain machine learning and AI engineering processes (MLOps) that are deployed to cloud or big data environments
- Responsible for delivery of assigned projects, this may include providing guidance to Junior contributors within team. Will attend meetings with customers as needed
- Assist with the establishment of standards and patterns for high performance data ingestion, transformation, and delivery. Keep current with cloud, big data, and data science technologies and be able to recommend and use best tools to perform current and future work
- Other duties as assigned or requested
Skills
- CANDIDATE MUST BE US Citizen (due to contractual/access requirements)
- Bachelor's Degree in Software Engineering, Information Systems, Computer Science, Data Science or related field
- 3 years of Data platform development, data engineering, software development, or data science
- 1 year of Big data or cloud data platform
- SQL
- Data Warehousing
- Problem-Solving
- Communication Skills
- Analytical Skills
- 0% - 25%
- Master's Degree Software Engineering, Information Systems, Computer Science, Data Science or related field
- 1 year of Google Cloud Platform, AWS, Azure or other cloud platform
- 1 year of Spark or Python
- 1 year of Data science, AI & machine learning engineering
- 1 year Healthcare Industry
- 1 year of Database Administration
Company Overview