Note: The job is a remote job and is open to candidates in USA. Cotiviti is hiring a Data Engineer to build and maintain scalable data infrastructure and pipelines for analytics and reporting solutions. The role focuses on ETL/ELT development, Databricks and Spark-based processing, data quality assessment, data gap analysis, semantic layer development, and collaboration with cross-functional Agile teams.
Responsibilities
- Design, build, and maintain ETL/ELT pipelines to ingest, process, and transform data from multiple sources
- Architect and optimize data storage solutions including databases, data lakes, and warehouses (e.g., Hadoop, PostgreSQL, MySQL, Oracle)
- Develop and manage data workflows in Databricks, including authoring, executing, and optimizing Spark-based queries and models
- Implement data quality assessment frameworks in Databricks, including profiling, validation, and monitoring of data assets
- Perform data gap analysis to identify missing, incomplete, or inconsistent data and recommend remediation strategies
- Develop and maintain a semantic layer to support reporting and business analytics, ensuring data is accessible in business-friendly formats
- Automate data processes and workflows to improve efficiency and reliability
- Ensure data security, governance, and compliance in all data engineering solutions
- Collaborate with analytics, business, and development teams to understand data requirements and deliver robust, scalable solutions
- Maintain comprehensive documentation of data flows, pipelines, repositories, and semantic layers
- Deliver solutions using Agile development processes and participate in code reviews for adherence to standards and best practices
Skills
- * Bachelor's degree in Computer Science, Information Technology or equivalent work experience
- * 2+ years' experience in data engineering, designing and maintaining data pipelines and infrastructure
- * Experience with Databricks for data processing, pipeline development, and data quality assessment
- * Proficiency in Spark, Python, Scala, and SQL across multiple database platforms (Oracle, MySQL, PostgreSQL)
- * Experience with big data tools and distributed systems (e.g., Hadoop, Kafka, Pig)
- * Familiarity with data warehousing concepts and semantic layer development
- * Experience in data gap analysis and implementing data quality frameworks
- * Ability to work independently and collaboratively within Agile teams
- * Strong problem-solving and creative thinking skills
- * Must be able to sit and use a computer keyboard for extended periods
- * Willingness to work after hours/weekends as required for major deadlines
- * Flexibility to participate in international work processes, including conference calls across global time zones
- * Knowledge of data governance, security, and compliance practices
- * Familiarity with infrastructure-as-code, containerization, and CI/CD pipelines for data workflows
- * Ability to document and communicate technical concepts to both technical and non-technical audiences
- * Proficient with Microsoft Office Suite (Word, Excel, PowerPoint)
- * Experience integrating Databricks workflows with other big data tools and platforms
- * Ability to collaborate with analytics teams to support business-friendly reporting solutions
- * Communicating with others to exchange information
- * Assessing the accuracy, neatness, and thoroughness of the work assigned
- * Remaining in a stationary position, often standing or sitting for prolonged periods
- * Repeating motions that may include the wrists, hands, and/or fingers
- * Must be able to provide a dedicated, secure work area
- * Must be able to provide high-speed internet access/connectivity and office setup and maintenance
- * Experience in healthcare data engineering, including claims data, billing, and coding (preferred)
Benefits
- Medical, dental, vision, disability, and life insurance coverage
- 401(k) savings plans
- Paid family leave
- 9 paid holidays per year
- 17-27 days of Paid Time Off (PTO) per year, depending on specific level and length of service with Cotiviti
- This role is eligible for discretionary bonus consideration.
Company Overview
Company H1B Sponsorship