Note: The job is a remote job and is open to candidates in USA. SheJobs is a diversity-focused job portal committed to advancing inclusion and equitable employment opportunities. The company is seeking a remote Data Engineer to design, build, and maintain scalable Databricks and PySpark data pipelines, ETL processes, data models, and warehousing solutions while ensuring data quality and performance. The role also supports analytics and reporting, monitors pipeline health, troubleshoots issues, and documents data workflows.
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes within Databricks, using PySpark to process and transform large datasets
- Developing and optimizing data models, implementing data warehousing solutions, and ensuring data quality, reliability, and performance across various systems
- Collaborating with analytics, engineering, and business teams to understand data requirements, support reporting and data products, and contribute to best practices for cloud-based data engineering
- Monitoring pipeline health, troubleshooting issues, and documenting data workflows and standards
Skills
- Strong data engineering skills, including experience with Databricks, PySpark, and building scalable data pipelines
- Proficiency in data modeling and data warehousing concepts to design efficient, well-structured data stores
- Hands-on experience with Extract Transform Load (ETL) processes, including orchestration, optimization, and error handling
- Ability to support data analytics initiatives by preparing, validating, and optimizing datasets for reporting and insights
- Solid knowledge of SQL and at least one programming language commonly used in data engineering (such as Python)
- Experience with cloud data platforms (e.g., AWS, Azure, or GCP) and related storage and compute services
- Understanding of data governance, security, and compliance practices in handling sensitive information
- Strong problem-solving skills, attention to detail, and ability to work independently in a remote, collaborative environment
- Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent practical experience
- Prior experience in contract or consulting roles in data engineering is beneficial
Benefits
- Remote work arrangement
- W2 contract basis (no C2C)
Company Overview