Note: The job is a remote job and is open to candidates in USA. Collins Aerospace is an aerospace company advancing digital technologies and business efficiencies. The Data Engineer will design, build, and optimize large-scale batch and streaming data pipelines, distributed computing clusters, and production-ready analytics services using Python, PySpark, cloud platforms, and modern data lakehouse technologies.
Responsibilities
- Design and deploy robust batch and streaming ETL/ELT pipelines using PySpark and Python
- Optimize Spark jobs by tuning configurations, managing partitioning, and resolving data skew or OOM (Out of Memory) errors
- Implement modern data lakehouse architectures using Delta Lake, Iceberg, or Hudi
- Build and maintain complex workflow DAGs using orchestration tools like Apache Airflow
- Develop backend Python services or REST APIs (e.g., Fast API, Flask) to expose processed data to downstream applications
- Write clean, modular, and unit-tested code while participating in rigorous code reviews
Skills
- U.S. citizenship is required, as only U.S. citizens are authorized to access information under this program/contract
- • This is a hybrid role in Puerto Rico. Applicants must reside in Puerto Rico. \•\•
- • Typically requires a University Degree and minimum 5 years prior relevant experience or an Advanced Degree in a related field and minimum 3 years of experience
- • Must be a U.S. Citizen
- • Strong proficiency in Python (OOP, concurrency, data structures) and advanced SQL
- • Deep production experience with Apache Spark / PySpark (Data Frames, Spark SQL, RDDs)
- • Hands-on experience with cloud data platforms like AWS (EMR, Glue), Azure (Databricks), or GCP
- • Experience working with Snowflake, Big Query, Redshift, or Synapse
- • Proficient with Git, Docker, and automated deployment pipelines
- • PySpark MLlib or deploying Machine Learning models to production
- • Familiarity with streaming technologies like Apache Kafka or Spark Structured Streaming. Databricks Certified Data Engineer or Apache Spark Developer certifications
Benefits
- Hybrid work arrangement in Puerto Rico
- Medical, dental, and vision insurance
- Three weeks of vacation for newly hired employees
- Generous 401(k) plan that includes employer matching funds
- Participation in the Employee Scholar Program (ESP)
- Life insurance and disability coverage
- Employee Assistance Plan, including up to 8 free counseling sessions
- Access to digital tools to work with colleagues around the world
- Access to Collins sites when work requires in-person meetings
Company Overview