Note: The job is a remote job and is open to candidates in USA. RTX's Collins Aerospace is seeking an experienced Python and PySpark Developer to design, build, and optimize next-generation big data pipelines. The role focuses on developing ETL/ELT pipelines, optimizing distributed Spark workloads, implementing data lakehouse architectures, managing workflow orchestration, and building backend services for downstream applications.
Responsibilities
- Design and deploy robust batch and streaming ETL/ELT pipelines using PySpark and Python
- Optimize Spark jobs by tuning configurations, managing partitioning, and resolving data skew or OOM (Out of Memory) errors
- Implement modern data lakehouse architectures using Delta Lake, Iceberg, or Hudi
- Build and maintain complex workflow DAGs using orchestration tools like Apache Airflow
- Develop backend Python services or REST APIs (e.g., Fast API, Flask) to expose processed data to downstream applications
- Write clean, modular, and unit-tested code while participating in rigorous code reviews
Skills
- U.S. citizenship is required, as only U.S. citizens are authorized to access information under this program/contract
- Applicants must reside in Puerto Rico
- Typically requires a University Degree and minimum 5 years prior relevant experience or an Advanced Degree in a related field and minimum 3 years of experience
- Must be a U.S. Citizen
- Strong proficiency in Python (OOP, concurrency, data structures) and advanced SQL
- Deep production experience with Apache Spark / PySpark (Data Frames, Spark SQL, RDDs)
- Hands-on experience with cloud data platforms like AWS (EMR, Glue), Azure (Databricks), or GCP
- Experience working with Snowflake, Big Query, Redshift, or Synapse
- Proficient with Git, Docker, and automated deployment pipelines
- PySpark MLlib or deploying Machine Learning models to production
- Familiarity with streaming technologies like Apache Kafka or Spark Structured Streaming
- Databricks Certified Data Engineer or Apache Spark Developer certifications
Benefits
- Medical, dental, and vision insurance
- Three weeks of vacation for newly hired employees
- Generous 401(k) plan that includes employer matching funds
- Participation in the Employee Scholar Program (ESP)
- Life insurance and disability coverage
- Employee Assistance Plan, including up to 8 free counseling sessions
- Hybrid work arrangement, with employees working regularly both onsite and offsite
- All employees will have access to digital tools so they can work with colleagues around the world – and access to Collins sites when their work requires in-person meetings
Company Overview