Software Developer/Data Engineer - 12 Month Contract
Educational Qualifications
- BSc Computer Science / BEng
Professional Qualifications
- AWS Professional Certification
Years of Experience
- 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
Skills / Requirements
- 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
- Required to code complex transformations using loader specifications provided by the BA
- Experience working with Big Data sets and solving data-related challenges
- Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue
- Proficiency in coding languages: PySpark, Python, SQL
- Hands-on experience with AWS services, including S3, Athena, Lambda Functions, GLUE, EC2
- AWS experience and AWS certification required
- Experience in data modeling and data architecture design
Key Responsibilities
- Implement scalable data pipelines and architectures using PySpark, Python, SQL
- Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue
- Serve as a technical resource for team members and mentor junior engineers
- Collaborate with the team to deliver high-quality solutions that meet business requirements
- Ensure code is well-designed, maintainable, and follows best practices and standards
- Play a key role in shaping engineering practices by working in a scrum team to ensure sprint deliverables are met
- Utilize project development tools such as JIRA, Confluence, and GIT
- Assist DEVOPS Engineer in automation and CI/CD practices
- Evaluate and recommend new technologies to improve performance, scalability, and reliability of software systems.
Originally posted on