About the role
As a Data Engineer at Sporty, you will play a critical role in ensuring the smooth processing and handling of data for our machine learning and data science initiatives. Your primary responsibilities will include designing, building, testing, optimising, and maintaining data pipelines and architectures for various aspects of our rapidly growing business.
What you'll be doing
- Design, develop and maintain scalable batch ETL and near-real-time data pipelines and architectures for various parts of our business, on fast and versatile data sources with millions of changes per day
- Ensure all data provided is of the highest quality, accuracy, and consistency
- Identify, design, and implement internal process improvements for optimising data delivery and re-designing infrastructure for greater scalabilit
- Builds out new API integrations to support continuing increases in data volume and complexity
- Communicate with data scientist, MLOps engineers, product owners and BI analysts in order to understand business processes and system architecture for specific product features
What you'll bring
- Bachelor’s degree, or equivalent experience, in Computer Science, Engineering, Mathematics, or a related technical field
- 3+ years of experience in data engineering, data platforms, BI or related domain
- Experience in successfully implementing data-centric applications, such as data warehouses, operational data stores, and data integration projects
- Experience with large-scale production relational and NoSQL databases
- Experience with data modelling
- General understanding of data architectures and event-driven architectures
- Proficient in SQL
- Familiarity with one scripting language, preferably Python
- Experience with Apache Airflow & Apache Spark
- Solid understanding of cloud data services: AWS services such as S3, Athena, EC2, RedShift, EMR (Elastic MapReduce), EKS, RDS (Relational Database Services) and Lambda
Even better if
- Understanding of ML Models
- Understanding of containerisation and orchestration technologies like Docker/Kubernetes
- Relevant knowledge or experience in the gaming industry
What's in it for you
- Sporty is a remote first company in pursuit of sustainability
- A competitive salary + individual performance based bonuses every quarter
- 28 days paid annual leave
- Our core working hours are 10am-3pm in your local time zone with flexibility outside of this
- Referral bonuses & flash bonuses
- Top of the line equipment
- Annual company retreats to provide great internal networking opportunities
Interview Process
- Remote video screening with our Talent Acquisition Team
- Offline Take home assignment
- Remote video interview with Team Members (90 Mins)
Bachelor's degree in Computer Science, Engineering, Mathematics or related field; 3+ years data engineering experience; SQL proficiency; Python familiarity; experience with Apache Airflow, Apache Spark, AWS services (S3, Athena, EC2, RedShift, EMR, EKS, RDS, Lambda).
Key Responsibilities
- designing data pipelines
- maintaining data architectures
- optimizing data delivery
Skills & Tools
SQL, Python, Apache Airflow, Apache Spark, AWS S3, AWS Athena, AWS EC2, AWS RedShift, AWS EMR, AWS EKS, AWS RDS, AWS Lambda, Docker, Kubernetes
Job Details
- Category: Data and Analytics
- Seniority: Mid Level
- Commitment: Full Time
- Workplace: Remote — Europe
- Languages: English
Benefits
- Generous paid time off
About Sporty Group
A remote-first sports technology company focused on data-driven products and services. — Industry: Information Technology