Note: The job is a remote job and is open to candidates in USA. Valtech is an experience innovation company and trusted partner to recognized brands, focused on digital transformation and customer experiences. The Senior Data Engineer will build and support batch and real-time data pipelines using Databricks, Azure, SQL, Python, Spark, and cloud services, while tuning queries and resolving software or process issues.
Responsibilities
- Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data pipelines
- Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
- Provide consultation and lead the implementation of complex programs
- Develop and maintain documentation relating to all assigned systems and projects
- Tune queries running over billions of rows of data running in a distributed query engine
- Perform root cause analysis to identify permanent resolutions to software or business process issues
Skills
- To be considered for this role, you must meet the following essential qualifications:
- SQL Server (T-SQL, query-heavy, not ORM)
- PostgreSQL (read-only, for the Cargotel replica)
- Python + FastAPI
- Scikit-learn (percentiles, outlier detection)
- Understands acceptance/likelihood models (carrier-accept-probability logic)
- Kafka (consuming, not building)
- Can read C# well enough to extract logic (not write it)
- AWS basics: S3, RDS, Secrets Manager, CloudWatch
- Terraform (read fluency)
- Proven industry experience executing data engineering, analytics, and/or data science projects or Bachelors/Masters degree in quantitative studies including Engineering, Mathematics, Statistics, Computer Science or computation-intensive Sciences and Humanities
- SQL Server (T-SQL, query-heavy, not ORM)
- PostgreSQL (read-only, for the Cargotel replica)
Benefits
- Flexibility, with remote and hybrid work options (country-dependent)
- Career advancement, with international mobility and professional development programs
- Learning and development, with access to cutting-edge tools, training and industry experts
Company Overview