Note: The job is a remote job and is open to candidates in USA. UST is a mission-driven technology company that helps clients create transformative experiences and human-centered solutions. The Lead I - Data Engineering role focuses on migrating data assets and updating pipelines across unified AWS and Databricks environments, while also provisioning workspaces, mapping permissions, and validating migrations.
Responsibilities
- Hands-on Migration: Execute the moving of data assets, schemas, tables, and notebooks from the source tenant to the target environment
- Pipeline Updates: Update and test data pipelines, changing storage paths, API endpoints, and connection strings to match the new unified architecture
- Workspace Setup: Use Terraform and platform APIs to spin up new, unified workspaces, clusters, and warehouses according to the new company standards
- Permissions Mapping: Recreate and map user groups, access permissions, and roles from the old systems into the new centralized governance model
- Monitoring & Validation: Run data validation tests and monitor migration logs to ensure zero data loss or downtime during cutovers
Skills
- UST is searching for a Data Platform Engineer Merger & Migration with solid hands-on experience using AWS (S3, IAM, EC2, Lambda) in a multi-account setup
- 2-4 years of experience working in Data Engineering, Platform Operations, or Cloud Operations
- Strong troubleshooting skills and the ability to work collaboratively to solve migration roadblocks
- Practical administration experience with Databricks (clusters, notebooks, jobs) OR Snowflake (warehouses, roles, storage integration)
- Automation Tools: Comfortable using Terraform for provisioning infrastructure and Git/CI/CD for deployment pipelines
- Core Coding: Proficient in Python and SQL for writing tests, scripting automation tasks, and verifying data structures
Benefits
- Full-time, regular employees accrue a minimum of 10 days of paid vacation per year.
- Full-time, regular employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
- Full-time, regular employees receive 10 paid holidays.
- Full-time, regular employees are eligible for paid bereavement leave and jury duty.
- Full-time, regular employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
- Full-time, regular employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
- Full-time, regular employees receive Company-paid basic life insurance, accidental death and disability insurance, and short- and long-term disability benefits for employees only.
- Full-time, regular employees may purchase additional voluntary short-term disability benefits.
- Full-time, regular employees may participate in a Health Savings Account (HSA).
- Full-time, regular employees may participate in a Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses as allowable under IRS guidelines.
- Part-time employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
- Part-time employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
- Full-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
- Full-time temporary employees are eligible to participate in the Company’s 401(k) program with employer matching.
- Full-time temporary employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
- Part-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
- All US employees who work in a state or locality with more generous paid sick leave benefits than specified here will receive the benefit of those sick leave laws.
Company Overview