Note: The job is a remote job and is open to candidates in USA. Gateway Financial Solutions is seeking a Senior Data Engineer to join their Technology, Data & Analytics team. In this role, you will design, build, and operate production-grade data pipelines and systems, while also engaging in high-impact projects that involve real-time APIs and automation.
Responsibilities
- Design and maintain scalable pipelines that ingest from internal systems, vendors, APIs, files, and cloud storage
- Model and transform data in the cloud data warehouse into trusted, analytics-ready datasets for reporting and downstream automation
- Expand data testing and monitoring to catch quality and performance issues early, and enable efficient, low-impact remediation
- Build and host the services and integrations that drive operational processes — real-time, event-driven APIs and system-to-system connections across internal platforms and external partners (often warehouse-centric, but not always)
- Automate document-heavy workflows such as OCR and document generation to remove manual steps from core operations
- Own the architecture and design of the systems you build and help set the technical patterns and best practices the department builds on
- Design and operate end-to-end orchestrated workflows, including event-driven and queue-based patterns beyond batch ELT; monitor, handle failures gracefully, and improve observability
- Use AI-assisted tooling to accelerate development, testing, and documentation, and build AI-enabled workflows and automation where they create durable leverage
- Mentor less-experienced engineers and participate in code reviews, raising the quality bar across the team
Skills
- 5+ years in data engineering, analytics engineering, or a related technical role
- Strong SQL and Python for building pipelines, integrations, and workflow automation
- 3+ years building in a cloud data warehouse (Snowflake, Redshift, or BigQuery), with hands-on modeling in dbt or a comparable transformation framework
- Production experience operating an orchestration tool such as Prefect, Dagster, or Airflow — not just authoring DAGs, but handling failures, retries, and dependencies
- Hands-on experience building and deploying services on AWS (e.g., S3, Lambda, SQS, ECS/Fargate, API Gateway)
- Extensive experience integrating with APIs to push and pull data — working within rate limits and handling authentication and errors gracefully
- Experience designing and operating ELT/ETL pipelines in a modern, Git-based CI/CD environment
- Hosting real-time or request/response APIs
- Document processing, OCR, or automated document generation
- Experience in auto finance or related financial services
Company Overview