Note: The job is a remote job and is open to candidates in USA. Lumenalta is hiring a Senior Infrastructure Engineer to support database and ETL infrastructure in an Azure environment for a client in the regulated banking domain. The role focuses on operating Azure Data Factory pipelines and Snowflake ingestion, troubleshooting file movement and database issues, and maintaining monitoring, security, reliability, and documentation.
Responsibilities
- ADF operations. Monitor Azure Data Factory, read failed pipeline runs, and fix triggers, linked services, self-hosted integration runtimes, and expired or rotated credentials so data keeps moving
- Snowflake administration. Operate the Snowflake side of ingestion: stages, file formats, warehouses, roles and permissions, COPY INTO failures, and stuck or expensive queries
- File movement troubleshooting. Investigate and resolve ingestion failures such as bad file formats, missing or late files, expired credentials, misconfigured stages, and triggers that did not fire, and document the root cause and fix for each
- Storage and transfer infrastructure. Manage the blob storage, SFTP endpoints, access keys and SAS tokens, and file arrival monitoring that feed the pipelines
- Monitoring and alerting. Build alerting for pipeline failures, load failures, database health, and credential expiry with Azure Monitor and Log Analytics, so issues are caught before the business notices
- Vulnerability remediation. Own scanner and penetration test findings on database servers, integration runtime hosts, and data services: apply patches, upgrade software, fix configurations, and track exceptions to closure
- Network collaboration. Explain what data services need from the network (private endpoints, VNet integration, NSG rules, integration runtime connectivity) and work with networking teams to put it in place
- Documentation. Write and maintain runbooks covering recovery steps, credential rotation procedures, and known failure patterns
Skills
- 7+ years of experience in infrastructure or operations, with at least 3 years hands-on in Azure
- Strong operational experience with Azure Data Factory: troubleshooting failed runs, triggers, linked services, integration runtimes, and credentials
- Hands-on Snowflake administration in production: stages, file formats, warehouses, roles and permissions, and troubleshooting failed loads
- Experience operating Azure storage and file transfer infrastructure (blob storage, SFTP, access keys, SAS tokens)
- An operational troubleshooting mindset: takes a failed overnight load from investigation to resolution and documents the cause
- Experience setting up monitoring and alerting for production data pipelines
- Experience owning vulnerability remediation on servers and data services, from finding to closure
- Working knowledge of Azure networking, including VNets, private endpoints, and NSGs
- Strong documentation habits, including writing and maintaining runbooks
- A strong sense of ownership and the ability to work independently, taking problems from investigation to resolution
- Advanced English and the ability to communicate technical issues clearly to engineers and client stakeholders in a distributed, remote team
- Administration of Azure SQL Database, SQL Managed Instance, or SQL Server
- Working experience with AKS, enough to debug workloads and service connectivity that feed or consume data
- Experience operating Databricks, Azure Synapse, or Microsoft Fabric
- Scripting in PowerShell, Python, or SQL for automation and troubleshooting
- Experience running CI/CD pipelines (Azure DevOps Pipelines or GitHub Actions) for ADF artifacts
- Infrastructure as code with Terraform or Bicep
- Experience in banking, financial services, or other regulated environments
- Consulting or client-facing delivery experience
- Certifications such as DP-300, DP-203, AZ-104, or SnowPro Core
Benefits
- Flexible working hours in a remote environment.
- Health insurance (medical and dental) for T4 Employees.
- A professional development fund to enhance your skills and knowledge.
- 15 days of paid time off annually.
- Access to soft-skill development courses to further your career.
Company Overview