Note: The job is a remote job and is open to candidates in USA. ATG USA is a leading technology business partner focused on the Architectural, Engineering, and Construction industry. The Senior Software and Data Engineer will build and evolve data solutions on the Microsoft data platform, focusing on data warehouse, data lake, and analytics, while collaborating with clients to ensure their data strategy aligns with business needs.
Responsibilities
- Design and build data warehouse solutions on Microsoft Fabric and Azure SQL aligned to client business needs
- Implement and evolve the Medallion Architecture — Bronze (raw), Silver (cleansed/conformed), and Gold (business-ready) layers — on Fabric and Azure SQL
- Develop and maintain ELT/ETL pipelines that are reliable, observable, and easy to operate
- Model data for analytics and reporting — fact/dimension design, conformed dimensions, performant aggregates
- Collaborate with ATG technical leads and client stakeholders to translate requirements into delivery-ready solutions
- Own quality — testing, validation, documentation, and monitoring of pipelines and datasets
- Research and propose solutions independently; bring options and tradeoffs, not just questions
- AI Readyness: understanding of leveraging Fabric and Azure AI Search to tag data and make data available to Enterprise AI Orchestration platforms such as Foundry
- Consulting: Able to explain various data and analytic approaches to non-technical stakeholders. Able to conduct Bronze to Silver analysis and mapping and present to clients. Able to interview clients to design data marts for Gold
- Technical Leadership: Provide thought leadership on best practices for readable, maintainable, performant, and secure data pipelines
Skills
- 5+ years experience with data engineering experience with at least 2 years on the Microsoft platform
- Microsoft Fabric: OneLake, Lakehouse, Warehouse, Pipelines, Notebooks, Dataflows Gen2
- Azure SQL: schema design, performance tuning, indexing, partitioning, and security
- Medallion Architecture: hands-on experience designing and building Bronze / Silver / Gold layers in Microsoft Fabric and Azure SQL
- T-SQL: advanced querying, stored procedures, window functions, performance optimization
- ELT / ETL pipeline development: ingestion, transformation, orchestration, and monitoring across the Bronze >> Silver >> Gold flow leveraging tools such as Azure Data Factory, Synapse Analytics, Azure Functions, Python and PySpark for Notebook development
- Data warehouse modeling: dimensional modeling (Kimball), slowly changing dimensions, conformed dimensions in the Gold layer
- Document requirements, data flows, and system architecture
- Estimate effort accurately and communicate blockers or timeline risks proactively
- Champion best practices for readable, maintainable, performant, and secure code
- Mentor junior engineers and share knowledge across the team
- Manage your time effectively and communicate technical trade-offs clearly
- Detail oriented: ability to understand and business processes & data
- Power BI and DAX for semantic models and reporting
- Git-based source control and CI/CD for data pipelines (Azure DevOps or GitHub Actions)
- Experience with Snowflake and Databricks
- Experience with AEC data including Autodesk APS and Autodesk Forma
- Familiarity with data governance, lineage, and cataloging (Microsoft Purview)
- Experience with Microsoft Foundry and Azure AI Search
- .NET or Python Django Web Application and RESTful API development
- Azure & AWS infrastructure, Terraform
Benefits
- Health, Dental and Vision Benefits
- Short-Term and Long-Term Disability
- Wellness Programs
- 3 weeks of PTO each year, paid holidays, and your birthday off
- 2 paid volunteer days each year
- 401k match up to 4% after 90 days of employment
- Great culture with frequent in-person events and gatherings
Company Overview