Note: The job is a remote job and is open to candidates in USA. Peregrine Advisors is an AI and data innovation hub helping government solve complex problems and deliver better outcomes. The Senior Data Engineer and Analytics Lead will serve as technical continuity across production data products, building and integrating data pipelines, owning data quality, supporting analytics, and making products understandable and supportable after cutover.
Responsibilities
- Reliable ingestion and transformation pipelines across a legacy system, the current system of record, and multi-format contractor submissions, with traceable source-to-target mappings
- Data Vault 2.0 and Gold tier models that support the required analytics and can be queried independently by agency analysts
- Documented deduplication, reconciliation, and data quality controls, including the evidence required for acceptance
- Integrated semantic models, Microsoft Power BI support, performance optimization, and production-ready code
- Technical review of partner work before it enters the Peregrine acceptance process
- Complete data dictionaries, pipeline specifications, runbooks, and knowledge transfer materials
Skills
- 8+ years in data engineering or analytics engineering, including at least three years with Azure Databricks or a comparable lakehouse platform
- Bachelor's degree
- Advanced Structured Query Language (SQL) and Python or PySpark, Delta Lake, extract, transform, and load (ETL) and extract, load, and transform (ELT), orchestration, schema design, data quality, and performance tuning
- Hands-on experience with Data Vault 2.0, dimensional modeling, semantic models, and production analytics
- Working familiarity with Unity Catalog, source control, automated deployment, environment promotion, and continuous integration and continuous delivery (CI and CD)
- Ability to support Microsoft Power BI datasets and dashboards and to collaborate with machine learning engineers on feature pipelines and model deployment
- Strong technical writing and the discipline to maintain diagrams, mappings, specifications, and runbooks as the build changes
- United States citizenship; dual citizenship and green card holders are prohibited by the contract terms
- The ability to satisfy the required suitability, security, and access requirements
- Hands-on and exacting
- You prefer working code and reconciled data to architecture theater
- Comfortable challenging assumptions with evidence and changing course when the data proves the design wrong
- Able to teach, document, and review without becoming a bottleneck
- Reliable in a partner-heavy team and willing to own the seams between work packages
- Curious about audit and planning questions, not only platform mechanics
- Experience on a federal system accredited at Impact Level 5 (IL-5) or higher
- Databricks Data Engineer, Azure Data Engineer, or a relevant cloud certification
- ServiceNow data, federal audit data, government financial data, or controlled federal environments
- Experience moving solutions between Azure environments using infrastructure as code and Databricks Asset Bundles
Benefits
- Medical, dental, and vision insurance with the employee premium fully paid and half of dependent premiums
- Employer-paid life, accidental death, and short-term and long-term disability insurance
- A 401(k) matched 100% up to 4% of salary, vesting immediately
- Unlimited paid time off
- Sponsored professional certifications and continuing education
- Extensive onboarding
- Rotation across functions to expand your skills and perspective
Company Overview