Note: The job is a remote job and is open to candidates in USA. Brooksource is recruiting for a client launching a new AI-ready Enterprise Data Platform built on Google Cloud and BigQuery. The Senior Developer / Data Engineer will build and optimize data pipelines, develop Terraform infrastructure, manage data ingestion, and collaborate on testing, governance, and CI/CD standards.
Responsibilities
- Develop and optimize data pipelines and transformations within the BigQuery medallion architecture
- Write and tune complex SQL queries for large-scale data transformation and validation
- Build and maintain Terraform-based infrastructure to support pipeline deployment
- Implement and manage data ingestion from on-prem and cloud source systems using GCP tools (Dataflow, Dataform)
- Collaborate with technical leads on pipeline standards, testing, and CI/CD automation
- Ensure data governance and cataloging through Google Knowledge Catalog (Dataplex)
- Participate in technical Q&A sessions and communicate solutions clearly to panel and team members
- Contribute to a culture of hands-on technical excellence and proactive problem-solving in a newly established team
Skills
- Expert-level SQL skills: complex queries, performance tuning, and data validation (must be recent and hands-on)
- Strong hands-on experience with Terraform in a GCP environment, including authoring and owning modules (not just running existing ones)
- Production experience with Dataflow and/or Dataform for pipeline development (hands-on, not just conceptual)
- Experience developing and optimizing data pipelines within BigQuery medallion architecture
- Familiarity with CI/CD automation and pipeline standards
- Ability to work effectively in a fast-paced, newly established platform team
- Demonstrated ability to acknowledge unfamiliarity rather than guess through technical questions
- Lack of recent, hands-on delivery with SQL or Terraform (theory-only backgrounds will not be considered)
- Medium-level skills in SQL, Terraform, or Dataflow/Dataform (the bar is set at strong, hands-on expertise)
- Guessing through technical questions instead of acknowledging unfamiliarity
- Experience with Google Knowledge Catalog / Dataplex (nice to have)
- Background in healthcare or other highly regulated data environments (nice to have)
- Clear, confident communication skills, especially in technical Q&A settings (nice to have)
Benefits
- Remote role
- Competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs
- 401k plan that includes a company match and is fully vested after you become eligible
- Paid time off
- Sick time
- Paid company holidays
- Employee Assistance Program (EAP) providing services like virtual counseling, financial services, legal services, and life coaching
Company Overview
Company H1B Sponsorship