Note: The job is a remote job and is open to candidates in USA. Google is seeking a Senior Security Engineer to help build resilient AI infrastructure for national security and public-sector environments. The role focuses on securing AI/ML deployments across on-premises GPU clusters and cloud-native environments, protecting model systems, and developing defenses against adversarial manipulation.
Responsibilities
- Architect and manage LLM deployments across on-premises (NVIDIA/AMD) and cloud (cloud computing platform, Google Cloud platform (GCP) environments. Audit multi-agent orchestration, agent construction, and vector databases to map data flows and enforce privilege boundaries
- Use Docker and Kubernetes to orchestrate scalable inference and training environments, optimizing Graphics Processing Unit (GPU) utilization and resource isolation
- Protect model weights, secure data ingestion, and harden inference endpoints across the Machine Learning operations (MLOps) lifecycle
- Investigate and mitigate AI-specific threats (e.g., prompt injection, jailbreaking, data poisoning). Map testing findings to MITRE ATLAS, OWASP for LLMs, and STRIDE models
- Bridge local high-compute clusters and cloud AI services while maintaining a consistent security posture
Skills
- Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, or a related technical field or equivalent practical experience
- 5 years of experience in AI/ML development, AI infrastructure engineering, or software development
- 5 years of experience with containerization (Docker) and orchestration (Kubernetes)
- 5 years of experience with Python and with libraries like PyTorch, TensorFlow, or Hugging Face Transformers
- Ability to travel up to 25% of the time as needed
- Must possess an active Top Secret/SCI security clearance with current polygraph
- Applicants must work 5 days per week on-site in Fort Meade, Maryland
- 5 years of experience in AI/ML research or software development
- Experience with LLM deployment frameworks such as vLLM, NVIDIA Triton, or Ollama and agent development
- Knowledge of open worldwide application security project (OWASP) for LLMs or similar security frameworks
- Familiarity with cloud-native AI services (e.g., cloud computing platform, Google Vertex AI)
- Track record of deploying AI models on air-gapped or on-premises high-performance computing (HPC) systems
Benefits
- Health, dental, vision, life, disability insurance
- Retirement Benefits: 401(k) with company match
- Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
- Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance
- Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
- Baby Bonding Leave: 18 weeks
- Holidays: 13 paid days per year
Company Overview