Note: The job is a remote job and is open to candidates in USA. Trase Systems is hiring a Senior or Staff Software Engineer to build and own critical components of Trase OS, its shared platform for deployments in regulated environments. The role focuses on distributed systems, workflow execution, reliability, scalability, and correctness, while contributing to architecture and engineering practices across teams.
Responsibilities
- Design, build, and own critical components of the core execution model (state machine, lifecycle, resource model, failure semantics)
- Build reliable distributed systems that behave predictably across retries, restarts, partial failures, and concurrent execution
- Develop platform APIs/SDKs connecting workflows, agents, tools, and product surfaces; drive versioning & compatibility
- Guarantee correctness via idempotency, deterministic replays, compensating actions, and data integrity
- Engineer reliability at scale: concurrency controls, rate limits, backpressure, sharding/partitioning, and workload isolation
- Build security & governance into the core: RBAC/ABAC, policy enforcement, fine-grained audit & lineage
- Deliver observability: distributed tracing, structured logs, metrics, and evaluation hooks; build an “explainable trail” of agent actions
- Own quality: design reviews, test strategy (unit, property, chaos), performance baselines, SLOs, incident response, and postmortems
- Mentor engineers, contribute to design reviews, and help establish strong engineering patterns across the platform
Skills
- 8+ years of experience building distributed/platform systems, including significant experience defining architecture across teams or domains
- 4+ years owning mission-critical runtimes or workflow/orchestration systems
- Deep expertise with durable execution (e.g., state machines, event sourcing, saga/compensation, idempotency, exactly/at-least-once semantics)
- Proven track record with security & governance in production systems (auth, RBAC, audit, policy)
- Hands-on with observability (Grafana or equivalent), including trace correlation across async boundaries
- Strong systems design across storage, queues, schedulers, and evented architectures; performance tuning under load
- Excellence in a modern language (e.g., Go, Rust, Java, or TypeScript) and cloud-native stacks (containers, CI/CD, IaC)
- Comfortable operating in regulated or high-assurance environments; bias toward correctness, clarity, and documentation
- Strong technical judgment and the ability to influence design decisions within a team and across closely related engineering areas
- Ability to incorporate advance LLM capabilities into system design and platform architecture decisions where appropriate
- Prior work on workflow engines (Temporal/Cadence/AWS Step Functions, Argo, Airflow) or serverless runtimes
- Experience with policy engines (OPA), secrets/KMS, or data-handling controls (PII/PHI)
- ML/LLM evaluation frameworks, tool/plugin architectures, or embedding model governance into execution
- Government or healthcare experience (HIPAA, audit readiness) and multi-tenant isolation
Benefits
- For full-time roles only: Career track opportunity with potential for rapid advancement with strong performance as the firm grows.
- For full-time roles only: 100% employer paid, comprehensive health care including medical, dental, and vision for you and your family.
- For full-time roles only: Paid maternity and paternity for 14 weeks at employees' normal pay.
- For full-time roles only: Unlimited PTO, with management approval.
- For full-time roles only: Opportunities for professional development and continued learning.
- For full-time roles only: Optional 401K, FSA, and equity incentives available.
- For full-time roles only: Mental health benefits are available through Tara Mind.
Company Overview
Company H1B Sponsorship