Note: The job is a remote job and is open to candidates in USA. Technology Partners is currently seeking a talented Data Engineer. The role involves creating scalable analysis solutions and developing Go services and APIs that support AI agents and end-users, while collaborating with cross-disciplinary teams to solve complex problems.
Responsibilities
- Develop and maintain distributed data analysis capabilities across multiple datasets
- Build scalable Go-based services and APIs for AI agents and human users
- Define and implement protocols for autonomous agent discovery, authentication, and task handoff
- Apply best practices in software engineering, including writing efficient algorithms and data structures
- Collaborate with cross-disciplinary teams on complex problem solving and system design
- Explore and evaluate new technology stacks to improve data processing workflows
- Contribute to the documentation of systems, processes, and best practices
- Support deployment, monitoring, and maintenance of cloud-based infrastructure
Skills
- 5+ years of professional experience in software engineering
- 2+ years of experience with Go programming language
- Proven track record of building and maintaining data-intensive APIs using RESTful approaches
- Hands-on experience with stream processing using Apache Kafka
- Proficiency with unit testing and test-driven development methodologies
- Familiarity with containerized applications and deployment using Docker
- Experience designing and maintaining cloud infrastructure on platforms like AWS, Azure, or Google Cloud Platform
- Knowledge of data modeling for large-scale relational or NoSQL databases
- High School Diploma or equivalent and a valid Driver's License
- Experience with protocol buffers and gRPC
- Experience in building services for large language model (LLM)-based agents, including tool calling and agent-to-agent communication
- Familiarity with Google Cloud's AI offerings, such as Vertex AI, Agent Engine, or ADK
- Knowledge of Google Cloud Dataflow, Google Kubernetes Engine, or Kubernetes
- Background working with scientific datasets, bioinformatics, or high-volume variant data analysis
Company Overview