Note: The job is a remote job and is open to candidates in USA. Fusemachines is a global provider of enterprise AI products and services, on a mission to democratize AI. They are seeking a Senior Software Engineer to build and operate high-performance backend services using Java, collaborating with various teams to deliver reliable production solutions.
Responsibilities
- Design, build, test, and maintain scalable backend services using Java
- Develop APIs, microservices, and event-driven components for high-volume production systems
- Apply established Java architecture patterns, coding standards, and engineering best practices
- Integrate backend applications with machine learning models, inference endpoints, and feature stores
- Design reliable model-calling workflows with appropriate timeouts, retries, validation, and fallback behavior
- Build highly available, low-latency services that meet defined SLAs and service-level objectives
- Monitor and optimize latency, throughput, availability, resource utilization, and error rates
- Implement resilience patterns such as caching, circuit breakers, rate limiting, and graceful degradation
- Develop unit, integration, contract, performance, and end-to-end tests
- Implement logging, metrics, dashboards, distributed tracing, and actionable alerts
- Use platforms such as Datadog or similar tools to monitor systems and investigate production issues
- Participate in incident response, root-cause analysis, and reliability improvements
- Use AI-assisted coding tools responsibly to support development, testing, documentation, and debugging
- Participate in architecture discussions, technical design reviews, and code reviews
- Communicate technical decisions, risks, dependencies, and tradeoffs clearly to technical and nontechnical stakeholders
- Promote strong software engineering practices across the team
Skills
- Strong professional experience developing production applications with Java
- Experience designing backend services, APIs, microservices, or distributed systems
- Strong understanding of Java design patterns, object-oriented programming, and software architecture
- Experience building systems with demanding availability, scalability, throughput, or latency requirements
- Experience with automated testing and continuous integration and delivery practices
- Experience with relational or non-relational databases
- Experience implementing production logging, monitoring, metrics, tracing, and alerting
- Familiarity with Datadog, OpenTelemetry, Grafana, Prometheus, New Relic, or comparable platforms
- Understanding of SLAs, service-level indicators, service-level objectives, and production reliability
- Familiarity with cloud platforms, containers, and modern deployment environments
- Basic understanding of machine learning concepts and how applications interact with deployed models
- Strong troubleshooting, problem-solving, and production support skills
- Excellent written and verbal communication skills
- Experience integrating applications with machine learning inference services or feature stores
- Experience with low-latency or real-time decisioning systems
- Experience with Kafka, message queues, streaming platforms, or event-driven architectures
- Experience with Kubernetes, Redis, distributed caching, or performance testing
- Familiarity with model versioning, feature freshness, prediction logging, and controlled model rollouts
- Experience in advertising technology, digital marketplaces, auction systems, recommendation systems, or personalization
- Experience using AI-assisted development tools such as GitHub Copilot, Claude Code, or Cursor
Benefits
- Type: Full-Time, Remote
Company Overview
Company H1B Sponsorship