Note: The job is a remote job and is open to candidates in USA. d-Matrix focuses on software and hardware innovation for generative AI and AI inference accelerators. The Principal Software Engineer will analyze and model performance across the hardware/software boundary, develop analytical models and architecture simulators, and identify hardware/software improvements for current and future AI accelerator architectures.
Responsibilities
- Analyze emerging ML workloads, multi-modal LLMs, CoT reasoning models, and video/audio generation to identify performance-relevant properties
- Build and maintain analytical performance models that project behavior on current and future d-Matrix hardware generations
- Develop and extend architecture simulators to support performance analysis of proposed HW/SW features
- Partner with hardware design, compiler, inference server, kernel, and product teams to validate modeling assumptions and surface downstream implications
- Track relevant ML architecture and algorithms research and incorporate findings into modeling work
- Propose targeted HW/SW feature improvements based on modeling results and workload analysis
- Document modeling methodology and findings for reuse across the architecture team
Skills
- BSEE with 6+ years of industry experience, or MSEE with 4+ years of industry experience
- Working knowledge of computer architecture, HW/SW co-design, performance modeling, and ML fundamentals (particularly DNNs)
- Programming fluency in C/C++ or Python
- Experience building or working with analytical performance models or architecture simulators
- Self-motivated and collaborative, comfortable working across hardware and software teams
- Experience optimizing AI/ML workloads on accelerator technologies
- Research and investigation in AI/ML architecture/microarchitecture
Benefits
- Hybrid work arrangement: working onsite at the Santa Clara, CA headquarters 3 days per week; remote work in the United States will be considered.
Company Overview
Company H1B Sponsorship