Note: The job is a remote job and is open to candidates in USA. d-Matrix develops software and hardware innovations for generative AI and AI inference accelerators. The Principal Architect, Performance Analysis and Modeling role analyzes emerging ML workloads, builds analytical performance models, and develops architecture simulators to project hardware and software performance. The role collaborates across hardware design, compiler, inference server, kernels, and product teams to identify and implement HW/SW improvements.
Responsibilities
- Analyze emerging ML workloads, multi-modal LLMs, CoT reasoning models, and video/audio generation to identify performance-relevant properties
- Build and maintain analytical performance models that project behavior on current and future d-Matrix hardware generations
- Develop and extend architecture simulators to support performance analysis of proposed HW/SW features
- Partner with hardware design, compiler, inference server, kernel, and product teams to validate modeling assumptions and surface downstream implications
- Track relevant ML architecture and algorithms research and incorporate findings into modeling work
- Propose targeted HW/SW feature improvements based on modeling results and workload analysis
- Document modeling methodology and findings for reuse across the architecture team
Skills
- BSEE with 6+ years of industry experience, or MSEE with 4+ years of industry experience
- Working knowledge of computer architecture, HW/SW co-design, performance modeling, and ML fundamentals (particularly DNNs)
- Programming fluency in C/C++ or Python
- Experience building or working with analytical performance models or architecture simulators
- Self-motivated and collaborative, comfortable working across hardware and software teams
- Experience optimizing AI/ML workloads on accelerator technologies
- Research and investigation in AI/ML architecture/microarchitecture
Benefits
- Working onsite at our Santa Clara, CA, headquarters 3 days per week hybrid.
- Will consider remote in the United States.
Company Overview