d-Matrix
d-Matrix
d-Matrix develops datacenter AI inference technology designed to improve compute efficiency through in-memory computing. Founded in 2019, the company combines custom circuit design, machine learning tools, software, algorithms, and chiplet-scale interconnects to address the challenge of integrating memory and computation for modern artificial intelligence workloads.

Director of Site Reliability Engineering, AI Infrastructure — d-Matrix, Santa Clara Hybrid

Lead d-Matrix’s SRE organization for generative AI inference infrastructure. Own reliability, observability, automation, storage, and hybrid cloud and on-premises operations.

Description

  • Establish and lead d-Matrix’s Site Reliability Engineering organization.
  • Create the SRE charter and embed reliability practices across hardware and software engineering.
  • Recruit, develop, and retain a team of one to three SRE engineers.
  • Manage the Data Center and Lab Technician team while setting operational priorities and standards.
  • Own 24/7 reliability across colocation facilities, on-premises lab clusters, cloud environments, and customer-facing platform services.
  • Design resilient systems around failure domains, progressive delivery, and disciplined change control.
  • Define service-level indicators, service-level objectives, and error budgets.
  • Create on-call processes, including a follow-the-sun model as global operations expand.
  • Develop incident response and root-cause analysis frameworks.
  • Lead observability for metrics, traces, and logs.
  • Advance Terraform- and Ansible-based automation, including self-healing infrastructure.
  • Implement host lifecycle automation, fleet remediation, and AIOps-enabled alerting.
  • Manage FinOps and capacity planning across cloud, colocation, and on-premises environments.
  • Lead the transition from ad hoc JBOD storage to enterprise shared storage across on-premises, colocation, and cloud environments.
  • Collaborate with Software Tools, QA DevOps, Engineering, Networking Operations, and IT Operations to improve reliability, cost efficiency, and technical debt management.

Requirements

  • Bachelor’s or master’s degree in computer science, electrical engineering, or a related discipline.
  • At least 15 years of experience in SRE, infrastructure engineering, or production engineering.
  • At least five years of experience leading SRE or infrastructure engineering teams.
  • Experience creating or substantially rebuilding an SRE or infrastructure engineering function.
  • Experience defining SLOs, building on-call programs, implementing observability, and leading organizational change.
  • Advanced expertise with Linux systems.
  • Experience with enterprise shared storage, including NAS/SAN, large-scale NFS/SMB, snapshot and replication architectures, and hybrid-cloud storage integration.
  • Experience operating colocation facilities and on-premises hardware at scale.
  • Understanding of server lifecycle management, power and cooling systems, and rack-level networking.
  • Production experience with Terraform and Ansible, including module design, remote state, environment isolation, and change governance.
  • Experience operating Kubernetes clusters, including lifecycle management, workload reliability, storage, and large-scale RBAC.
  • Experience owning observability platforms such as Prometheus, Grafana, Datadog, or Splunk.
  • Strong Python or Go scripting skills for production services and infrastructure automation.
  • Strong executive communication abilities.
  • Ability to work effectively in a high-ambiguity, low-process environment.
  • Experience running customer-facing infrastructure or platform services is preferred.
  • Knowledge of InfiniBand, RoCE, or NVLink is preferred.
  • Experience with HPC schedulers such as Slurm, LSF, or equivalent is preferred.
  • Experience with hybrid, multi-cloud operations across AWS, Azure, and GCP is preferred.
  • FinOps expertise is preferred.
  • Knowledge of ITIL or an equivalent incident, problem, and change management framework is preferred.
  • Published technical writing, conference presentations, or open-source contributions are preferred.
  • Must be legally authorized to work in the United States.

Benefits

  • Equity compensation.
  • Bonus or incentive opportunities tied to individual and company performance.
  • Medical insurance.
  • Dental insurance.
  • Vision insurance.
  • 401(k) plan.
  • Inclusive rewards program focused on the wellbeing of employees and their loved ones.

Related Jobs

SUSE

East Coast Solution Architect, Enterprise Linux and Kubernetes

SUSE

Advise East Coast customers on SUSE’s enterprise Linux, Kubernetes, and open-source infrastructure solutions. Support technical sales with solution design, demonstrations, and proofs of concept.

Open