Site Reliability Engineer - AI Cloud

Job Req ID: 26861

About Supermicro:

Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.
 

Job Summary:

As a Cloud Reliability Engineer for our Linux-based AI cloud platforms, you will help us deploy, scale, and ensure high availability, performance, scalability, and security across GPU-accelerated compute clusters, Kubernetes workloads, and supporting storage/network infrastructure. You’ll bridge Dev and Ops by automating infrastructure deployment, enhancing observability, and applying SRE best practices to support reliable AI and MLOps environments.

Essential Duties and Responsibilities:

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field—or equivalent experience and 8 years of experience in the areas below
• Proficiency in Linux (Ubuntu, RHEL/CentOS), containers (Docker, Podman), and orchestration (Kubernetes).
• Experience managing GPU compute clusters (NVIDIA / CUDA, AMD / ROCm)
• Hands-on experience with observability tools (Prometheus, Grafana, Loki, ELK, etc.).
• Strong scripting and coding skills (Bash, Python, or Go).
• Exposure to secure multi-tenant environments and zero trust architectures.
• Familiarity with network protocols, DNS, DHCP, BGP, ROCEv2, and InfiniBand or high-throughput Ethernet fabrics.
• Excellent collaboration and communication skills for cross-team, partner, and customer initiatives

Preferred Qualifications:

• Understanding of AI/ML reference architectures and experience with workflows, MLFlow, or Kubeflow.
• Familiarity with storage backends optimized for AI (CephFS, BeeGFS, WekaFS).
• Prior experience in bare-metal provisioning via PXE, Ironic, or Foreman.
• Understanding of NVIDIA GPU telemetry and NCCL testing for performance benchmarking.
• Familiarity with ITIL processes or structured change management in production systems is a plus.
• Certifications: CKA, CKAD, Linux+, or related credentials.

Salary Range

 $145,000 - $165,000

The salary offered will depend on several factors, including your location, level, education, training, specific skills, years of experience, and comparison to other employees already in this role. In addition to a comprehensive benefits package, candidates may be eligible for other forms of compensation, such as participation in bonus and equity award programs.

EEO Statement

Supermicro is an Equal Opportunity Employer and embraces diversity in our employee population. It is the policy of Supermicro to provide equal opportunity to all qualified applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status or special disabled veteran, marital status, pregnancy, genetic information, or any other legally protected status.