Site Reliability Engineer, HPC Infrastructure and Platforms (Hybrid Eligible)

Date: Feb 25, 2024

Location: Oak Ridge, TN, US, 37830

Company: Oak Ridge National Laboratory

Requisition Id 11979 

Overview: 

The National Center for Computational Sciences (NCCS) at Oak Ridge National Lab (ORNL), which hosts several of the world’s most powerful computer systems, is seeking highly qualified individuals to play a key role in improving the security, performance, and reliability of the NCCS computing infrastructure which supports multiple highly ranked Top500 Supercomputers, including the first exaflop supercomputer, Frontier. 

 

The Team: 

As a Site Reliability Engineer, you will work within the HPC Infrastructure and Platforms group to support all activities of our supercomputer center. Our primary platform is the OLCF Slate Service, built on Kubernetes and Red Hat OpenShift, which provides a container orchestration service for running critical operation applications and user-managed persistent applications that run alongside our OLCF Supercomputer systems and other OLCF supported HPC clusters. 

 

Major Duties/Responsibilities: 

  • Improve reliability, scalability and quality of our Kubernetes and Linux based applications and services. 

  • Define and implement define critical metrics, processes and drive continuous improvement. 

  • Capture and analyze metrics to assist in tuning operating systems and applications. 

  • Diagnose system operational problems quickly and effectively. 

  • Participate in on-call rotation providing 24-hour, 7-day support and off-hours maintenance windows. 

  • Coordinate with vendors to resolve hardware and software problems. 

  • Deliver ORNL’s mission by aligning behaviors, priorities, and interactions with our core values of Impact, Integrity, Teamwork, Safety, and Service. Promote diversity, equity, inclusion, and accessibility by fostering a respectful workplace – in how we treat one another, work together, and measure success. 

 

Basic Qualifications: 

Bachelor’s Degree in computer science or closely related field and a minimum of 5 years of experience as an SRE/Systems Engineer. An equivalent combination of education and experience may be considered. 

 

Preferred Qualifications: 

  • Excellent interpersonal/communication skills, and the ability to work as part of a team. 

  • Strong working knowledge of Unix system fundamentals and common network protocols. 

  • Experience managing Linux/UNIX operating systems in a heterogeneous environment. 

  • Proven understanding of networked computing environment concepts. 

  • Ability to develop and maintain programs and scripts that aid in the operation and automation using various shell (primarily bash) and high-level languages (Python or Go). 

  • Ability to proactively identify performance issues, problems, and areas for improvement. 

  • Experience with continuous integration and continuous deployment software methodologies and how they apply to SRE/systems engineering. 

  • Understanding of code review and familiarity with tools like GitHub and GitLab 

  • Experience using tools such as Nagios, Grafana and Prometheus to monitor systems, metrics, and create dashboards. 

  • Experience implementing systems/services using virtual machines and Kubernetes resources. 

  • Experience deploying and maintaining automated configuration management software such as Puppet or Ansible 

  • Experience implementing systems-level security technologies like SELinux and following best security practices. 

 

Special Requirement: 

This position requires the ability to obtain and maintain a clearance from the Department of Energy. As such, this position is a Workplace Substance Abuse program (WSAP) testing designed position which requires passing a pre-placement drug test and participation in an ongoing random drug testing program in which employees are subject to being randomly selected for testing. The occupant of this position will also be subject to an ongoing requirement to report to ORNL any drug-related arrest or conviction or receipt of a positive drug test result. 

 

#LI-KC1 

 

This position will remain open for a minimum of 5 days after which it will close when a qualified candidate is identified and/or hired.

We accept Word (.doc, .docx), Adobe (unsecured .pdf), Rich Text Format (.rtf), and HTML (.htm, .html) up to 5MB in size. Resumes from third party vendors will not be accepted; these resumes will be deleted and the candidates submitted will not be considered for employment.


If you have trouble applying for a position, please email ORNLRecruiting@ornl.gov.


ORNL is an equal opportunity employer. All qualified applicants, including individuals with disabilities and protected veterans, are encouraged to apply.  UT-Battelle is an E-Verify employer.


Nearest Major Market: Knoxville