Share this Job

Senior Data Platform Engineer

Date: Jul 17, 2021

Location: Oak Ridge, TN, US, 37830

Company: Oak Ridge National Laboratory

Requisition Id 5889 

Purpose

The National Center for Computational Sciences (NCCS) at the Oak Ridge National Laboratory (ORNL) is seeking highly qualified individuals to play a key role in improving the security, performance, and reliability of the NCCS computing infrastructure.  The NCCS is a leadership computing facility providing high performance computing resources for tackling scientific grand challenges.

The Team

The Analytics and Monitoring team is one half of the NCCS Security and Information Engineering Group, and is tasked with architecting, developing, deploying, and maintaining operationally stable data pipelines.  These pipelines carry vitally important telemetry, log, and metrics information in real time from the worlds fastest supercomputers to expose the inner workings of these scientific instruments for operational, strategic, and scientific decision making.  We operate Kafka and Elasticsearch based applications on top of a Kubernetes platform and work with both data consumers and producers to streamline their data needs.

Come help us centralize an immutable stream of facts and decentralize the freedom to act, adapt, and change within our organization.

About You

We are looking for an experienced systems engineer who can code and focus on customer success.  You deploy infrastructure as code because automation lets you focus on the more difficult and rewarding problems.  You love collaboration with others and coming up with the best solution to the problem.  You enjoy and can pick up new technology quickly and notice the common design patterns in the tools that you use.  You probably have production experience with Elasticsearch or Apache Kafka.  You may have a GitHub account with cool projects.  You may have technical leadership experience.

 

Major Duties and Responsibilities:

As a Data Platform Engineer you will be responsible for:

  • Developing high-scale streaming message platforms with an operational focus
  • Providing systems administration staff and other data owners with the tools and knowledge to successfully extract necessary data from systems
  • Interfacing with research teams to understand data needs, and providing subject matter expertise to research teams and other team members about the data models, query optimizations, and schema interpretation
  • Designing and developing architectures for intake, curation, organization, and dissemination of data in support of data science and related disciplines
  • Participating in a 7-day 24-hour oncall rotation
  • Documenting data dictionaries, schemas, and paths and maintaining a catalog of available data sources

 

Basic Qualifications:

  • B.S. in Computer Science, Information Systems, Engineering, or closely related field.
  • 8+ years of experience with data-oriented technologies.

 

Preferred Qualifications:

  • Previous experience with data-oriented technologies such as SQL/NoSQL Databases, Kafka, Apache Spark, Hadoop, Telegraf, ELK Stack, Splunk, RabbitMQ, Syslog
  • 8+ years of experience administering linux-based systems or container-based applications
  • Previous experience with programming/scripting languages (Python Preferred)
  • Experience in data warehousing systems and database system administration
  • Experience with highly performant filesystems such as Lustre/GPFS/Hadoop and block storage
  • Experience in designing analytics data systems
  • Demonstrated experience with collecting, organizing, storing, and preparing data analysis
  • Experience working with containers and orchestration technologies such as Docker, Singularity, Docker Swarm, and Kubernetes
  • Ability to conduct tasks independently and communicate effectively to team members and stakeholders

 

Special Requirements

 This position requires the ability to obtain and maintain a clearance from the Department of Energy. As such, this position is a Workplace Substance Abuse (WSAP) testing designated position. WSAP positions require passing a pre-placement drug test and participation in an ongoing random drug testing program.

 

Relocation:  Moving can be overwhelming and expensive. UT-Battelle offers a generous relocation package to ease the transition process. Domestic and international relocation assistance is available for certain positions. If invited to interview, be sure to ask your Recruiter (Talent Acquisition Partner) for details.
 
For more information about our benefits, working here, and living here, visit the “About” tab at jobs.ornl.gov.

 

This position will remain open for a minimum of 5 days after which it will close when a qualified candidate is identified and/or hired.

We accept Word (.doc, .docx), Adobe (unsecured .pdf), Rich Text Format (.rtf), and HTML (.htm, .html) up to 5MB in size. Resumes from third party vendors will not be accepted; these resumes will be deleted and the candidates submitted will not be considered for employment.


If you have trouble applying for a position, please email ORNLRecruiting@ornl.gov.


ORNL is an equal opportunity employer. All qualified applicants, including individuals with disabilities and protected veterans, are encouraged to apply.  UT-Battelle is an E-Verify employer.


Nearest Major Market: Knoxville