Share this Job

Scalable Data Engineer - Associate Level

Date: May 12, 2022

Location: Oak Ridge, TN, US, 37831

Company: Oak Ridge National Laboratory

Requisition Id 8256 

Position Level: TP02

 

Overview

 

The Data Lifecycle and Scalable Workflows Group at Oak Ridge National Laboratory is seeking a self-motivated and creative engineer who can develop software, tools and infrastructure to support handling of data assets at ORNL.  The Oak Ridge National Laboratory (ORNL) operates several simulation and experimental facilities such as the Oak Ridge Leadership Computing Facility (OLCF), Spallation Neutron Source (SNS), Center for Nanophase Materials (CNMS), Building Technology Research and Integration Center (BTRIC), and several others, that produce large volumes of data. There is an immediate need to support scientists in managing data throughout its lifecycle.  We are seeking a software developer/engineer who has a passion for developing and deploying data solutions across heterogeneous platforms across different facilities.

This position is part of the Advanced Technologies Section within the National Center for Computational Sciences (NCCS) Division.  The NCCS provides state-of-the-art computational and data science infrastructure, coupled with dedicated technical and scientific professionals, to accelerate scientific discovery and engineering advances across a broad range of disciplines. NCCS hosts the Oak Ridge Leadership Computing Facility, one of DOE’s National User Facilities. NCCS will deploy an exascale system in 2021.

 

Job Duties and Responsibilities

 

  • Participate in the planning, designing, implementation, and testing of new software capabilities for a distributed scientific data management system supporting cutting-edge cross-facility data-oriented science.
  • Develop software applications/utilities, data pipelines, and/or workflows to interface ORNL experimental facilities with NCCS compute and analytics resources.
  • Develop, deploy, and maintain data services/infrastructure on NCCS analytics resources (Scalable HPC, OpenStack, OpenShift).
  • Develop data storage and management solutions for domain scientists. Specifically, use or develop software to transfer 100s of GB robustly and routinely to 10s of TB of data from multiple computers attached to scientific instrumentation to scalable data storage facilities.
  • Document all the developed software and workflows for reproducibility.
  • Assist users of developed software in using the software, debugging problems.

 

Basic Requirements

 

  • A minimum of a bachelor’s degree in Computer Science, Computer Engineering, or related field.
  • 2+ years’ experience in developing and maintaining complex software and services written in multiple programming languages.
  • Experience with languages: Ruby, Python, JavaScript, etc.
  • Experience with web development: HTML, CSS, JavaScript.
  • Experience with database programming such as PostgreSQL, Lucene, SOLR, MySQL, NoSQL.
  • Experience in developing software for Linux / Unix operating systems or developing cross-platform software.
  • Experience using version control systems, project/issue tracking systems, and continuous integration services.

 

Preferred Qualifications

 

  • Master’s degree in Electrical/Computer Engineering, Computer Science, or related field, or Bachelor’s degree and 1+ year of industry experience.
  • Experience with full-text search platforms: Lucene, SOLR, ElasticSearch, etc.
  • Experience in software artifacts for deployment for web applications and relevant technologies: containerization (i.e., Docker, Podman, Kubernetes, Nomad, etc.), virtual images (i.e., Vagrant, Packer, etc.).
  • Experience with configuration management technologies and/or infrastructure-as-code provisioning tools: Puppet, Capistrano, Ansible, Chef, Terraform, etc.
  • Experience with large-scale data transfer technologies such as Globus or others.
  • Experience with distributed databases and graph/multi-model databases such as ArangoDB, MongoDB, H-Base, Cassandra, etc.
  • Experience with web frameworks such as Ruby on Rails or Django.
  • Experience with message-oriented technologies such as ZeroMQ, RabbitMQ, Protocol Buffers, etc.
  • Strong understanding of software development methodologies, best practices, and object-oriented design.
  • Experience with microservice architectures and software containers.
  • Experience developing graphical web applications using HTML5/CSS/JS or web development frameworks.
  • Strong experience in developing and deploying software on a variety of environments ranging from cloud to high-performance computing.
  • Strong verbal and written skills.
  • Self-motivated person with the ability to manage multiple projects and stay on schedule, work with multiple people in a team in a collaborative manner.

 

#LI=KC1

 

This position will remain open for a minimum of 5 days after which it will close when a qualified candidate is identified and/or hired.

We accept Word (.doc, .docx), Adobe (unsecured .pdf), Rich Text Format (.rtf), and HTML (.htm, .html) up to 5MB in size. Resumes from third party vendors will not be accepted; these resumes will be deleted and the candidates submitted will not be considered for employment.


If you have trouble applying for a position, please email ORNLRecruiting@ornl.gov.


ORNL is an equal opportunity employer. All qualified applicants, including individuals with disabilities and protected veterans, are encouraged to apply.  UT-Battelle is an E-Verify employer.


Nearest Major Market: Knoxville