Data Engineer II

Requisition Id 10087 

Overview: 

Oak Ridge National Laboratory is the largest US Department of Energy science and energy laboratory, conducting basic and applied research to deliver transformative solutions to compelling problems in energy and security.

Purpose:

The Information Technology Services Division in the Business Services Directorate at the Oak Ridge National Laboratory is seeking qualified applicants for a KDI Data Engineer.  The Knowledge Discovery Infrastructure (KDI) program serves to facilitate research activities on data that has been entrusted to ORNL by the U.S Department of Veteran’s Affairs (VA) and other agencies. As such, you will have the opportunity to work on some of the most challenging and impactful research and development programs in healthcare informatics, bioinformatics, and computer science.

This position will work with the sponsors and research users to deliver and maintain data pipelines including ETL and reporting workflows as well as data management and data lifecycles. As a Data Engineer, you should be comfortable several technologies including Linux, SQL, Python, containers, Pandas, Spark, and source control in a high security environment.

Major Duties/Responsibilities: 

• Develop high-scale, robust data warehouses, and data lakes with special focus on the state-of-the-art solutions for healthcare, life sciences, and genomics
• Interface with research teams to understand data needs, and provide subject matter expertise to research teams, and other team members about the data models, query optimizations, and schema interpretation
• Design, build, and launch new data/study marts for the major national research programs
• Design, build, and launch new data quality, data extraction, transformation and loading processes
• Design and develop architectures for intake, curation, organization, and dissemination of data in support of data science and related disciplines
• Design and develop high-performance database architectures
• Research and evaluate the state-of-the-art data and information management technologies
• Work on a variety of data assignments; collaborate with scientists and engineers, and expect to produce reliable data products and systems

Basic Qualifications:

• Bachelor’s degree in computer science, engineering, mathematics, or closely-related field.
• 2+ years of experience in database design and development.

Preferred Qualifications:

• M.S or Ph.D. degree in Computer Science, Information Systems, Engineering, or closely related field
• 5+ years of experience in basic and advanced SQL, database programming, and scripting languages (Python preferred)
• 5+ years of experience in data warehousing systems
• Strong knowledge of database system administration
• 5+ years of experience in data driven software development
• Demonstrated expertise with OLTP and data warehousing, SQL Server is preferred
• Experience in designing analytics data systems
• Experience working with Big Data processing frameworks such as Spark, Dask, and Pandas
• Familiarity with Big Data and NoSQL architectures
• Demonstrated experience with collecting, organizing, storing, and preparing data analysis
• Ability to conduct tasks independently and communicate effectively to team members and stakeholders
• Experience with heath care informatics is highly desired
• Working experience and basic understanding of AI/ML data requirements

Visa Sponsorship:

Visa sponsorship is not available for this position.

Q clearance:

This position requires the ability to obtain and maintain a clearance from the Department of Energy. As such, this position is a Workplace Substance Abuse (WSAP) testing designated position. WSAP positions require passing a pre-placement drug test and participation in an ongoing random drug testing program.

#LI-KC1

This position will remain open for a minimum of 5 days after which it will close when a qualified candidate is identified and/or hired.

We accept Word (.doc, .docx), Adobe (unsecured .pdf), Rich Text Format (.rtf), and HTML (.htm, .html) up to 5MB in size. Resumes from third party vendors will not be accepted; these resumes will be deleted and the candidates submitted will not be considered for employment.

If you have trouble applying for a position, please email ORNLRecruiting@ornl.gov.

ORNL is an equal opportunity employer. All qualified applicants, including individuals with disabilities and protected veterans, are encouraged to apply.  UT-Battelle is an E-Verify employer.