Data Engineer
Date: Mar 11, 2023
Location: Oak Ridge, TN, US, 37830
Company: Oak Ridge National Laboratory
Requisition Id 10086
Overview:
The Information Technology Services Division in the Business Services Directorate at the Oak Ridge National Laboratory is seeking qualified applicants for a KDI Data Engineer. The Knowledge Discovery Infrastructure (KDI) program serves to facilitate research activities on data that has been entrusted to ORNL by the U.S Department of Veteran’s Affairs (VA) and other agencies. As such, you will have the opportunity to work on some of the most challenging and impactful research and development programs in healthcare informatics, bioinformatics, and computer science.
This position will work with the sponsors and research users to deliver and maintain data pipelines including ETL and reporting workflows as well as data management and data lifecycles. As a Data Engineer, you should be comfortable several technologies including Linux, SQL, Python, containers, Pandas, Spark, and source control in a high security environment.
Major Duties/Responsibilities:
- Collaborating on high-scale, robust data warehouses, and data lakes with special focus on the state-of-the-art solutions for healthcare, life sciences, and genomics
- Collaborating with research teams to understand data needs, and providing subject matter expertise to research teams, and other team members about the data models, query optimizations, and schema interpretation
- Building and launching new data/study marts for the major national research programs
- Building and launching new data quality, data extraction, transformation and loading processes
- Collaborating on architectures for intake, curation, organization, and dissemination of data in support of data science and related disciplines
- Collaborating on the development of high-performance database architectures
- Researching and evaluating the state-of-the-art data and information management technologies
- Working on a variety of data assignments; collaborate with scientists and engineers and expect to produce reliable data products and systems
Basic Qualifications:
- B.S. in computer science, information systems, engineering, or closely-related field.
- Experience in database development or experience with building data driving applications.
Preferred Qualifications:
- Degree in Computer Science, Information Systems, Engineering, or closely related field.
- 2+ years of experience in basic and advanced SQL, database programming, and scripting languages (Python preferred).
- 2+ years of experience in data warehousing systems.
- Working knowledge of database system administration.
- Experience in data driven software development.
- Expertise with OLTP and data warehousing, SQL Server is preferred.
- Experience in designing analytics data systems.
- Experience working with Big Data processing frameworks such as Spark, Dask, and Pandas.
- Experience with relational SQL and programming languages such as Python.
- Familiarity with building data reporting and analytics.
- Familiarity with Big Data and NoSQL architectures and tools.
- Demonstrated experience with collecting, organizing, storing, and preparing data analysis.
- Ability to conduct tasks independently and communicate effectively to team members and stakeholders.
- Experience with heath care informatics preferred.
Visa Sponsorship:
Visa sponsorship is not available for this position.
Q clearance:
This position requires the ability to obtain and maintain a clearance from the Department of Energy. As such, this position is a Workplace Substance Abuse (WSAP) testing designated position. WSAP positions require passing a pre-placement drug test and participation in an ongoing random drug testing program.
#LI-KCP
This position will remain open for a minimum of 5 days after which it will close when a qualified candidate is identified and/or hired.
We accept Word (.doc, .docx), Adobe (unsecured .pdf), Rich Text Format (.rtf), and HTML (.htm, .html) up to 5MB in size. Resumes from third party vendors will not be accepted; these resumes will be deleted and the candidates submitted will not be considered for employment.
If you have trouble applying for a position, please email ORNLRecruiting@ornl.gov.
ORNL is an equal opportunity employer. All qualified applicants, including individuals with disabilities and protected veterans, are encouraged to apply. UT-Battelle is an E-Verify employer.
Nearest Major Market: Knoxville