What are the responsibilities and job description for the ETL Developer position at J5 Consulting?
J5 Consulting is a Maryland based company established in 2006 to provide computing and consulting services for government and commercial entities. Our services improve Information System networking performance and compliance and protect electronic assets from loss and compromise. We welcome your application to receive consideration for the following position.
Job Overview:
The customer is an IT-oriented office that supports analysts through the provision of large datasets, methodologies, and data visualizations to help address pressing intelligence questions. The customer seeks to ingest, clean, store, and analyze relevant data while improving and expanding its data infrastructure. The customer needs experienced support in data ingestion, data management, and application development. The work includes engaging regularly with data scientists, analysts, and managers.
- Load large datasets into customer’s on-premise and Cloud environments.
- Develop ingestion algorithms and schemas for large datasets.
- Aanalyze new datasets to optimize the data ingest processes;
- Support the creation of NiFi schemas for new data loads
- Develop software tools that efficiently preprocess, modify, aggregate, load, index, and archive large data collections into clusters in near real-time;
- Generate metrics to track data ingest statistics to maintain data integrity
- Document the data-flows according to standards set by customer.
Required skills and demonstrated experience:
- Demonstrated professional experience in Computer Science, Computer Engineering, Systems Engineering, or closely related discipline.
- Demonstrated professional experience with cloud services and tools, such as Databricks and EMR.
- Demonstrated experience understanding of SQL database structures and mapping them between different SQL databases.
- Demonstrated professional experience working with Nifi, and and Extract-Transform-Load processes.
- Demonstrated experience creating operating system level scripts to perform ETL operations on SQL databases.
- Demonstrated professional experience with version control systems, preferably Git.
- Demonstrated experience testing the development of software solutions for the extraction, transacting, and loading of data using the most efficient languages for the task, e.g. Nifi, Python, and SQL.
Highly desired, though not required, include:
- Demonstrated familiarity with the Sponsor’s data environment.
- Demonstrated experience organizing and structuring solutions to complex problems.
- Demonstrated strong coordination and collaboration skills.
__________________________________________________________________________________
US Citizenship:
- This position requires US Citizenship. Verification of US Citizenship to meet federal government security requirements will be confirmed.
Security Clearance:
- The successful candidate must have an active U.S. Government Top Secret Security Clearance with a Full Scope Polygraph.
- Clearance Verification: This position requires successful verification of the stated security clearance to meet federal government customer requirements. You will be asked to provide clearance verification information prior to an offer of employment.
Travel:
- Local travel/POV will be on an as needed basis, within the local place of performance.
- The position will be located within the Washington Metropolitan Area (WMA).
J5 Consulting offers excellent benefits and compensation packages. We are an Equal Opportunity Employer committed to providing fair and equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, pregnancy, sexual orientation, national origin, age, disability, genetic information, veteran or military status, or any other characteristic protected by applicable laws.