What are the responsibilities and job description for the Data Lake Architect/Engineer position at Aveshka, Inc.?
Overview
Aveshka’s Technology Service Division is looking for a Data Lake Architect/Engineer to join our federal technology services practice. In this role, you will work in support of the USSS Enterprise Data Management organization to meet all the requirements of data services at the US Secret Service (USSS) who seeks to maintain and facilitate the implementation of existing strategies for enterprise level data services and continued support of the current database infrastructure and environments. In this role, you will provide capabilities to support the current Data Lake architecture that is utilizing container virtualization of various micro services and support an enterprise level ETL solution that consolidates data from many different data sources into an operational data store, data warehouse or data lake. The United States Secret Service (USSS), Office of the Chief Information Officer, Software Solutions Program is responsible for building and maintaining custom application projects, databases and reporting capabilities. The Software Solutions program builds custom software using the latest technologies from Microsoft, Oracle, Tableau, IBM Cognos, Data Warehouse and ESRI Geographic Information System (GIS). The program often utilizes contract driven resources to assist in its development, maintenance, and support efforts in the areas of Application Services, GIS, and Data Services.
The senior level data lake architect shall provide the technology roadmap for enabling and supporting a concrete enterprise data lake strategy. This resource will be responsible for documenting the data lake architectural model and views that show how the current and future needs of the organization will be met with a successfully design data lake solution.
Responsibilities
- Provides all activities related to the administration of data lake servers.
- Must be able to manage, build, administer, develop, test or demonstrate the capabilities of the data lake environment.
- Be able to perform many data lake administrative functions across multiple servers that uses the Microservices Architecture.
- Must be able to define standards and techniques to guide architecture solution decisions for microservices architecture.
- Provide a resource that will support a large Micro Services clustered environment with experience in adding and removing nodes, configure and tune the clusters and monitor the environment
- Provide data lake solutions that are built for performance, fault tolerance and security to ensure quality data is being ingested and utilized
- Must have extensive Python experience and capabilities to create Bash/shell scripts
- Provide senior level knowledge to support Solr, Apache Spark, Minio, Docker, Kubernetes, MySQL, Redis, Presto, Prometheus, React, and Nginx
- Resource must be able to support the current implementation and ongoing future enhancements to data lake infrastructure.
- Provide the ability to administer the data lake infrastructure utilizing Red Hat Linux and be able to perform the following:
- Security setup
- Configuration changes
- Tuning
- Troubleshooting
- Monitoring
Qualifications
Required Education:
- Bachelor’s degree Computer Science, Management Information Systems, or related discipline
Required Experience:
- Commensurate experience and education for the specific level
- 10 years providing technical and data management services
- Experience with Data Lake architecture, microservices, container virtualization
- Python, Solr, Apache Spark, Minio, Docker, Kubernetes, MySQL, Redis, Presto, Prometheus, React, and Nginx
- Red Hat Linux environment
- Active listening skills and flexibility in adapting to feedback from team members
- Following through on multiple tasks simultaneously to achieve deadlines
- Attention to detail, ability to self-manage, and maintain high quality
- Excellent written and verbal communication skills
- US Citizenship
Required Clearance:
- Must be eligible for a security clearance
About Aveshka:
Aveshka is a professional services firm focused on addressing our nation’s most complex threats and challenges. As a small business we’re committed to supporting our clients’ missions with services delivered by our diverse and experienced staff. With expertise in cybersecurity, emergency preparedness, and public health, our experience base spans federal, state, and local governments, as well as private sector entities.
Aveshka encourages collaborative communication and ongoing learning. Some of our benefits include:
- Extensive training programs
- Gym membership reimbursement
- Education reimbursement
- Technology benefits
- Commuter benefits
- Generous paid time off and much more!
Aveshka is an Equal Opportunity Employer (EOE)