What are the responsibilities and job description for the AWS Data Lakehouse Consultant position at Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Tri-Force Consulting Services Inc, is seeking the following. Apply via Dice today!
Title: AWS Data Lake Architect
Location: Waterbury Village Historic District, VT 05676
Client: The Vermont Department of Public Safety
Note: This is an onsite position day 1 onsite
Job Description :
Environment
Title: AWS Data Lake Architect
Location: Waterbury Village Historic District, VT 05676
Client: The Vermont Department of Public Safety
Note: This is an onsite position day 1 onsite
Job Description :
- The Vermont Department of Public Safety (DPS) is seeking to improve statewide law enforcement data access.
- The purpose is to design and implement a state-controlled system to access de-identified, aggregated law enforcement and related data currently housed in a record management system.
- DPS, in collaboration with the Vermont Agency of Digital (ADS) Services, is seeking to procure Amazon Web Service (AWS) professional services to work with the ADS Technical Lead to build out the Public Services Lake house environment.
Environment
- Store Data in AWS CJIS compliant environment.
- Implement and design the lake house technologies with the IT Tech Lead assigned to the project.
- Design and implement using latest AWS Lake House standards.
- Data Security Layer
- Implement and design security Identity and Access Management roles and processes.
- Design and Create security IAM templates.
- Data Ingestion Layer
- Ingestion Design for variety of sources
- Operational Database Sources
- MySQL, SQL Server
- SaaS Applications
- File Shares (SharePoint and one drive)
- Stream Data Sources
- System Templates of ingestion processes Data Storage Layer
- AWS S3 CJIS compliant S3 buckets
- AWS Redshift Infrastructure
- Power BI Connector process Data Processing Layer
- Data Extract, Load and Transform (ELT) process for loading from source to S3 and Transforming data from S3 to Redshift for reporting and analytics.
- Templates for creating ELT processes for future processes.
- Design and implement solution to solve data schema drift in AWS Glue for use with reporting and analytical needs.
- Design and build crawlers for schema and build catalog that stores schema information.
- Meta data store in catalog for consumption in data warehouse
- Create Catalog crawler templates for data sources
- AWS Lake house Certification
- AWS Design and Implementation Lake House Technologies
- AWS IAM
- AWS Lake house Technology
- AWS Glue Knowledge
- Data Catalog and Crawler
- AWS Redshift
- AWS Athena
- CJIS certified data storage
- AWS CJIS Data location
- CJIS Security Background Check (See Additional Attachments / Assurances)
SAP Master Data Governance Consultant, Director
PRICE WATERHOUSE COOPERS -
Montpelier, VT
Consultant
Rizing -
Burlington, VT
Consultant
Stratford Davis Staffing LLC -
South Burlington, VT