What are the responsibilities and job description for the Lead Data Engineer position at Steneral Consulting?
Client is looking ONLY onsite LOCAL to MA consultants for this position.
Health Care Domain Experience Is MUST.
Lead Data Engineer
Boston, MA
10 months
Must Have:
Health Care Domain Experience Is MUST.
Lead Data Engineer
Boston, MA
10 months
- Snowflake, AWS, Glue are the key skills
- Must have credible and verifiable experience on Snowflake and not just certification
- Health Care is big plus
Must Have:
- Resource with minimum 10 years of experience in DWH area who can work independently.
- Strong hands-on SQL skills/ Stored procedures / writing complex queries
- Good knowledge of Data warehousing and all related concepts0Hands on experience in Data Ingestion from different sources
- Candidate must be strong in SQL
- Must have 4 years of Relevant experience in working with Snowflake cloud data warehouse and exposure to AWS S3.
- Implementing SCD Techniques like slowly changing dimensions (type1, type2 and type3).
- Experience in working with AWS S3 and Snowflake cloud data warehouse.
- Good exposure in Snowflake Cloud Architecture and SnowSQL and SNOWPIPE for continuous data ingestion.
- Handling large and complex data sets like JSON, ORC, PARQUET, CSV files from various sources like AWS S3.
- Hands-on experience in bulk loading and unloading data into Snowflake tables.
- Experience in writing complex SQL scripts using Statistical Aggregate functions and Analytical functions to support ETL in snowflake cloud data warehouse.
- Experience with performance tuning of SnowFlake data warehouse with Query Profiler, Caching and Virtual data warehouse scaling
- Knowledge on redshift (Good to have)
- Knowledge on AWS EC2, lambda
- Good to have python
