Snowflake Data Engineer

Role: Senior Data Engineer (MS SQL, T-SQL, SSIS, Snowflake, Python)

Location: NYC (3 Days Hybrid)

Experience: 10 Years

Job Description:

Must have hands-on: MS SQL, T-SQL, SSIS, Snowflake, Python

Primary Responsibilities:

• Candidate must have 6 or more years of experience working on services S3, Lambda, Airflow (MWAA), Secrets Manager, Cloud Watch Exp. on other services such as AWS, IAM, Cloud Formation, CI\CD etc. is preferable.
• Snowflake or SQL expertise - 4 or more years of experience working on Data Ingestion/Transformation/Loading. Strong understanding of relational database concepts & technology data modeling (dimensional/snowflake), SQL, query optimization, data warehouse architecture.
• Strong understanding on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
• Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
• Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
• Developing EL pipelines in and out of data warehouse using combination of Data bricks, Python and Snow SQL.
• Developing scripts UNIX, Python etc. to Extract, Load and Transform data, and T-SQL as well as other utility functions.
• Provide production support for Data Warehouse issues such data load problems, transformation translation problems
• Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
• Understanding data pipelines and modern ways of automating data pipeline using cloud based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
• Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Basic Qualifications:

• Minimum 8 years of designing and implementing an operational production grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
• Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL, MS SQL and T-SQL.
• Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies.
• Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.

Good to Have:

• Experience in Finance / Banking industry some understanding of Securities and Banking products