What are the responsibilities and job description for the Azure Data Engineer position at Next Gen IT Inc?
Job Details
Role: Azure Data Engineer
Hybrid: 2x week (Chicago, IL Downers Grove)
Rate: $80 max
Exp: 12 yrs
Non-Visa Candidates (No Employer)
Only W2 or Own Corporation
Relocation will also work
Top Skills
Azure
ADF
Databricks
PowerBI
SQL
Python
DevOps
Job Description
National Express is currently seeking an experienced Data Engineer to join our development team. The right person will have proven Specialization in Data Engineering following Medallion Data Architecture Principles and experience in building/supporting large data structures.
Design and build data processing pipelines using tools and frameworks in the Databricks/Azure ecosystem using ADLS.
Design, develop, optimize, and maintain data pipelines, storage, and compute components using Azure Services.
Understand the Data Platforms & Services strategy, and information architecture, and help build modern data lakes and maintain high standards of data quality and integrity.
Design and build ETL pipelines to automate structured and unstructured data ingestion.
Analyzes requirements and architecture specifications to create a detailed design document. - Responsible for data engineering functions including, but not limited to data extraction, transformation, loading, and integration in support of modern cloud computing platforms like Azure and Databricks.
Work with DevOps engineers on CI/CD processes; perform code reviews and develop processes for improving code quality.
Strong in scalability, performance, and availability of our systems.
Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
Assist in the evaluation, implementation, and deployment of emerging tools to modernize the data platform.
Partner with analysts and architects to support technical architectures for data engineering projects.
In-depth experience using SQL Server DB for ETL processes
Design and build data processing pipelines using tools and frameworks in the Databricks/Azure ecosystem using ADLS.
Design, develop, optimize, and maintain data pipelines, storage, and compute components using Azure Services.
Understand the Data Platforms & Services strategy, and information architecture, and help build modern data lakes and maintain high standards of data quality and integrity.
Design and build ETL pipelines to automate structured and unstructured data ingestion.
Analyzes requirements and architecture specifications to create a detailed design document. - Responsible for data engineering functions including, but not limited to data extraction, transformation, loading, and integration in support of modern cloud computing platforms like Azure and Databricks.
Work with DevOps engineers on CI/CD processes; perform code reviews and develop processes for improving code quality.
Strong in scalability, performance, and availability of our systems.
Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
Assist in the evaluation, implementation, and deployment of emerging tools to modernize the data platform.
Partner with analysts and architects to support technical architectures for data engineering projects.
In-depth experience using SQL Server DB for ETL processes
Additional Skills & Qualifications
Bachelor s degree in computer science or a similar field with 5 years experience as a data engineer or SQL developer.
5 years experience developing SQL and Python.
In-depth knowledge of Azure Data Factory, Azure Databricks, and Azure Service Bus.
Excellent understanding of T-SQL programming, ETL Processes, and Microsoft SQL Server.
Experience working with data using structured (SQL) and/or unstructured (NoSQL) approaches, Redshift experience a plus
Experience with or exposure to data visualization principles and practices, especially with Power BI or Tableau.
BS/MS degree in Computer Science, Engineering, or a related subject
Sense of ownership and pride in your performance and its impact on the company s success
5 years experience developing SQL and Python.
In-depth knowledge of Azure Data Factory, Azure Databricks, and Azure Service Bus.
Excellent understanding of T-SQL programming, ETL Processes, and Microsoft SQL Server.
Experience working with data using structured (SQL) and/or unstructured (NoSQL) approaches, Redshift experience a plus
Experience with or exposure to data visualization principles and practices, especially with Power BI or Tableau.
BS/MS degree in Computer Science, Engineering, or a related subject
Sense of ownership and pride in your performance and its impact on the company s success
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Salary : $80
Data Engineer (AWS, Azure, GCP)
CapTech -
Chicago, IL
Lead Data Engineer (AWS, Azure, GCP)
CapTech Consulting -
Chicago, IL
Azure Databricks Data Engineer - Chicago, IL (Onsite)
Lorven technologies -
Chicago, IL