Lead Data Engineer

Title: Lead Data Engineer

Location: Chicago, IL (Onsite)

Full Time

Job Description:

Responsibilities:

• Design, develop, and maintain efficient and scalable data pipelines to extract, transform, and load data from various sources into data warehouses and data lakes.
• Leverage Python/Pyspark scripting to automate data processing tasks and create custom data analysis solutions.
• Utilize Glue and Lambda services to build serverless data processing workflows.
• Work with Snowflake to execute SQL queries, create stored procedures, and manage data within the cloud data warehouse.
• Implement AWS Cloud Formation templates to automate infrastructure provisioning and management.
• Orchestrate and manage data workflows using Airflow or equivalent tools.
• Collaborate with data analysts and scientists to understand their data requirements and provide effective data solutions.
• Strong proficiency in Python/Pyspark scripting
• Experience with Glue and Lambda services
• In-depth knowledge of Snowflake SQL and stored procedures
• Familiarity with AWS Cloud Formation
• Experience with Airflow or equivalent orchestration tools
• Understanding of ETL concepts and tools (e.g., Informatica)
• Excellent problem-solving and analytical skills
• Ability to work independently and as part of a team

VDart Group, a global leader in technology, product, and talent management, empowers businesses with comprehensive solutions through our four distinct, industry-leading business units. With a diverse team of over 4,000 professionals across 13 countries, we deliver strong results across various industries, including Fortune 500 companies.

Leveraging our deep expertise as a global provider of resources and solutions, we serve a wide range of industry verticals, including BFSI, Automotive, Healthcare, Mobility, Energy, Life Sciences, Manufacturing, Consumer Industries, and Technology.

With over 16 years of experience, VDart has evolved to meet the needs of leading technology brands, placing and training more than 20,000 professionals and shaping the industry's future.

Our continuous reinvention, providing resources for IT solutions and unique digital solutions, has positioned us as a top growth leader in digital talent management and technology consulting.

Committed to "People, Purpose, Planet," we prioritize social responsibility and sustainability, as evidenced by our EcoVadis Bronze Medal Certification and participation in the UN Global Compact.

Our dedication to delivering strong results has earned us recognition as a trusted advisor for businesses seeking to drive innovation and growth, including many Fortune 500 companies.

Join our network! Partner with VDart Group to leverage our global network, industry expertise, and proven track record with a diverse clientele.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.