Sr. Data Engineer

Duration: 6 Months Contract

 Job Description:

 Top skills: Spark, Sql, Python

 What Are We Looking For:

We seek a high performing Sr. Data Engineer to play a critical role in the development of Client Enterprise Data & Analytics capabilities.  You will be part of an organization focusing on the development and delivery of data solutions and capabilities for Client Commercial Analytics and data platforms.  The successful candidate is motivated by thinking big data, technically proficient, and enjoys working in a fast-paced environment.

What Will You Work On:

As a Senior Data Engineer for Commercial Analytics, you will drive deliverables to completion with hands-on development responsibilities, and partner with the Lead Engineer to provide thought leadership and innovation with those deliverables.

Responsibilities:

In this role, you will:

• Design and build reusable components, frameworks, and libraries at scale to support analytics products.
• Design and implement product features in collaboration with business and Technology stakeholders.
• Identify and solve issues concerning data management to improve data quality.
• Clean, prepare and optimize data for ingestion and consumption.
• Collaborate on the implementation of new data management projects and re-structure of the current data architecture.
• Implement automated workflows and routines using workflow scheduling tools.
• Build continuous integration, test-driven development and production deployment frameworks.
• Collaboratively review design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
• Analyze and profile data for designing scalable solutions.
• Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues.
• Develop architecture and design patterns to process and store high volume data sets.
• Participate in an Agile / Scrum methodology to deliver high - quality software releases every 2 weeks through Sprints.

Who Will You Work With:

In this role, you will be part of an agile scrum team, closely partnering with the Product Manager, Lead Engineer, and other team members to deliver data and analytics capabilities to Client Commercial Analytics organization.   You will collaboratively partner with business stakeholders and other technology solution delivery, architecture, and platform teams.

 Experience and Qualification:

What You Bring:

We are looking for world class talent that brings the following key skills and experience to this role:

• Bachelor's degree in IT or related field.  One of the following alternatives may be accepted:  PhD or Law 3 yrs.; Masters 4 yrs.; Associates 6 yrs.; High School 7 yrs. exp
• 5 years of experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools.
• 3 years’ experience in Big Data stack environments (Hadoop, SPARK, Hive & Delta Lake)
• 3 year’s working with multiple file formats (Parque, Avro, Delta Lake)  & API
• 3 years’ experience in cloud environments like AWS (Serverless technologies like AWS Lambda, API Gateway, NoSQL like Dynamo, EMR & S3)
• Experience with relational and non-relational SQL
• Strong experience in coding languages like Python, Scala & Java
• Have experience in building real time streaming data pipelines.
• Experience in pub/sub modes like Kafka
• Strong understanding of data structures and algorithms
• Experience in building lambda, kappa, microservice and batch architecture
• Experience working on CI/CD processes and source control tools such as GitHub and related dev processes.
• Has a passion for data solutions and willing to pick up new programming languages, technologies, and frameworks?

About US Tech Solutions: US Tech Solutions (;/a>) is global firm providing a wide-range of talent on-demand and total workforce solutions. We are an Equal Opportunity Employer and Prohibit Discrimination and Harassment of Any Kind.