Data Engineer

RESPONSIBILITIES:
Kforce has a client that is seeking a Data Engineer in Madison, WI.

Summary:
As a Mid-Level Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure. You will work with cutting-edge AWS technologies to build robust and scalable data pipelines, ensuring the integrity, quality, and availability of our data.

Primary Responsibilities:
Design and Implement Data Pipelines:
* Create and optimize ETL (Extract, Transform, Load) processes using AWS services such as Glue, S3, Lambda and Data Pipelines
* Develop scalable data architectures that support our microservice-based data ecosystem
* Utilize Terraform for infrastructure as code (IaC) to set up and manage resources

Data Modeling and Transformation:
* Implement best practices in data modeling, ensuring efficient data structures
* Use PySpark and Python scripting for data transformation and enrichment
* Work with Glue crawlers to discover and catalog data sources

AWS Services Expertise:
* Build and maintain Lambda functions for serverless data processing
* Leverage Glue jobs for data transformation and orchestration
* Utilize Glue catalog for metadata management
* Implement logging, monitoring, and alerting using AWS CloudWatch and other relevant tools
* Work with Delta Lake and Databricks for advanced analytics and data processing
* Query data stored in S3 data lakes using AWS Athena

Collaboration and Communication:
* Interface with business stakeholders to gather requirements and deliver complete reporting solutions
* Collaborate with cross-functional teams to ensure data consistency and accuracy

Continuous Improvement:
* Stay updated with industry trends and emerging technologies related to data engineering
* Identify opportunities for process optimization and automation

REQUIREMENTS:
* Bachelor's degree in Computer Science, Information Systems, or a related field
* Minimum 3 years of experience in data engineering, preferably with a focus on AWS technologies
* Experience with Glue jobs, Lambda functions, and Glue crawlers
* Knowledge of Delta Lake, Databricks, and S3 data lake storage
* Familiarity with Terraform for infrastructure provisioning
* Proficiency in Python and PySpark
* Strong problem-solving skills and attention to detail
* Excellent communication and teamwork abilities

The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.

We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.

Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.

This job is not eligible for bonuses, incentives or commissions.

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.