Senior. Data Engineer

Hi folks,                                                                                             

This is Prem Singh from "Akvarr Inc". We have an immediate role for “Sr. Data Engineer" you.  Please find the job description below if you are interested.                         

Job Title:       Senior. Data Engineer 

Duration:       12 Months Contract.                   

Location:       Remote Work – 100%     

  It’s a W2 Basis position.

job Description:

The Single-Family Enterprise Data space is moving on-prem data processing workflows into AWS cloud. They need resources who have STRONG experience with AWS DATA services (RDS, SQL queries, PL/SQL, RedShift, S3, ECS Fargate and AWS GLUE for ETL).

Candidates MUST have hands-on experience with

Creating ECS Components

Writing Python code

Invoke Lambda Functions using Python

Create complex SQL queries to analyze the AWS Databases

Use AWS Glue for ETL / data processing activities using Python

Duplicate database or data warehouse services in AWS for different applications.

Data Engineer background with Python coding skills

This person is processing data events coming in and setting these up in AWS (XML, flat files). Involved in transformations, analysis of data and integrations for AWS. Data quality rules.

Top Skills:

Hands-on development experience with Python code and AWS Data services  

Must have experience with AWS Database / Data Services:

GLUE (ETL), RDS, PL/SQL, Redshift, S3, ECS Fargate

Experience migrating on-prem data to AWS

Deploy Spring Boot components to ECS Fargate.

Responsible for integration, data processing and data transformation (ETL) using GLUE.

Ingesting, Transforming, and loading the data to S3, Amazon Elastic Search, and Amazon Redshift

Develop AWS Glue Data Pipelines for ingesting, manipulating, and storing the data while interacting with different services in AWS

Deploy and Run Glue ETL jobs

Python Object Oriented Programming in AWS

Worked with Boto3 for Python Development on top of AWS. Well-versed in Python's libraries (Boto3, Numpy, etc.).

Use Python to develop data pipelines.

Built backend process to invoke Lambda’s using Python code.

Experience writing complex SQL queries

Wrote complex SQL queries to extract, manage, analyze and transform data in Oracle and other AWS Database services

Parsing XML Data

Create complex SQL queries against RDS database and S3 data

Enhancements to existing solutions

Write Unix scripts - Shell scripting. CRON

Ops, DevOps, Automation Skills:

Ability to automate code written in Python

Manage, maintain and enhance/update the pipelines

Python Object Oriented Programming

Well-versed in Python Object Oriented Programming and Python libraries:

Boto3, pandas, psycopg2, csv, json, io

Experienced with Python and AWS native services –

. Well-rounded skills interacting with AWS as a Developer. 

This team is migrating applications from on-prem to AWS and building new applications in the cloud.

Experience with CI/CD pipelines, Spring Framework, Microservices is highly preferred

Understanding of application lifecycle management

U can reach me @