What are the responsibilities and job description for the Data Engineer with AWS Glue position at Source Mantra Inc?
Job Description
Job Title: Data Engineer with "AWS Glue"
Location: Dallas TX (Day 1 Onsite/Hybrid)
Job Type: Long Term Contract
Job Description
10 years of experience as Sr. Data Engineer and must have strong 3 years of experience with AWS Glue
- Experience in AWS Compute such as EC2, Lambda, Batch or ECS
- Experience with AWS Storage services such as: S3, EFS, Glacier.
- Collaborate as part of a development team to design and enhance large scale applications development.
- Evaluates and plans software designs, test results and technical manuals using AWS
- Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions.
- Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.).
- Create or implement solutions for metadata management
- Solve for complex data integrations across multiple systems.
- Design and execute strategies for real-time data analysis and decisioning.
- Translating client user requirements into data flows, data mapping, etc.
- Analyses and determines data integration needs and follows Agile practices. Experience in AWS Analytics such as Athena, EMR, Glue, Redshift, Kinesis
- Strong knowledge in Python object-oriented programming
- Strong experience with AWS Database services such as: RDS, DynamoDB
- Experience using APIs for developing or programming software
- Experience using AWS Application Integration Services such as: Simple Notification Service (SNS), Simple Queue Service (SQS), Step Functions.
- Strong experience with SQL
- Experience with enterprise data lakes, data warehouses, data marts, and big data.
- Strong experience with data migration, cloud migration, and ETL processes.
Experience determining causes of operating errors and taking corrective action
If interested share your resume to