What are the responsibilities and job description for the Data Consultant position at HCM Staffing and Consulting?
Job Description
Job Overview:
We are seeking a skilled and experienced Mid/Senior Data Consultant with AWS experience to join our team. The ideal candidate should have strong experience in developing applications using Glue/EMR, Serverless Services, and proficiency in Python and Pyspark. Additionally, the candidate should have experience in on-prem to AWS migration, DevOps, resiliency architecture, and production monitoring.
Responsibilities:
- Design, build, and maintain data pipelines and data lakes using AWS services such as Glue/EMR, Serverless Services, and other relevant tools.
- Develop ETL processes to move data from on-prem to AWS environment.
- Work with stakeholders to understand their data needs and develop solutions that meet their requirements.
- Develop and maintain data models and data structures to ensure data accuracy and consistency.
- Write code in Python and Pyspark to perform data processing and transformation.
- Create automated data pipelines and workflows using AWS technologies.
- Ensure that data pipelines are robust, scalable, and maintainable.
- Monitor data pipelines and workflows in production to ensure that they are performing as expected.
- Collaborate with other teams to ensure that data is available and accessible to support business needs.
- Participate in code reviews and ensure that best practices are followed.
- Continuously improve data processing and transformation pipelines.
Requirements:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- 3 years of experience in developing data pipelines and data lakes using AWS services such as Glue/EMR, Serverless Services, and other relevant tools.
- Proficiency in Python and Pyspark.
- Experience in on-prem to AWS migration, DevOps, resiliency architecture, and production monitoring is a plus.
- Strong problem-solving and analytical skills.
- Ability to work independently and in a team environment.
- Excellent verbal and written communication skills.
- Ability to adapt to new technologies and learn quickly.
Salary : $45 - $48
Senior Data Engineer
Starcom Consultant -
Reston, VA
Azure & Network Support Consultant (Secret Clearance)
SunPlus Data Group, Inc -
Washington, DC
Data Analyst
Numero Data -
Herndon, VA