Senior Data Engineer

Job Summary:

In this role, you will be responsible for expanding and evolving the cloud-based enterprise data platform. You will ensure the technology components of the platform are correctly configured and optimized to meet the functional, non-functional, and operational requirements. This role requires a highly motivated individual with strong technical ability, data capability, excellent communication, and collaboration skills. The candidate must be self-directed with excellent written and spoken communication to interact with both upstream and downstream users and stakeholders.

Be willing to work non-standard business hours on an on-call basis in a 24x7 environment few days a month.

Responsibilities:

• Work directly with Business, Product and Technical stakeholders to triage through issues and fix data pipelines.
• Partner with Development Leads for refining and enhancing our Data architecture, Pipeline development, Automation, and planning.
• Develop and maintain documentation, technical runbooks and user guides and coach junior support engineers.
• Maintain best practices to facilitate optimized software development by team members and continuous integration and continuous delivery (CI/CD pipelines)
• Ensure the technological components of the platform are optimally configured to meet the functional and operational requirements.
• Able to identify and debug issues in Tableau dashboards.

• Create and manage Incident and Change Requests as needed for data pipelines.
• Use industry best practices such as code reviews, pull requests, and peer testing to ensure high quality deliverables.

Qualifications:

• Degree in computer science, engineering, or a related discipline preferred.
• 8 years of experience in building and maintaining data platforms, ETL processes and connected sources and targets required.
• 5 years’ experience in data analytics on (Microsoft SQL Server, Redshift, HQL)
• 5 years of professional experience in Python, Java, Hortonworks, AWS, Rest API, Microservices, Spring Boot, Spring cloud etc.
• 3 years of Tableau or similar Visualization dashboards build and debugging.
• Hands on with compute frameworks like EMR, Hadoop,  Spark .
• Advanced structured query language (SQL) skills are key.
• Strong foundation in the AWS Cloud Services: S3, Redshift Spectrum, EC2
• Practical Knowledge of AL / ML models in commercial settings
• This position will not be eligible for visa sponsorship now or in the future.

#LI-AO1

#LI-Hybrid