Data Engineering Lead

Responsibilities:

• We are looking for an experienced Data Engineer to help manage existing data resources, implement, and enhance new technologies and tooling to further enable data science and analytics.
• In this role you will split your time between hands on data operation support, development activities.
• You will own data environments, integrate with new technologies, and oversee the development of new processes. You will be responsible for following tasks as part of your day to day operations.
• Partner closely with onsite leads, customer, and stakeholders to deliver and define the priorities.
• Provide regular updates to the clients and highlight roadblocks proactively.
• Work independently on the decided tasks and take the direct responsibility of data operations and support in rotation.
• Participate in regular Agile practices like scrum and retrospection etc.
• Create value by meeting needs of stakeholders and delivering highquality results.
• Open and flexible to accommodate and implement new ideas, understand business complexities, nurture innovation and challenge the status quo persistently.
• Demonstrate strong communication skills (both written and verbal) and a positive, solution oriented attitude.
• Must have Skill In depth knowledge on AWS, especially data storage & processing technology stack like Athena, Glue, S3, EMR, Lambda, Cloud front, Cloud Formation, Kinesis, Data Pipeline Services, AWS Batch Services, Dynamo DB, etc. In depth understanding of data ingestion, processing, and delivery.
• Expert in writing SQL and Python and understanding of shell scripting. Experience on building an enterprise data lake and maintaining data quality through error free and tested ETLELTs.
• Experience building data lakes data warehouses, Knowledge of tools like Apache Airflow.
• Understanding of CICD tools, data governance and Agile project management skills Clear, professional written and verbal communication skills, ability to easily communicate complex ideas.
• Good to have Skill Knowledge on Big data Experience in Spark and realtime processing.
• Any AWS certification related to Data.
• Having AWS Big data specialty or AWS data analytics certification would be a big advantage.
• Experience in real estate domain.
• Qualifications Bachelor or masters in software engineering and Computer Science 6 to 8 years of experience in design, development and support of largescale data platforms.