What are the responsibilities and job description for the Data Engineer (Azure) position at Tiger Analytics?
Job Details
Job Description
Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in the world.
We are looking for a Data Engineer to join our growing team of analytics experts. The right candidate will have strong analytical skills and the ability to combine data from different sources and will strive for efficiency by aligning data systems with business goals.
Requirements
- Bachelor s degree in Computer Science or similar field
- 4 years of experience in IT industry
- Expertise in Python and Pyspark
- Experience building data pipelines using Azure stack
- 2 years of experience using Apache spark
- Good working experience on Delta Lake and ETL processing
- Proficiency in SQL queries
- Prior experience of working in a Unix environment
- Experience in harmonizing raw data into a consumer-friendly format using Azure Databricks
- Experience extracting/querying/joining large data sets at scale
- Experience building data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data
- Experience in data wrangling, advanced analytic modeling is preferred
- Exposure to Java is a plus
- Strong communication and organizational skills
Benefits
This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.