Data Engineer - 12 Month FTC - Spark, Glue

Company Description

Discover the Unexpected

Experian is the world’s leading global information services company. We’re passionate about unlocking the power of data in order to transform lives and create opportunities for consumers, businesses and society. For more than 125 years, we’ve helped economies and communities flourish – and we’re not done.

Our 21k amazing employees in 40 countries believe the possibilities for you, and the world, are growing. We’re investing in the future, through new technologies, talented people and innovation so we can help create a better tomorrow. To do this we employ the brightest minds that share our purpose and want to make a difference.

Job Description

We are looking for a Data Engineer, with experience in Spark, Glue and Data Modelling, to join our growing Data Engineering team within Experian’s e-commerce business, solving everyday big data problems.. You’ll work on exciting new projects, contribute to the build of new data architecture and deliver cutting edge solutions using advanced tools and technologies in the data and analytics space. As part of the role, you will also be mentoring 2 junior data engineers.

You’ll be using modern technologies to support the expansion of machine learning and AI capabilities and be part of transforming the way that we understand and talk to our customers. The successful candidate will get an opportunity to shape the way Experian manages its data- driven product landscape.

Our team has a passion for learning, problem solving and building innovative and scalable data solutions. If this sounds like a good fit for you then this could be a great opportunity.

Key responsibilities of the role:

• Contribute to the design and deployment of large-scale data pipelines and applications
• Build production ready data services using a range of technologies including Spark, Glue, Redshift, Lambda, CDK, Sagemaker and Step Function.
• Contribute to the evolution of the platform by evaluating new technologies and building prototypes covering topics such as machine learning, streaming or API-driven services 
• Work as part of an agile delivery teams with DevOps ways of working to continuously deliver iterative deployments with experience in using Git, Jira and Confluence.
• Advise development teams on best practices for the use of big data technologies and coding practices
• Develop and share knowledge on new technologies across our analytics and data science community.
• Take offline models data scientists build and turn them into a real machine learning production system.

Qualifications

You’ll have experience with some of the following:

• Data architecture, data modelling, database design and development 
• End to End Data pipeline Orchestration and production deployment.
• Building data solutions at scale using Spark or Glue. 
• Experience working with workflow scheduling tools like Step Function, Airflow.
• Debugging and performance tuning data pipelines
• Skilled in SQL and Python
• Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services like Spark, Glue, RedShift, SQS, SNS, Lambda, Glue, Sagemaker and Athena.
• Apply software engineering rigor and best practices to machine learning, including CI/CD, automation.
• Demonstrable experience in handling structured, semi-structured and unstructured data.
• Data performance management (monitoring query performance, enabling steps to improve performance like archiving, indexing, partitioning, compression etc)

Desirable

• Familiarity with Linux and scripting languages e.g., bash
• Visualisation platforms such as Tableau an advantage but not essential
• Experience with MLOps is an added advantage.

Additional Information

Our uniqueness is that we truly celebrate yours.

Experian's culture and people are key differentiators. We take our people agenda very seriously. We focus on what truly matters; DEI, work/life balance, development, authenticity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. We’re an award winning organisation due to our strong people first approach.

Innovation is a critical part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

#LI-DS1

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here