What are the responsibilities and job description for the Data Engineer position at Pure Storage?
PURE IN PRAGUE
We opened our R&D Second Home (besides the one in Silicon Valley) in Prague in January 2020 and since then we have experienced unbelievable growth. Our Engineers are solving complex engineering problems (from low-level system software to cloud computing) that help us innovate our cutting-edge products. Besides our world-class Software Engineering teams, we have many other talented colleagues working in Product Management, Sales, Finance, and HR to name a few. What’s more, we’ve developed these teams from talent across the globe.
ABOUT THE ROLE...
Designing and overseeing a data platform that enables efficient data discovery, integration, and usage, which encompasses tool selection, process design, and promoting best practices. Leading the data strategy by merging current and forthcoming technologies into a cohesive data infrastructure. Streamlining ELT/ETL pipelines and integrating tools like Alation, Fivetran, and SnapLogic. Implementing stringent data safety measures, fostering data quality awareness among producers, and aligning with IT and other units for strategic decisions. Guiding BI tool adoption, setting usage standards, and managing project lifecycles, from rollout to ongoing innovation.
IN THIS ROLE YOU WILL...
- Create and manage the architectural design of a data platform that facilitates data discovery, integration, and consumption.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Collaborate with data producers, educate them on data quality, ownership, and guide them to become active data stewards.
- Identify, design, and automate manual processes, optimize data delivery, re-design infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources into Snowflake.
- Create and review technical solution requirements documents.
- Align with industry leading technology standards to develop solutions capabilities.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Communicate with internal team members and stakeholders in other time zones for the purpose of requirements clarification and progress reporting.
- Keep our data secure while building data products to derive business insights from the data.
- Responsible for coaching other junior members of the team on their deliveries.
WHAT YOU’LL NEED TO BRING TO THIS ROLE...
- 5 years of experience in data architecture, platform design, and data integration.
- Proficient with Python and/or Java.
- Excellent knowledge and Proficient with Tableau/Power BI
- Advanced relational SQL knowledge, including experience with databases like Postgres.
- Hands-on experience with data warehouses such as AWS Redshift, Aurora, Snowflake and/or Spark.
- Working knowledge of data pipeline and workflow management tools such as Airflow, Azkaban, Luigi, Airflow, Snaplogic, Boomi etc.
- Experience with stream-processing systems: Storm, Spark-Streaming, Kafka etc.
- Extracting data from various sources, such as databases, log files, and APIs.
- Strong understanding of data management life cycle, data safety protocols, and governance.
- Experience building and optimizing big data pipelines, architectures, and data sets.
- Hands-on experience with data quality management capabilities and analysis.
- Proven ability in data transformation processes, metadata management, dependency, and workload management.
- Experience performing root cause analysis to address business questions and identify areas for improvement.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Strong communication skills with the ability to influence decisions and collaborate effectively with various stakeholders.
- Program management capabilities with a history of successful delivery.
