What are the responsibilities and job description for the Senior Data Engineer position at Whip Media?
Whip Media is looking for an exceptional Senior Data Engineer to join our rapidly growing Data Engineering team! In this role you will design, build, and scale the next-generation of modern data engineering and machine learning systems here at Whip Media. These make up the core of our industry-leading media analytics and insights powering Whip Media’s enterprise products and services. Our customers include major film and television studios, television and streaming content platforms, and other big players in the media and entertainment industries.
If you are looking for a fast-paced, high-impact role driving the future of data engineering at Whip Media, this is the role for you.
What Will You Do?
- Support mission-critical data infrastructure supporting machine learning operations, including: data management, data ingestion and export, feature extraction, model training, and model evaluation
- Lead and contribute to high-impact projects related to: master data management, pipeline scalability, batch and streaming architectures, data warehousing, and data quality assurance
- Evangelize modern data engineering and data product development best practices
- Collaborate with data scientists, machine learning engineers, business analysts, and product managers ensuring product roadmap and strategy alignment
- Mentor other data engineers accelerating team growth and maturity
What Do You Need?
- 5-10 years of experience supporting technical aspects of:
- Consumer or enterprise cloud native data-driven applications
- Large-scale data processing using Spark, EMR, Hadoop, or similar
- Managing and aligning complex first and third-party data sets
- Data warehouse and lakehouse patterns using Snowflake or Redshift
- Highly-available relational and document databases including Postgres, MySQL, DynamoDB, and Elasticsearch
- Scalable model-serving APIs
- Data orchestration with Apache Airflow and Databricks
- Business intelligence tools such as Looker or Tableau
- Logging, monitoring, and alerting for pipelines, applications and infrastructure SLAs
- Expert in writing modern Python and SQL
- Expert in data modeling for advanced machine learning and analytics use-cases
- Strong working knowledge of Git and the full software development lifecycle
- Experience working in an agile environment using Jira and Confluence, or similar
- Creative, pragmatic, and strategic approach to solving complex technical problems
- Passion, positivity, and strong people skills including excellent communication capabilities, written and verbal
- Familiarity developing and managing containerized cloud infrastructures using Kubernetes, EKS, Terraform, and Docker is a plus
- Experience or interest in leading-edge machine learning techniques is preferred
- Prior experience working in startup and high-growth company environments is a plus
- Previous experience as a Technical Lead, Project Lead, or Engineering Manager is preferred
- Prior experience in advertising, media, or entertainment industries is a plus