What are the responsibilities and job description for the Data Engineer position at VidMob?
Who We’re seeking:
We are looking for a Data Engineer with the passion and technical skills to make data come to life. The ideal candidate must blend expertise in data with hands-on experience in engineering. You should strive to design and build large-scale, high-performance data systems through your insights into data and how to manage it at scale. If faced with roadblocks, you continue to reach higher to make greatness happen. You believe in not only serving customers but also empowering them by providing knowledge and tools.
What You'll Do
Play a pivotal role in growing our data initiatives, supporting both data insights and software engineering teams. Rapidly process data on an immense scale. Create reports that drive business outcomes and optimizations. Balance granularity and business value with resource cost and efficiency. Develop the maturity of VidMob’s platform by reducing latency and error rates. Maintain speed, availability, and reliability as our client base grows.
Responsibilities
- Work with data insights teams to define and extract data sets for use in analysis and machine learning
- Work with software engineering and data science teams to design, build, and manage our application DB, machine learning components, and our data infrastructure
- Maintain, extend, and automate reporting infrastructure
- Manage the design and architecture of our data warehouse
- Create software tools to automate and manage ETL processes and dependencies
Minimum Qualifications
- 5 years of data engineering experience
- B.S. in computer science or equivalent experience
- Advanced working knowledge of SQL and relational databases, MySQL preferred
- Understanding of statistics and data modeling methodologies
- Experience collaborating with Data Scientists and Data Analysts
- Ability to create fast solutions to problems introduced in a changing environment with iteration towards optimal solutions
- Experience with data-related AWS services such as RDS, Redshift, and Kinesis
- Experience with programming or scripting language, preferably Python, Spark, Java, or Scala