What are the responsibilities and job description for the Senior Data Engineer position at Ziff Davis?
Everyday Health Group (EHG) is a recognized leader in patient and provider education and services attracting an engaged audience of over 74 million health consumers and over 890,000 U.S. practicing physicians and clinicians. Our mission is to drive better clinical and health outcomes through decision-making informed by highly relevant information, data, and analytics. We empower healthcare providers, consumers and payers with trusted content and services delivered through Everyday Health Group’s world-class brands.
We are looking for a Senior Data Engineer to join us in supporting our data processing, engineering, and insight generation.
Responsibilities:
Understand overall data collection strategies and implement them in data tables and connections.
Program Python-based APIs and web services per implementation schema, such as creating applications to access Facebook, Twitter, Salesforce, and other data sources.
Use Databricks, PySpark, SQL Server, MySQL, HDFS and AWS to design, develop and deploy data processing.
Analyze and organize raw data from various ETL tools.
Monitor/Forecast computing resources usage (data lakes, AWS, EC2, etc.).
Collaborate with ETL developers located at various offices (US and India)
Implement coding standards, procedures and techniques, concluding writing technical code base.
Detect, repair, prevent data pipeline failures; identify systematic weaknesses and provide pre-emptive remedies with programming or processes.
Build and optimize data storage systems.
Prepare data for prescriptive and predictive modeling.
Recommending and implement emerging database technologies.
Create automation for repeating database tasks.
Qualification:
4 years of programming experience with an emphasis on data processing.
Coding skills: Python, SQL.
Ability to create object-oriented programming and data architectures
Knowledge of new, leading technology strategy in data engineering and management
Understanding of industry technologies in scalability, performance, delivery pipeline and maintenance of these tools and systems.
Hands-on experience with SQL database design, AWS or other cloud systems.
2 years experience in Linux environments.
Experience with SQL Server, MySQL or other popular database management tools.
Good/Expert knowledge of API services
Familiarity with Agile process
Clear documentation requirements and specifications
Bachelors or Advanced Degree in Information Management, Computer Science or related field.
Desirables:
Experience in AWS
Experience in developing custom data pipelines in HDFS
Experience working with social media, Double Click, Adobe APIs
Working with teams across multiple locations
Skills: Databricks; PySpark; Pig; Hive; Spark; Impala; EMR
Our Culture and Values
We created our values together to guide our collective purpose and pursuits. We are collaborators and problem solvers. We empower one another to make informed decisions and to be enabled towards action. We embrace success. We recognize that innovation can spark and be born from any of us no matter our individual role or background. We encourage open mindedness and sensitivity to each other and our environment. Our personal and professional passions get ignited, nurtured and supported. We value that doing is greater than talking as the most measurable means of impact. Our collective purpose to deliver enlightened audience experiences with trusted brands is what drives the success of our business and our professional satisfaction.
Life at Everyday Health
At Everyday Health Group, a division of Ziff Davis, we work in a culture of collaboration and welcome those who desire to join our growing global community. We believe in careers versus jobs and people versus employees. We seek enthusiastic individuals with an entrepreneurial spirit looking for an environment that rewards your best work.
#MedpageToday