What are the responsibilities and job description for the DataOps Engineering Lead position at OneStudyTeam (Jobs)?
Our unique, rapidly growing data streams are enabling unique opportunities to manage clinical trials more efficiently and predictably. The Data Engineering division is looking for a talented DataOps Engineering Lead to operationally support a cutting-edge, globally distributed data architecture which is the analytical backbone of our company. If you are empathetic, business-driven, and want to use your data engineering and DataOps skills to make a tangible impact in the clinical research community then this may be the role for you.
As a fast-growing company, we're looking for people who can effectively balance rapid execution and delivery with sustainable and scalable operations initiatives to serve the business most effectively. You have strong opinions, weakly held, and while well-versed technically know when to choose the right tool, for the right job, at the right level of complexity. You will work closely with our other Data Engineering teams, our Data Science & Analytics and Data Products divisions, and the Product, and Product Engineering departments to help ensure our analytics infrastructure is growing scalably and effectively supporting critical-path analytics projects and workstreams across OST.
What You'll Be Working On
- Supporting the operation and international expansion of modern, privacy-aware, data warehouse and data mesh architectures using Amazon Web Services
- Supporting data automation processes and tooling with an eye towards availability, latency, performance, and capacity
- Supporting the growth and expansion of data warehousing, ingestion, ELT, distributed query execution, and orchestration systems to support the highly available collection and processing of multiple data sources
- Building automations to support self-service access to Business Intelligence platforms and data products
- Managing the monitoring of quality and freshness of data and related alerting and anomaly remediation systems to ensure there is no production impact
- Supporting Data infrastructure observability of events (as championed by Charity Majors)
- Acting as the liaison between Data Engineering and the Site Reliability Engineering team
- Learning to effectively understand and deftly navigate the global compliance ecosystem (HIPAA, GDPR, etc.) to ensure your work respects the rights, regulations, and consent preferences of all stakeholders, including historical underserved or underrepresented populations
- Developing an understanding of the clinical ecosystem, our products, and our business and how they all uniquely interact to help people
What You Bring To OneStudyTeam
- Minimum of 4 years in a DataOps-related leadership role with a successful track record of team execution at a growing company, ideally in a space similar to ours
- Demonstrated experience in Agile management methodologies and ability to translate business goals into discrete, tactical execution plans while adapting to evolving technical and business constraints
- Deep practical experience or familiarity with a good portion of our stack, including: AWS services (Redshift, MSK, Lambda, ECS, ECR, EC2, Glue, Quicksight, Spectrum, S3, etc.), Postgres, dbt, Kafka, Prefect, Docker, Terraform
- Experience in managing enterprise-scale data, distributed data architectures
- Excellent programming skills in a modern programming language such as Python and adept with SQL and Bash scripting
- Skill at containerizing applications with Docker or similar technology
- Ability to create, manage, and deploy infrastructure-as-code using Terraform (or CloudFormation)
- Ability to deploy, configure, and utilize monitoring and tracing services, such as OpenTelemetry, AWS X-Ray and Datadog
- Knowledge of network architecture and internet security best practices
- Ability to troubleshoot performance problems and system outages
- Strong knowledge of Linux-based operating systems
- Great communication skills and can work comfortably with technical and non-technical stakeholders to develop requirements