What are the responsibilities and job description for the DevOps Engineer (LLM), Enterprise Systems position at Apple?
Summary
Posted:
Weekly Hours: 40
Role Number:200515468
Apple’s Applied Machine Learning team has built systems for a number of large-scale data science applications. We work on many high-impact projects that serve various Apple lines of business. We use the latest in open source technology and as committers on some of these projects, we are pushing the envelope. Working with multiple lines of business we manage many streams of Apple-scale data. We bring it all together and unleash business value.
We do all this with an exceptional group of software engineers, data scientists, DevOps engineers and managers. We are looking for a talented and dedicated engineers to join our team to bring passion for infrastructure and distributed systems, to build world-class platforms/products at a very large scale across cloud environments.
Key Qualifications
- 5 years of experience in SRE/Devops
- Extensive experience in managing the applications on AWS/GCP & Kubernetes
- Strong Experience in Infrastructure templating tools like CloudFormation, Terraform
- Experience in building CI/CD pipelines for large scale application on AWS/GCP & Kubernetes
- Experience in GitOps based deployment tools like Spinnaker/Flux/ArgoCD
- Strong proficiency with Helm and Kustomize for managing Kubernetes applications and configurations.
- Experience in managing Embeddings using Vector databases
- Deep understanding on RAG based pipelines for Model inferencing
- Exposure to Prompt engineering
- Experience in observability & traceability for Large Language Models
- Deep understanding of Object Oriented Programming skills like Java.
- Experience in Performance tuning JVMs & Operating Systems like Linux
- Strong programming skills in Unix & Python
- Excellent analytical & problem solving skills
Description
Join Apple's Applied Machine Learning Team, as a Senior LLM DevOps Engineer, to enable GenAI across our Applications & Platforms. Candidates should have strong background in LLM core concepts, be proficient in setting up and supporting the infrastructure for large scale big data applications in public cloud like AWS/GCP.
The main responsibilities for this position include:
Build & Support CI/CD tools to port & manage applications on AWS/GCP & Kubernetes
Evaluate and port Language Models onto optimized infrastructure to reduce cost and increase performance
Identify the LLM evaluation frameworks and integrate with the platform
Build automation to enable self-healing systems
Build tools to monitor & alert the high performance and low latency applications on AWS/GCP
Ability to troubleshoot application specific, core network, system & performance issues.
Build a multi-tenancy system by enforcing data protection between different use cases.
Involvement in challenging and fast paced projects supporting Apple's business by delivering innovative solutions.
The candidate is expected to be self-motivated, proactive, and a solution-oriented individual.
Education & Experience
BS in computer science with 7-10 years or MS plus 5-7 years experience or related experience
Additional Requirements
Pay & Benefits
- At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $170,700.00 and $300,200.00, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.
Salary : $170,700 - $300,200
DevOps Engineer - Distributed Systems
Apple -
Cupertino, CA
Associate DevOps Engineer - 2025 Start Dates
Veeva Systems -
Pleasanton, CA
Framework Software Engineer, Enterprise Systems
Apple -
Cupertino, CA
