What are the responsibilities and job description for the Lead Azure Cloud Data Engineer position at TalTeam?
Job Description
Lead Azure Cloud Data Engineer Washington DC _ Must be local to DC, VA MD WV and PA
PURPOSE:
Lead Cloud Engineer is responsible for the implementation, 24x7 operational support, automation, availability, and performance management of the public cloud platforms.
The candidate is responsible to work with multi-disciplined IT technical teams to collaborate and manage infrastructure, automation, and applications in the public cloud with a focus on (but not limited to) Microsoft Azure and AWS. They need to contribute valuably to the evaluation of application and infrastructure cloud readiness, work on cloud migration plan to support on-premise moves to a cloud service as well as the long-term management of the infrastructure associated with these applications.
Candidate must have a strong and broad foundational IT skillset including supporting Azure Cloud services, Linux/Windows Operating Systems, server configurations (including networking, storage and security principals), Data Hub, Containerization environments. The candidate must also have a strong understanding and working knowledge with critical IT services such as Active Directory/Azure Active Directory, DNS, IaaS, PaaS, Containers, etc.
Responsibilities include working with application, development, database, and security teams as well as with other IT teams to collaborate on implementing automation services across the infrastructure platforms. This is a highly technical cross-functional role that understands all components of IT infrastructure (network, compute, storage, security, etc.), and knows how to integrate and automate each of the components using scripting or automation tools like Azure DevOps and ServiceNow.
Responsible for:
• Supporting and implementing infrastructure used for business mission critical applications including Claims Processing, Enrollment, Financial and Portal Websites and many other applications.
• Supporting cloud infrastructure to manage a 99.98% availability for all systems/services on a 7x24x365 basis.
• Providing On-Call escalation and emergency support as needed.
• The current public/private server environments consist of:
o Azure IaaS Linux/Windows Servers – 90%
o AWS IaaS Linux/Windows Servers – 10%
• Configuring and supporting Azure services such as Data Factory, Web App services, Functions, Databricks, Azure AD, Storage Blob, File Share
• Contribute to the evaluation of application cloud readiness while also working on migration plans and long-term management of applications.
• Design and Implement Cloud platforms for highest levels of availability, performance, security, and agility.
• Implement cost transparency, disaster recovery and business resiliency best practices.
• Implement process and procedures as well as the creation and maintenance of Standard Operating Procedure (SOP) documentation enhancing and standardizing the support of the Cloud Platforms on documented best practices.
• Ensure that each cloud platform complies with well-established policies, standards, licensing agreements and configuration guidelines.
• Assist in administering Active Directory and Azure AD for the highest levels of security and availability.
• Experienced with Cloud SAML integration such as Azure Enterprise Apps, SSO and SCIM provisioning
• Understand and apply new technical skills through a combination of research, instructor lead training and self-training.
• Lead the review, design and implementation of new technologies that improve infrastructure or reduce cost.
• Provide excellent customer service to all customers, both internal and external.
• Exhibit professionalism when working with and communicating to our customers and vendors.
• Act as an interface to members of the IT infrastructure team, keeping management and peers informed, and disseminating information as needed.
• Utilize strong troubleshooting capabilities to diagnose and resolve problems and escalate to next level of support (both internally and with vendors) as necessary.
• Work independently and cross functionally with others to resolve problems.
Cloud Data Engineering
• Knowledge of Cloud data services including ETL, ELT processes
• Design, implement, monitor, and optimize data platforms
• Work with Data engineering team to implement cloud data stores
• Understand and Supports Azure Data Factory, Pipelines, linked services
• Knowledge of data processing languages such as SQL, Python
Infrastructure Automation
• Work with ITSM team to integrate cloud service catalog into ServiceNow.
• Azure builds via Azure DevOps\ARM/BICEP/Terraform automated services
• This is a highly technical cross-functional role that understands all components of IT infrastructure (network, compute, storage, security, etc.) and knows how to integrate and automate each of the components and services and deliveries.
Project Management
• Provide project management over the technical aspects of implementing infrastructure projects and major release upgrades for largest, most complex and critical systems.
• Properly follow a project life cycle.
• Develop project plans and project tasks using Jira and Agile methodologies.
• Complete all appropriate documentation and notifications to obtain resolution within the established timeframes.
• Provide input to the development of corporate IT standards and policies to ensure compatibility and integration throughout the company.
• Complete project work within budget constraints if they exist.
• Stay current in new IT technologies to maintain high level subject matter expertise.
• Compose a set of ideas into a clear presentation for leadership to consume. Capable of presenting PowerPoint clearly and confidently.
• Take highly technical concepts and organize them into a PowerPoint presentation to present to management to provide full project status and updates.
QUALIFICATION REQUIREMENTS: Required:
• Bachelor's Degree Information Technology (or equivalent educational focus 10 years) is required.
• 10 years of total IT experience
• 4 years of Cloud experience
• Must have projects that implemented and supported Azure services like Web App service, Functions, Data Factory, Databricks
• Must be expert with cloud services such as AAD, VM, Storage, Network, Backup
• PowerShell scripting experience
• Must have cross platform enterprise experience across IT (Server, Network, Storage, Security).
• Must be a highly motivated individual with strong analytical, problem solving and multi-tasking skills complimenting a passion for learning/sharing information from and with peers.
• Must be able to work a 24x7 On-Call shift as needed.
Preferred Technical Expertise:
• Azure Architect Certification