Key Responsibilities:
- Develop and maintain the Front Office Data warehouse on Amazon Web Services (AWS).
- Design and implement scalable data pipelines to meet organizational data needs.
- Lead a team of data engineers in creating, testing, and deploying data pipelines and ETL processes.
- Collaborate with various teams to understand data requirements and provide effective solutions.
- Establish and enforce best practices for data engineering processes.
- Evaluate and implement new technologies to enhance data pipeline efficiency.
- Monitor and optimize data system performance for reliability, scalability, and cost-effectiveness.
- Provide technical leadership and mentorship to junior team members.
- Troubleshoot and resolve issues related to data pipeline failures and performance bottlenecks.
- Work closely with DevOps and infrastructure teams to manage data systems in production environments.
- Stay informed about industry trends and incorporate emerging technologies to improve existing systems.
Skills and Experience:
- Bachelor's or Master's degree in Computer Science or equivalent experience.
- 10 years of experience in designing, building, and deploying large-scale data pipelines and ETL processes.
- Background in Power & Gas Commodities is advantageous.
- Proficient in programming languages like Python.
- Expertise in SQL Server, Database Administration, data modeling, and database design.
- Familiarity with modern data warehouse platforms such as Snowflake and Data Bricks.
- Experience with AWS cloud platform.
- Knowledge of containerization technologies like Docker and orchestration tools such as Kubernetes.
- Previous leadership or mentoring experience is preferred.
- Relevant certifications like AWS Certification are a bonus.
If you are a seasoned Lead Data Engineer with a passion for technology and a track record of delivering impactful solutions, we encourage you to apply and join our innovative team at iSphere.
Click the checkbox next to the jobs that you are interested in.
Click the checkbox next to the jobs that you are interested in.
Capacity Management Skill
Capacity Planning Skill
Team Lead - Traffic Signal Maintenance
Office of the County Engineer, Houston, TX
Project Delivery Team Lead - Traffic Design
Office of the County Engineer, Houston, TX