Kafka Architect

Role : Kafka Architect

Location- Atlanta, GA

Job Description:

As a Kafka expert, you will be responsible for assisting with the design, architecture, implementation, and on-going support of Kafka clusters on AWS/on prem.
Responsibilities
Manage large scale multi-nodes Kafka cluster environments residing on AWS/on prem.
Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.
Creation of key performance metrics, measuring the utilization, performance and overall health of the cluster.
Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
Research and recommend innovative, and where possible, automated approaches for system administration tasks.
Ability to closely calibrate with product managers and lead engineers.
Provide guidance in the creation and modification of standards and procedures
Create topics, setup redundancy cluster, deploy monitoring tools, alerts
Proactively monitor and setup alerting mechanism for Kafka Cluster and supporting hardware to ensure system health and maximum availability
Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka cluster
Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
Manage large scale multi-nodes cluster environments residing on AWS
Provide technical expertise and guidance to production support staff.
Partner with business units in order to improve the effectiveness of business decisions.

Qualifications

Design, build, assemble, and configure application or technical architecture components using business requirements.
Hands-on experience with Kafka clusters hosted on Amazon cloud is a plus.
Experience in Kafka build pipelines using Ansible, Cloud formation templates, shells etc.
Experience in Jenkins, GitHub
Experience in implementing security & authorization (permission based) on Kafka cluster.
Experience in open source Kafka, zookeepers, Kafka connect, schema registry Avro schemas.
High availability cluster setup, maintenance and ongoing support
Has good knowledge of best practices
Hands on experience in standing up and administrating Kafka platform which includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management(ACL)
Knowledge of Kafka API (development experience is a plus)
Knowledge of best practices related to security, performance, and disaster recovery.
Comfortable performing in a fast paced, dynamic and ambiguous business environment.
Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable.
Demonstrate a product mindset with an ability to set forward thinking and direction.
Excellent listening and communication skills.
Must be able to communicate technical information clearly, able to ‘translate’ between diverse groups of technical and non-technical individuals.
Ability to synthesize large amounts of complex data into meaningful conclusions and present recommendations to a vast array of individuals.
Ability to structure documents to effectively communicate with senior leadership and drive alignment and decision making.
Strong problem solving skills with the ability to offer why one technical solutions is more preferable than another.
Ability to analyze and interpret complex concepts.
Proven track record of sound, effective decision making.

Devesh

Job Types: Full-time, Part-time, Contract

Salary: $75.00 - $100.00 per hour

Schedule:

• 8 hour shift

Education:

• Bachelor's (Preferred)

Experience:

• Kafka Architect: 2 years (Required)
• Ansible, Cloud formation templates, shells: 2 years (Required)
• Jenkins, GitHub: 1 year (Required)
• TOTAL IT: 9 years (Required)

Work Location: One location