What are the responsibilities and job description for the Hadoop Architect position at Horizon Corp?
Job Title: Hadoop Architect
Location: Pennington, NJ
Duration: Full Time
Skills Required:
- Experience with Agile/Scrum methodology is essential.
- Experience with either Apache Spark-On-YARN (Hadoop) or Apache Spark-On-EGO (IBM Spectrum Conductor) is essential.
- Experience with Apache Spark Libraries: PySpark, Spark SQL, Spark Streaming, MLlib are essential.
- Experience with either Hadoop/YARN or IBM Spectrum Conductor/EGO cluster resource manager is essential.
- Experience with RedHat Linux (RHEL) command line and shell scripting are essential.
- Experience with file formats CSV, JSON, ORC, Avro, Parquet, Protocol Buffers are essential.
- Experience with Python, Java, and R are highly desirable.
- Experience with Numpy, and Pandas are highly desirable.
- Experience with designing and configuring distributed architectures are desirable.
- Knowledge of CI/CD SDLC practices.
- Knowledge of Scikit-Learn, Pytorch, Keras, H20.ai.
- Strong communication skills, should be able to communicate effectively with business and other stakeholders.
- Demonstrate ownership and initiative taking
Job Type: Full-time
Work Location: One location
Project Architect
Minno & Wasko Architects and Planners -
Lambertville, NJ
Landscape Architect
Clarke Caton Hintz -
Trenton, NJ
Tableau Architect
Pacific Consultancy Services -
Plainsboro, NJ