What are the responsibilities and job description for the Spark with Scala or python position at Fanisko?
Job Type
Contract to hire ( 3 Months)
Job Description
Our company is seeking a talented and experienced Spark Developer to join our dynamic team.
The ideal candidate will have a strong background in big data processing using Apache Spark
and proficiency in either Scala or Python. As a Spark Developer, you will be responsible for
designing, developing, and maintaining data processing pipelines to support our analytics and
business intelligence needs.
Key Responsibilities
Collaborate with data engineers, data scientists, and other stakeholders to understand business requirements and translate them into Spark-based solutions.
Design, develop, and optimize Spark applications to process and analyze large volumes of data efficiently.
Implement data processing pipelines using Spark with a focus on scalability, reliability, and performance.
Troubleshoot and resolve issues related to data processing jobs and performance bottlenecks.
Work closely with cross-functional teams to integrate Spark applications with other components of the data architecture.
Stay current with emerging trends and technologies in the big data and analytics space.
Qualifications
Bachelor's degree in Computer Science, Engineering, or a related field.
years of professional experience in big data processing and analytics.
Strong proficiency in Apache Spark with hands-on experience in either Scala or Python.
Experience with distributed computing and parallel processing.
Solid understanding of data structures, algorithms, and database systems.
Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their big data services.
Excellent problem-solving and communication skills.
Ability to work collaboratively in a fast-paced, agile environment.
Preferred Qualifications
Master's degree in a relevant field.
Experience with Spark SQL, Spark Streaming, and other Spark modules.
Knowledge of data warehousing and ETL processes.
Familiarity with containerization technologies (e.g., Docker, Kubernetes).
Experience
Salary : $106,000 - $134,000