What are the responsibilities and job description for the Pyspark Developer position at Best High Technologies?
Job Description
We are looking for 10 years of experienced candidates with strong Pyspark, and Scala experience.
Immediate interview for the candidates with Pyspark, Python, and Scala experience.
Primary Skill:
- Pyspark
- Python
- Scala
Responsibilities:
- Design and implement data processing pipelines using PySpark
- Develop and maintain PySpark applications and jobs for batch and stream processing of data
- Optimize and tune PySpark code for performance and scalability
- Collaborate with data scientists, data engineers, and other stakeholders to design and implement data solutions
- Troubleshoot and debug PySpark code as needed
- Develop and maintain unit tests and integration tests for PySpark code
- Stay up to date with the latest trends and developments in PySpark and Big Data technologies
Salary : $40 - $80
BE developer
Micro1 -
New York, NY
Android Developer
Pyramid Consulting, Inc -
New York, NY
Android Developer
Net2Source Inc. -
New York, NY