What are the responsibilities and job description for the Python Spark Developer position at Stellarwins?
Job Description
Spark/Python Developer
Mc Lean, VA
Job Description:
Develop, program, and maintain applications using the Apache Spark open-source framework!
Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.
Spark Developer must have strong programming skills in Java, Scala, or Python
Familiar with big data processing tools and techniques
Proven experience as a Spark Developer or a related role
Strong programming skills in Java, Scala, or Python
Familiarity with big data processing tools and techniques
Experience with the Hadoop ecosystem
Good understanding of distributed systems
Experience with streaming data platforms
Excellent analytical and problem-solving skills
Key Skills:
- Java SpringBoot with microservice architecture knowledge
- REST/GraphQL
- Mongo
- k8s (preferably EKS)
- TDD, ATDD
- Java/Python Spark
- AWS: s3, Lambda, Step Function, AMQ, SNS, SQS, CloudWatch Events
Salary : $40 - $50