What are the responsibilities and job description for the Python Developer position at Covetus?
Job Title: Python spark
Location: Columbus, OH– ( 3 day onsite per week)
Experience: 9 Year
Job details:
Responsibilities:
- Develop and maintain data platforms using Python, Spark, and PySpark.
- Handle migration to PySpark on AWS.
- Design and implement data pipelines.
- Work with AWS and Big Data.
- Produce unit tests for Spark transformations and helper methods.
- Create Scala/Spark jobs for data transformation and aggregation.
- Write Scaladoc-style documentation for code.
- Optimize Spark queries for performance.
- Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
- Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).
Skills:
- Proficiency in Python, Scala (with a focus on functional programming), and Spark.
- Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.
- Experience working with HDFS, S3, Cassandra, and/or DynamoDB.
- Deep understanding of distributed systems.
- Experience with building or maintaining cloud-native applications.
- Familiarity with serverless approaches using AWS Lambda is a plus
Python Developer
SynergisticIT -
Columbus, OH
AWS Python Developer
Conch Technologies, Inc -
Columbus, OH
C# / Node.js / Python Developer
Steneral Consulting -
Columbus, OH
