What are the responsibilities and job description for the Data Engineer position at Plus?
Responsibilities
- Create and maintain optimal data pipeline architecture
- Build the infrastructure required for optimal extraction, transformation, and loading of data using SQL and big data technologies.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with stakeholders including the Executive, Engineering, and Operation teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data secure through multiple data centers and AWS regions.
Qualifications
- MS or PhD in CS, EE, mathematics, statistics or related field
- Advanced working SQL knowledge and experience working with relational databases, as well as working familiarity with a variety of databases.
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Experience with data pipeline and workflow management tools, e.g. Airflow
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Java, C , Scala, etc.
Perks
- Work on industry-leading technologies at an energetic, exciting Silicon Valley startup
- Forge the future of autonomous transportation while collaborating with AI experts from around the world
- Catered free lunch, unlimited snacks and beverages
- Competitive salary and outstanding benefits package
Senior Electrical Engineer- Mission Critical Data Center Program Lead
Mission Critical Data Center Program Lead - Tetra Tech Careers -
Santa Clara, CA
Data Engineer, Data Application
TikTok -
San Jose, CA
Data Engineer
Dew Software -
San Jose, CA