Senior Data Engineer

Are you interested in working with an innovative group of technologists that includes backend, frontend, full-stack, and data engineers?

In this role you will build products which sit atop cloud-based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions.

Requirements

• Steward data and compute environments to facilitate usage of data assets
  

• Design, build, test and deploy scalable and reusable systems that handle large amounts of data
  

• Manage a small team of developers
  

• Perform code reviews and provide leadership and guidance to junior developers
  

• Learn and teach new technologies
  

Qualifications:

• BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience (You've learned something to be able to claim you are an engineer)
  

• Significant experience with Python, C , or other popular language
  

• Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive metastore or Glue or something similar.
  

• Experience working with relational databases.
  

• Experience with Hadoop, Hive, Spark, or other data processing tools
  

• Experience building scalable data pipelines (Airflow experience a plus)
  

• Significant experience working with AWS and/or GCP
  

• Experience designing and managing data flows
  

• Experience designing systems and APIs to integrate data into applications
  

• 8 years of Linux, Bash, Python, and SQL experience
  

• 4 years using Spark and other Hadoop ecosystem software
  

• 4 years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift
  

• 4 years managing team of developers
  

• Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges
  

Benefits

• Compensation Range: $119,000 to $170,000 . This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on relevant experience, other job-related qualifications/skills, and geographic location (to account for comparative cost of living). The Company reserves the right to modify this pay range at any time. 
  

• For this role, Benefits include: health/vision/dental insurance, 401(k), Healthcare Flexible Spending Account, Dependence Care Flexible Spending Account, vacation, sick, personal days, paid parental leave, paid medical leave, and STD/LTD insurance benefits.
  

Perks

• Generous PTO that includes vacation days, personal days, a fantastic Summer Friday program and extended time off around the holiday season.
  

• We have the backing and resources of a global billion-dollar company, but also have the flexibility and pace of a “startup” - we move fast, break things, and innovate.
  

If that sounds like you and you’re excited by the idea of joining a world-class team that’s passionate about growing together, we look forward to hearing from you. Apply Now!

-------------------------------------------------------------------------------------------------

Meet Pyxai

Screening and Recruiting Company - 11-50 employees

Pyxai (pronounced picks-eye) is an innovative technology company focused on bringing the transferable skills (soft skills) of job candidates to the forefront of the hiring process. Resumes do a great job at listing education and experience, but how does anyone knows how well a job candidate communicates, how great they problem solve, or even how flexible they are?  At the top of the hiring funnel, these are unknowns and they shouldn’t be. Research shows these skills truly hold the key to career success across all industries. 

Really think about it.  If you’re a genius at your job, but you can’t communicate well with others, how would that impact you at your job? Here’s a clue: misunderstandings or no communication at all creates conflict with others due to misalignments in expectations. Bottom line, poor soft skills lead to inefficiencies and conflicts at work (and in personal life too!).

With this in mind, Pyxai specializes in qualifying hard skills and screening for the soft skills most applicable to the role. We do this via our proprietary Video Interviewing technology. We focus on Operation-related jobs from Entry-level roles to Director-level roles. Our hope is to build long-lasting partnerships by providing clients and candidates with powerful data, great service, and valuable information to empower their searches.