Senior Data Engineer

Zonteq
Austin, TX Other
POSTED ON 8/24/2023 CLOSED ON 9/6/2023

What are the responsibilities and job description for the Senior Data Engineer position at Zonteq?

Job Description

The Role:

We are seeking a Senior Data Engineer to join our team and contribute to the E2E (End to End) Data Quality Framework initiative within the FVD (Fix Vehicle Data) domain. The successful candidate will play a crucial role in addressing pain points related to data capture, data quality (completeness, accuracy, and consistency), and data lineage within the OnStar Transformation Fix Vehicle Data initiative. The candidate will work closely with cross-functional teams to ensure the delivery of high-quality vehicle data from the back office to various stages such as Vehicle Communication Services, Vehicle Data Factory, Vehicle External Data Consumption, Telematics 360, and outbound to Azure and customers.
 

What You'll Do:

  • Focus on addressing data capture issues before data collection and delivery.
  • Provide insights into potential data capture issues and facilitate proactive resolution.
  • Implement DQ rule engine solutions using Spark/Scala in Azurefor real-time streaming and micro-batch processing.
  • Evaluate and assess the suitability of the Spark/Scalasolution, considering factors such as scalability and ease of implementation.
  • Collaborate with the business partners to analyze their existing solution and enhance it to meet specific needs.
  • Build and maintain monitoring dashboards for tracking latency and ensuring efficient data transformation.
  • Develop a tool to trace data lineage throughout the data pipeline.
  • Enable visibility into source-to-target mapping throughout the data pipeline. .
  • Collaborate with cross-functional teams to ensure effective monitoring and notification mechanisms.

Your Skills & Abilities (Required Qualifications):

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
  • Strong experience as a Senior Developer with expertise in data quality frameworks and pipeline architectures.
  • Proficiency in programming languages such as Scala, Python, Java, and SQL.
  • Hands-on experience with Spark and Scala for real-time streaming and micro-batch processing.
  • Knowledge of data governance, data cataloging, and data lineage concepts.
  • Experience with Azure (preferred) or AWS cloud platform for data processing and storage.
  • Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
  • Strong communication skills to effectively collaborate with cross-functional teams and stakeholders.

(Preferred Qualifications):

  • Azure Certification: AZ-204 Azure Developer Associate
  • Azure Certification: DP-203 Data Engineer 

 

Salary : $60 - $70

Senior Data Engineer
MNTN -
Austin, TX
Senior Data Engineer
Vectra -
Austin, TX
Senior Data Analyst/Engineer
ISmile Technologies -
Austin, TX

For Employer
Looking for Real-time Job Posting Salary Data?
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

Sign up to receive alerts about other jobs with skills like those required for the Senior Data Engineer.

Click the checkbox next to the jobs that you are interested in.

  • Bug/Defect Analysis Skill

    • Income Estimation: $100,668 - $129,964
    • Income Estimation: $102,328 - $137,582
  • Debugging Skill

    • Income Estimation: $94,373 - $127,234
    • Income Estimation: $100,668 - $129,964
This job has expired.
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other Senior Data Engineer jobs in the Austin, TX area that may be a better fit.

Senior Data Engineer

Aypa Power, Austin, TX

Senior Data Engineer

Oracle, Austin, TX