Data Engineer

Data Engineer - Onsite

Location: Quantum Office NJ, (Need to go Client location 2 days a week)

W2 Only

Required Exp: 12

Job Description:

We are seeking a highly skilled and motivated Data Engineer to join our clinical operations data team. As a Data Engineer, you will be primarily responsible for designing and developing data transformations and data models to ensure reliable and efficient data processing and analysis. You will work closely with cross-functional teams to support data-driven decision-making processes and contribute to the overall success of our insights teams.

Key Responsibilities:

1. Data Modeling and Development:

• Design and implement robust data models using DBT.
• Write and maintain data models, tests, and macros to ensure data quality and integrity.

1. Database Management:

• Optimize queries and models for Snowflake to ensure high performance and scalability.
• Debug and troubleshoot slow-performing queries to improve overall system efficiency.

1. Development Best Practices:

• Adhere to and promote development best practices, including version control using Git and branching models.
• Code review to ensure consistent coding standards and practices.

1. Collaboration and Communication:

• Utilize collaboration tools like Jira and Confluence to document processes, track tasks, and share knowledge.
• Participate in scrum methodology, including daily stand-ups, sprint planning, and retrospectives.
• Communicate effectively with team members and stakeholders to understand requirements and provide updates.

1. Independent Work and Problem-Solving:

• Take ownership of assigned tasks and work independently to complete them.
• Proactively seek help and clarification when needed to ensure task completion.
• Continuously improve and innovate data processes to enhance overall efficiency and effectiveness.

1. Quality Assurance:

• Maintain a high drive for quality in all data engineering tasks.
• Ensure all data transformations and models adhere to rigorous quality standards.

Qualifications:

• Proficient in SQL with a strong understanding of database concepts and optimization techniques.
• Proficient in DBT with experience in writing models, tests, and macros.
• Good knowledge of Snowflake, including query optimization and troubleshooting.
• Familiarity with development best practices, version control (Git), and branching models.
• Experience with collaboration tools like Jira and Confluence.
• Comfortable working in a scrum methodology and participating in agile ceremonies.
• Strong problem-solving skills and ability to work independently.
• Excellent communication and collaboration skills.
• High drive for quality and attention to detail in data engineering tasks.

Preferred Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Experience in data engineering or a related role.
• Familiarity with cloud-based data platforms and services.
• Domain knowledge of clinical operational data and the pharmaceutical industry.
• Proficiency in Python and Airflow for data engineering and automation tasks.
• If you are a passionate Data Engineer with a commitment to excellence and a desire to work in a collaborative and innovative environment, we would love to hear from you. Apply today and join our team in driving data-driven success!