What are the responsibilities and job description for the Data Engineer position at Ideaon?
Requires the assistance of contract resources to serve as Data Engineers. The primary purpose of these positions is to analyze, map, build, test, and maintain database pipeline architectures using Oracle and DB2 for Child Welfare Data Conversion efforts as the legacy system migrates to Salesforce. The work involves collaborating with various stakeholders to understand business requirements and translating them into efficient and scalable technical solutions for the Child Welfare program.
The persons in this position will play a crucial role in designing, implementing, and optimizing data pipelines and ETL processes to support the extraction, transformation, and loading of data from various Child Welfare sources into Salesforce. They will collaborate with cross-functional teams to understand data requirements and translate them into technical solutions. The data engineers will need excellent problem-solving skills and the ability to work independently as well as part of a team. The work involves developing and maintaining data models, schemas, and databases to support data conversion needs. The work also involves monitoring and troubleshooting data pipelines to ensure data quality, completeness, integrity, and availability. This position will be implementing best practices for data governance, security, and compliance to ensure regulatory requirements are met.
Responsibilities and Duties:
- Analyze, Map, Build, Test, and Maintain database pipeline architectures using Oracle and DB2
- Collaborate with SMEs to understand and execute data conversion objectives that transforms, masks, and loads data into Salesforce objects
- Create and maintain table schemas
- Create new data validation methods to ensure data accuracy, completeness, and cleanliness
- Ensure compliance with data governance and security policies
