What are the responsibilities and job description for the Data Engineer position at ITVISION360 Inc?
Job Description
Responsibilities include:
- Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse
- Design and implement data quality pipelines to ensure data correctness and building trusted data sets
- Design and implement a Data Lakehouse solution which accurately reflects business operations
- Assist with data platform performance tuning and physical data model support including partitioning and compaction
- Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives
Qualifications
- 5 years of experience as a Data Engineer designing and maintaining data pipeline architectures
- Expert knowledge of ANSI SQL, PLSQL, TSQL, and Python
- Experience in various data integration patterns including ETL, ELT, Pub/Sub, and Change Data Capture
- Experience in data management practices including data catalog, data lineage, and master data management
- Experience in business analysis and defining business performance metrics
- Experience in software development practices such as Design Principles and Patterns, Testing, CI/CD, and version control
- Experience in implementing a Data Lakehouse using Apache Iceberg or Delta Lake
- Knowledgeable of common data visualization tools such as Power BI and Tibco Spotfire
- Experience with Dremio is preferred
Staff Civil Structural Engineer
CHEMICAL & INDUSTRIAL ENGINEER -
Spring, TX
Civil Structural Engineer
CHEMICAL & INDUSTRIAL ENGINEER -
Spring, TX
Employee Experience Services Training Coordinator
Office of the County Engineer -
Houston, TX