What are the responsibilities and job description for the Data Engineer position at SN Cloud Solutions?
Job Details
Title: Data Engineer
Duration: Fulltime
Location: Houston, TX (Hybrid)
Job DescriptionThe data engineer will be responsible for designing, building, and maintaining enterprise data warehouse, ensuring data quality, and supporting data lake and surrounding technology ecosystem, including MDM, ELT , Data Security and Data Catalog.
Domain: Financial Services - Banking
Key responsibilities and expected output : (Clearly state the what the candidate is expected to deliver)
Design, build, and maintain data architectures, pipelines, and ETL processes to ensure efficient and reliable data ingestion, processing, and storage.
Develop and maintain data models, schema, and metadata to enable effective data analysis.
Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and ensure data quality.
Implement data validation and cleansing processes to ensure data accuracy and consistency as required.
Monitor and troubleshoot data pipelines to ensure that they are running smoothly and efficiently.
Keep up to date with the latest data engineering trends and technologies and apply them as appropriate
Required tech stack and other related details:
10 years relevant experience
Strong experience in data modeling, data integration, and data management
Experience with distributed computing frameworks such as Hadoop and Spark
Experience with cloud data technologies e.g. Google Cloud Platform, Dataproc, Big query. Airflow , Snowflake , Data Factory
Strong programming skills in languages such as Python, Java, or Scala
Strong experience with SQL and database management systems
Good to have tech stack and other related details:
Experience on Git, Azure DevOps
Any other information considered critical / Useful": (any detail that can be a game changer / will make our candidate most preferred ).
EXPERTISE IN DIMENSIONAL MODELING AT LARGE ENTERPSIES.
Write complex queries and Stored Procedures
Build Data pipelines and framework for a scalable solution to support the dynamic cloud environment.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Staff Civil Structural Engineer
CHEMICAL & INDUSTRIAL ENGINEER -
Spring, TX
Civil Structural Engineer
CHEMICAL & INDUSTRIAL ENGINEER -
Spring, TX
Employee Experience Services Training Coordinator
Office of the County Engineer -
Houston, TX
