What are the responsibilities and job description for the GCP DATA ENGINEER position at Teknismart Solutions Inc.?
Job Title: GCP Data Engineer
Location: Dallas, TX (Hybrid)
Pay Term: W2 (H1B transfers welcome)
Experience: 6 to 10 years
Job Summary:
The GCP Data Engineer will be responsible for designing and implementing data models to optimize data storage and consumption.
Technical Skills:
Programming: Python, PySpark
Tools: Databricks Workflows, Databricks SQL
Cloud Platforms: Cloud Composer, Cloud Storage, Google Kubernetes Engine (GKE)
Other Skills: Risk Management, Structured Streaming, Delta Live Pipelines, Databricks CLI, Data Fusion, Databricks Unity Catalog Admin, Databricks Workspace Admin
Domain Skills: Payer
Technology: Cloud Data Integration and Migration
Roles & Responsibilities:
Develop and maintain data ingestion pipelines from a variety of technology sources, meeting diverse scheduling requirements.
Design and implement data models to ensure efficient data storage and retrieval.
Utilize tools and techniques such as SQL, Python, and data visualization libraries for data analysis.
Clean, prepare, and transform data for thorough analysis.
Conduct statistical analysis and modeling, and monitor production environments for efficiency.
Communicate insights and production trends to stakeholders, ensuring transparency and clarity.
Ensure the quality, integrity, and reliability of data, providing regular status updates.
Collaborate with infrastructure teams to manage and configure Kubernetes clusters, set up CI/CD pipelines, and ensure the scalability and performance of the infrastructure.
Design, build, test, and deploy data access logic and solutions.