Senior Data Engineer

Title: Senior Data Engineer

Location:

Job Type: Full-Time

About Us: Logic Hire Software Solutions is an innovative data-centric organization committed to leveraging advanced analytics and data engineering practices to inform strategic business decisions and improve client engagement. We are seeking a seasoned Senior Data Engineer to join our team and contribute to the optimization and expansion of our data infrastructures.

Job Description

We are in search of a highly proficient Senior Data Engineer with over 8 years of hands-on experience in architecting and maintaining data infrastructure. The ideal candidate will possess extensive expertise in leveraging the Google Cloud Platform (GCP) and the BigQuery ecosystem, alongside strong commands in SQL, SSIS (SQL Server Integration Services), SSRS (SQL Server Reporting Services), and Python. This role necessitates a combined technical acumen and strong interpersonal skills to successfully engage with business units while supporting the overall project lifecycle.

Key Responsibilities

• Architect, implement, and maintain high-performance data pipelines utilizing GCP services, particularly BigQuery, Cloud Storage, Cloud Functions, and Dataflow, ensuring optimal data flow and accessibility.
• Design and write highly efficient, scalable SQL queries, including complex joins, CTEs, and aggregations, to enable robust data analysis and reporting across multiple operational facets.
• Develop ETL (Extract, Transform, Load) processes using SSIS for operational data integration and leverage SSRS for generating executive-level reporting and analytics dashboards.
• Employ Python to create production-quality scripts and applications for data ingestion, transformation, and visualization, utilizing libraries such as Pandas, NumPy, or Apache Airflow for orchestrating workflows.
• Engage with cross-functional teams to elicit, document, and analyze business requirements, subsequently translating these into comprehensive technical specifications, data models, and workflows.
• Implement and uphold data governance frameworks to ensure data integrity, quality control, and security protocols across all data engineering processes.
• Monitor data pipelines and system performance metrics, identifying bottlenecks and implementing solutions to optimize throughput and minimize downtime.
• Provide analytical insights and recommendations to project and client management, facilitating data-driven decision-making.
• Mentor junior data engineering staff, cultivating an environment of knowledge sharing and professional development.
• Stay abreast of latest trends in data engineering technologies, tools, and methodologies to continually refine our data practices.
  
  

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related discipline; a Master’s degree is highly desirable.
• A minimum of 8 years of experience in the field of data engineering, particularly within GCP and the BigQuery architecture.
• Profound experience in formulating and executing complex SQL queries and a solid understanding of relational database design principles.
• Advanced proficiency with SSIS for ETL processes and SSRS for business intelligence reporting.
• Strong programming skills in Python, with a focus on data manipulation and the development of scalable ETL solutions.
• Demonstrated ability in constructing, deploying, and maintaining data engineering pipelines utilizing modern best practices.
• Strong verbal and written communication skills, complemented by an ability to liaise effectively between technical teams and business stakeholders.
• Exceptional analytical and problem-solving capabilities, with a proactive approach towards diagnosing and resolving issues.
• Working knowledge of data governance principles, compliance with data privacy regulations, and industry best practices.
  
  

Preferred Skills

• Familiarity with additional GCP services such as Cloud Dataflow for stream/batch processing, Dataproc for managing Hadoop/Spark clusters, or Pub/Sub for messaging services.
• Understanding of machine learning concepts and frameworks (e.g., TensorFlow, scikit-learn) to integrate predictive analytics within data solutions.
• Experience working within Agile environments and proficiency with project management tools (e.g., JIRA, Trello).
  
  

What We Offer

• A competitive salary and comprehensive benefits package.
• Opportunities for continued professional development and advancement within a cutting-edge environment.
• A collaborative workspace that encourages innovation and creativity.
• Flexible working options to support work-life balance.
  
  

If you possess the expertise and are eager to advance your career by driving impactful data initiatives at Logic Hire we invite you to apply. Please submit your resume and a cover letter detailing your relevant qualifications and accomplishments.

Communication in English should be proficent.

Skills: data visualization,data integrity,pipelines,analytics,data engineering methodologies,problem-solving,pandas,data engineering,project management,data pipelines,sql,apache airflow,security protocols,reporting,data quality control,bigquery,business intelligence reporting,cloud,google cloud platform (gcp),ssis,ssrs,data governance,data governance frameworks,business requirements analysis,workflow management,relational database design,gcp,data analysis,cloud storage,data modeling,data reporting,python,dataflow,data engineering technologies,etl,data security,cloud functions,agile methodologies,data,technical specifications,numpy