Data Engineer

CTG is seeking to fill a Data Engineer opening for our client in Manassas, VA.

Location: Manassas, VA (1 day per week Onsite)

Duration: Permanent Placement

USC/GC Only

Overview:

We are seeking a Data Engineer for our growing data analytics practice. The candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal individual must have experience in data integration across multiple applications. He or she should also have experience in designing and developing ETL for data warehouse/data lakes. The Data Engineer will support our software developers, database architects, data analysts and data scientists on a variety of initiatives and will ensure optimal data delivery architecture being consistent throughout ongoing projects.

This position must work and think independently; duties of this position are to be completed under minimal guidance.  Discretion in handling assigned responsibilities, including the ability to resolve problems and exercise good judgment while maintaining confidentiality.  Functions are to be completed in a timely manner with acceptable quality.

Duties:

• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build data pipeline frameworks to automate high-volume and real-time data delivery to our cloud platform.
• Design and develop ETL solutions to move data from any source (relational, API, non-relational) to data warehouse/delta lakes.
• Have thorough knowledge of Data warehousing designs and have experience in designing conceptual and logical data models and flowcharts.
• Ability to write and maintain Spark and Python notebook in Azure for data integration and analysis.
• Apply modern cloud data modeling techniques to ensure development and implementation support efforts meet integration and performance expectations.
• Ability to Independently analyze data, solve, and correct issues in real time, providing problem resolution end-to-end.
• Coordinate with other IT teams and Client departments to identify future needs and requirements.
• Refine and automate regular processes, track issues, and document changes.
• Design, develop and maintain data services and/or pipelines as part of an Agile/Scrum team.
• Work with program management and engineers to implement and document complex and evolving requirements.
• Assist developers with complex query tuning and schema refinement.
• Share domain and technical expertise, providing technical mentorship and cross-training to other peers and team members.
• Perform multiple tasks simultaneously and successfully perform under changing requirements and deadlines.

Minimum Qualifications and Requirements:

• Bachelor's degree or equivalent experience and a minimum of eight (8) years’ experience in designing and developing data integration solutions.
• Expertise in SQL and Data warehousing concepts. Experience with modern cloud databases and services in Azure environment. This should include working with Azure synapse environment and also have knowledge of NoSQL databases specially Cosmos.
• Experience in designing and implementing ETL in Azure data integration tools (Azure data factory, Azure synapse pipelines, Spark notebooks).
• Experience in working on Delta Lake in Azure of data bricks environment and worked in implementing delta lake earlier.
• Knowledge to manage huge amounts on unstructured data from devices.
• Experience with Performance Tuning and Optimization (PTO), using native monitoring and troubleshooting tools.
• Leverage DevOps tool stack to build, inspect, deploy, test and promote new or updated features.
• Experience with reporting (e.g. SSRS, Business Objects, Cognos etc.) and data visualization tools (e.g. Power BI, Tableau)
• Self-starter, motivated and takes initiative; strong interpersonal and problem-solving skills; able to work collaboratively with all levels of staff to resolve problems to maximize performance, creativity, problem solving and results.
• Seek, learn, and apply new skills/knowledge to perform job responsibilities.
• Attentive to detail with a high level of accuracy; exercise sound judgment.
• Resourceful, diplomatic, and professional; deliver outstanding customer service while managing relationships; a can-do attitude and work style that supports teamwork, collaboration and positive relationships.
• Adaptable; be able to shift priorities and focus as departmental and/or business demands change (including, but not limited to early/late hours and/or weekend hours).
• Strong analytical skills and organized; completes tasks ahead of schedule.
• Excellent written and verbal communication skills, including excellent listening skills to communicate clearly, concisely and effectively.
• Position-relevant computer experience including Microsoft Office.
• Follow all company safety practices, Standard Operating Procedures (SOP’s) and policies.

Preferred Qualifications:

• Experience working with or for Federal Contractors.
• Experience in Manufacturing.

Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.

CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee based recruitment services for this role.

To Apply:

To be considered, please apply directly to this requisition using the link provided. For additional information, please contact Anisha Muralidhar at Anisha.Muralidhar@ctg.com. Kindly forward this to any other interested parties. Thank you!