What are the responsibilities and job description for the Data Engineer position at Amazech Solutions?
Job Description: Data Engineer
Location: Irving, TX - Hybrid
Rates - $65/HR C2C
Key Responsibilities:
Create and maintain optimal data pipeline architecture.
Assemble large, complex data sets that meet functional and non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Manage and support data engineering platform tools using technologies such as Microsoft SQL Server, SSMS, SSIS, REST APIs, and Azure Cloud Platform to move data from various heterogeneous data sources (flat files, Excel, Oracle, SQL Server, XML, XSL files, JSON files).
Design and develop a robust data engineering infrastructure to support optimal extraction, transformation, and loading (ETL) of data from diverse sources, utilizing SQL, Microsoft Azure, AWS, and advanced big data technologies.
Develop and perform unit tests; maintain up-to-date code in source control.
Collaborate on code reviews and adhere to change management processes to deploy changes to production systems.
Troubleshoot issues reported by users and perform root cause analysis for production issues with minimal guidance.
Participate in on-call rotation to provide support and implement fixes as needed.
Continuously learn about the business and the data that supports it.
Adhere to company policies and procedures, including but not limited to Compliance (UDAAP, BSA/AML, etc.), Information Technology, employee handbook, etc.
Perform other duties as assigned.
Key Qualifications:
Highly skilled Data Engineer with over 8 years of experience.
Proficiency in T-SQL, Stored Procedures, Functions, and SSIS.
Capability to implement REST APIs.
Experience with cloud data platforms such as Microsoft Azure and Microsoft Fabric.
Advanced SQL knowledge and experience with relational databases and query authoring.
Familiarity with a variety of databases.
Expertise in building and optimizing big data pipelines, architectures, and data sets.
Strong analytic skills for working with unstructured and semi-structured datasets.
Experience in root cause analysis on internal and external data and processes.
Proven ability to build processes supporting data transformation, data structures, metadata, dependency, and workload management.
Successful history of manipulating, processing, and extracting value from large, disconnected datasets.
Experience supporting and working with cross-functional teams in a dynamic environment.
Proficiency in unit testing, data quality validation, and data analysis.
Knowledge of cloud data and platform security, with a preference for AWS and Azure.
Salary : $64 - $65
