What are the responsibilities and job description for the Big Data Engineer position at SGS Consulting?
Job Description
This job designs and engineers solutions associated with analytic data for the organization and, working closely with the business, analytic and IT teams, assists with the build and upkeep for these solutions. This includes coding data ingestion, transformation, and delivery programs/locic for analysts to access operational, derived, and external data sets. Expected deliverables will include coding of delivery frameworks to load and transform raw source data into enhanced analytic assets, being a key resource for analytical and big data efforts, working with architects, analysts and data scientists as needed. The incumbent is responsible for the operation and execution of projects related to Big Data or other analytic platforms. Leverages experience in analyzing and delivering large data sets by using a variety of delivery tools to perform tasks. Works in cross-functional teams from different organizations (both technical and non-technical) on projects. Provides guidance and education to Seniors and Intermediate level staff. Responsible for maintaining customer relationships. Technologies such as, but not limited to: Hadoop, Hive, NoSQL, Spark, Python, SAS, Teradata, Oracle, Informatica.
- Work closely with IT, architect and engineer solutions that provide views for Enterprise Data Objects or other analytic ecosystems. This would include working with the appropriate teams, leading the design, and building out the design, and providing upkeep for the solution.
- Contribute to creating high performance Big Data (and traditional) systems to be used with analytic applications.
- Code, test, process, and maintain data resources for the analytics organizations. This will include working to maintain data sourcing, transformation, and delivery, for key analytic platforms throughout the organization. (ETL/ELT)
- Work with alternative analytic data systems to incorporate them into the operational data flow for the Analytics Teams.
- Work with data science teams and strategic partners on capabilities of core platform. This may include products purchased by the organization that must be ingested or modeled/derived data maintained by analytic teams.
- Contribute to large functional efforts for programs across multiple projects.
- Manage relationships with customers of the function. Attend meetings with customers on a stand-alone basis or with team as needed.
- Follow standards and patters for high performance data ingestion, transformation, and delivery of data analytic needs. Keep current with Big Data technologies in order to recommend best tools in order to perform current and future work.
- Other duties as assigned
Required:
- Bachelor's Degree in Computer Systems Analysis, Computer Engineering, Data Processing, Healthcare Informatics or Management Information Systems
Preferred:
- Master's Degree in Management Information Systems, Healthcare Informatics or Computer Engineering
Required
- 2 years in Data platform development, data engineering, software development, or data science
- 2 years in Big data or cloud data platform
Preferred
- 2 years in the Healthcare Industry
- 2 years in Data Warehousing
- 2 years in Database Administration
Preferred
- Cloud certification (Google Cloud Platform, Azure, AWS)
Required Skills:
- Demonstrated skills in SQL
- Data Warehousing
- Problem-Solving
- Communication Skills
- Analytical Skills
- Demonstrated skills in Spark or Python or related tool
- Demonstrated skills in Google Cloud Technologies
- Databricks
Salary : $50 - $60