What are the responsibilities and job description for the Senior Data Engineer position at hc1?
Summary:
The Senior Data Engineer will be a critical team member in designing, implementing, and documenting complex application integrations within the hc1 platform. This role reports to the VP of Data Engineering. This role requires the individual to be very methodical and have strong coding and troubleshooting skills. As a senior data engineer you should be comfortable mentoring junior engineers and working under minimal supervision. If you want to work in a fast moving environment and love to stay current with technology, then we want to hear from you!
What you’ll do:
- Design, develop, and maintain data pipelines, ETL processes, data integration and ML workflows
- Collaborate with cross-functional teams to gather data requirements and ensure data quality and integrity throughout the data lifecycle
- Optimize database performance, conduct tuning, and identify areas for improvement to enhance overall system efficiency
- Work with application owners and developers to support development efforts
What you bring:
- A bachelor’s degree in Computer Science or equivalent work experience
- Proven experience as a Data Engineer, working with AWS, Spark and Snowflake databases
- 4 years experience in Data Platform Administration, Engineering, or related field
- Experience in performing database monitoring, maintenance, reorganizations, resource management, schema management, and capacity
- Experience with modeling business requirements
- Knowledge of AWS infrastructure including EMR, Aurora, Glue and Kinesis
- Knowledge with writing code in Python or similar scripting language
- Experience with dbt and machine learning libraries
- Some full stack experience a plus
Tech Stack You Will Be Using:
- Python
- JavaScript
- Snowflake
- AWS Data Processes
- Linux
- MySQL
- PostgreSQL