What are the responsibilities and job description for the Data Engineer I position at Consumers Energy?
This is a contract role through Magnit for an American energy company based in Jackson, Michigan. This is a remote role with preference for a candidate to live in or near Jackson, MI so can report to the office on occasion as needed.
Job Title: Data Engineer I
As a Data Engineer, your role involves designing, implementing, monitoring, and maintaining data and analytical solutions both on-premise and on Microsoft Azure.
- Data Pipeline Design and Implementation:
- Create and maintain data pipelines that facilitate data movement, transformation, and integration.
- Ensure efficient and reliable data flow from source systems to target destinations.
- Data Storage Solutions:
- Design and manage data storage solutions, including:
- Azure Data Lake: Storing large volumes of raw data.
- Azure SQL Database: Providing structured data storage.
- Azure Blob Storage: Handling unstructured data.
- Relational Databases: SingleStore, Microsoft SQL Server, Oracle
- Data Processing and Transformation:
- Use tools like Databricks and dbt to process and transform data.
- Leverage Azure Databricks, on-premise solutions, or Data Orchestration tools for running data transformations in production
- Data Integration:
- Collaborate with data analysts and scientists to understand data requirements.
- Design effective data workflows that enable data-driven decision-making.
- Performance Optimization:
- Optimize SQL queries for better performance.
- Ensure consistency between development and production environments.
- Security and Compliance:
- Implement secure and compliant data processing pipelines.
- Use Azure services and frameworks to produce cleansed and enhanced datasets for analysis
Requirements:
- Microsfot Azure, Azure Databricks, and DBT
- Knowledge of data catalog tools (e.g., Microsoft Purview)
- Proficiency in data processing languages, including SQL and Python
- Familiarity with Data Orchestration Tools
- Excellent problem-solving skills and ability to work in a collaborative environment
- Experience as a Data Engineer or similar role.
Education:
- Bachelor’s degree in Computer Science, Engineering, or related field.
Hourly Pay Rate Range (dependent on location, experience, expectation)
The pay range that Magnit reasonably expects to pay for this position is: $35-42/hr
Benefits: Medical, Dental, Vision, 401K (provided minimum eligibility hours are met)
All qualified applicants will not be discriminated against and will receive consideration for employment without regard to protected veteran status, disability, race, color, religion, sex, age, sexual orientation, gender identity or national origin.
Salary : $35
