What are the responsibilities and job description for the Data Pipeline Engineer position at Sensei Ag?
About Sensei Ag
At Sensei Ag, we align technology with the environment to protect and preserve natural resources while optimizing how we grow food. Merging agriculture and innovation to achieve sustainable farming practices allows us to grow delicious and fresh fruits and vegetables.
Learn more from our website or by following us on LinkedIn. If you'd like to see what we are doing with our consumer-facing brand Sensei Farms, please check our Instagram!
Position Description
The mission of the Data Insights group is to foster a data-driven organization by providing robust and organized data and supporting the wise use of data to gain insights and make decisions. This role, as part of the Data Insights group, supports the development of data processing pipelines for Sensei Ag. Day to day tasks would include daily monitoring of data processing, troubleshooting and debugging data processing tasks, and development of new data flows for existing platforms. This role will also provide basic support to the development of new data processing technologies including setup and administration of new tools and engineering support to new data software systems. The role offers multiple growth opportunities including work in data science, data visualization, and sensing/control systems. An ideal candidate will have a passion for helping build systems which will empower Sensei Ag to grow crops more efficiently and sustainably.
Responsibilities
- Collaborate with cross-functional teams to understand data requirements and help translate domain expertise into data products that meet business needs.
- Build scalable infrastructure that will enable data users to derive insights and build models faster and more efficiently than they can today.
- Design, build and maintain robust data pipelines and data processing systems.
- Implement data quality frameworks to ensure the accuracy and integrity of data.
- Optimize data storage and retrieval for efficient data access and analysis.
- Stay up-to-date with industry trends and emerging technologies in data engineering.
Minimum years of experience required
- 3 years of data and/or software engineering experience
Required Skills, Abilities and Qualifications
- Solid understanding of data engineering fundamentals (design patterns, common practices) and what it takes to build high-volume data products and services.
- Experience with Python, SQL, and Python data science libraries such as Pandas and PySpark.
- Strong proficiency in querying and manipulating large datasets using SQL and Python.
- Experience with cloud-based data technologies, such as OCI, AWS, Azure or GCP.
- Familiarity with efficient big data formats and an understanding of their tradeoffs.
- Familiarity with data modeling and database design principles.
- A natural curiosity for technologies and problem-solving.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Preferred Skills, Abilities and Qualifications
- Experience with developing ETL flows.
Educational Requirements
- Bachelor's degree in Computer or Data Science
Travel Requirement
- Up to 10% of the time.
Traits We Value
- Appreciation for transforming health and the future of food
- Smart, not arrogant
- Humble and hardworking
- Entrepreneurial, not risk averse
- Kind and genuine
- Grit and lots of it
FLSA Status
- Exempt
Compensation
- $95,000 - $140,000 per year
Benefits
- Comprehensive Medical Plans
- Prescription Drug Benefits
- Employee Wellness
- Dental Plan
- Vision Plan
- HSA/FSA
- Basic Life and AD&D
- Short and Long Term Disability
- Flexible Spending Accounts
- Employee Assistance Program (EAP)
- Travel Assistance Program
- Paid-Time Off
- 401K
NOTE: Residents of Hawaii, receive a Comprehensive Healthcare Bundle consisting of: Medical, Dental, Vision and Rx prescriptions, different from US Mainland plans/programs.
NOTE: This job description is not intended to be an exhaustive list of all duties, responsibilities or qualifications associated with the job. Other duties may be assigned.
Salary : $95,000 - $140,000
