Data Architect

Position Summary
At Effectual, Data engineers are responsible for designing, building, and maintaining datasets that can be leveraged in data projects. As such, they closely work with both data scientists, data architects, and data governance professionals. Data engineers design, implement and maintain modern data pipelines.  As such we are looking for a Sr. Databricks Engineer that is invested in MLOPS as their overarching mission.

Typical projects focus on areas such as:

• Building Modern Data Pipelines
• Raw Data Source Intake and ETL Methods
• Feature Engineering
• Change and Test Models
• Deploy of Analytics

Why Join Effectual?
Effectual is a modern, cloud first managed and professional services company that works with commercial enterprises and the public sector to mitigate their risk and enable IT modernization. We are a deeply experienced and passionate team of problem solvers who apply proven methodologies to business challenges across Amazon Web Services and VMware Cloud on AWS. Effectual was named VMware Cloud on AWS Growth Partner of the Year by AWS at re:Invent 2021. The company earned Cloud Service Provider of the Year at the Channel Innovation Awards 2021.

Effectual is a validated AWS MSP Partner, holding 200 AWS Certifications. We achieved the AWS Migration Competency, AWS DevOps Competency, AWS Mobile Competency, AWS SaaS Competency, and AWS Government and AWS Nonprofit Competency designations. Effectual is a member of the AWS Well-Architected and AWS Public Sector Partner Programs as well as the AWS GovCloud (US) and Authority to Operate on AWS Programs. Additionally, Effectual is a VMware Principal Partner in VMware Cloud on AWS.
Employees at Effectual experience a fun, fast paced, and inclusive culture. We cloud strategy & design, application development, migrations, data & analytics and modern cloud management means you may never have to leave the company if you want to learn more and try something new. Additionally, we offer medical, dental, vision, pet, and life insurances as well as paid time off, 14 holidays and a 401k with company match. Consider joining our team today!

Essential Duties and Responsibilities

Essential functions include, but are not limited to the following:

• Construct, deploy, test, and maintain data architectures and pipelines within the Databricks including but not limited to (Delta Lake and Unity Catalog) and AWS ecosystems.       
• Analyze and organize raw data.     
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Databricks, AWS 'big data' technologies, and SQL.     
• Develop code and script for data architects, data scientists, and data quality engineers.       
• Perform data acquisition.  
• Develop data-set processes.
• Identify ways to improve data reliability, efficiency, and quality.
• Prepare data for prescriptive and predictive modeling.  
• Automate the data collection and analysis processes, data releasing, and reporting tools.       
• Build algorithms and prototypes.
• Develop analytical tools and programs.      
• Collaborate with data scientists and architects. 

Essential Skills and Experience

• Must have 5 years' experience with Databricks, AWS, SQL, RDS, NoSQL, database design, programming languages (Scala and/or Python).
• Advanced knowledge and technical proficiency with ETL, cloud-based data warehousing, and Apache Spark.
• Strong knowledge of AWS-specific services, including Lake Formation, Amazon Aurora, Amazon Data Pipeline, Amazon Athena, Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Database Migration Services, and Amazon Redshift.
• Familiarity and understanding of Common Data Engineering tools like: Apache Spark, Apache Airflow, Apache Lite, Apache Kafka, dbt, great_expectations·
• A strong desire to use a framework of the “Analytics Hierarchy of needs”:
• Collect/Clean/Define & Track/Analyze/Optimize & Predict
• Strong verbal and written communication skills, with the ability to work effectively across internal and external organizations.
• Demonstrated ability to think strategically about business, product, and technical challenges. 
• • The Databricks Certified Data Engineer Associate or The Databricks Certified Data Engineer Professional (Pro is preferred)
  And
  • AWS Platform Architect Speciality

Salary Range

• $130,000 -$180,000 

Company Offered Benefits

• Full-time employees are eligible to participate in our employee benefit programs:
• Medical, dental, and vision health insurances,
• Short term disability, long term disability and life insurances,
• 401k with Company match
• Paid time off (PTO) (120 hours PTO that accrue over one year)
• Paid time off for major holidays (14 days per year)
• These and any other employee benefit offerings are subject to management discretion and may change at any time. 

Physical Demands and Work Environment
The work is generally performed in an office environment. Physical demands include sitting, keyboarding, verbal communication, written communication. Employee is occasionally required to stand; walk; reach with hands and arms; climb or balance; and stoop, kneel, crouch, or crawl.
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this position. Reasonable accommodations may be made to enable individuals with disabilities to perform the functions.

Additional Duties
This job description may not be inclusive of all assigned duties, responsibilities, or aspects of the job described and may be amended at any time at the sole discretion of the Employer. Duties and responsibilities are subject to possible modification to reasonably accommodate individuals with disabilities. To perform this job successfully, the incumbents will possess the skills, aptitudes, and abilities to perform each duty proficiently.
This document does not create an employment contract, implied or otherwise, other than at “at will” relationship.
Effectual, Inc. is an EEO employer and does not discriminate on the basis of any protected classification in its hiring, promoting, or any other job-related opportunity.

Salary : $130,000 - $180,000