What are the responsibilities and job description for the Lead Big Data Engineer - Spark Expert position at Wells Fargo?
Wells Fargo is seeking a Lead Data Engineer who can bring their advanced Spark expertise to this unique role.
We need someone to build a Big Data Spark Center of Excellence within our Cyber Security Division.
No sponsorship is offered for this position.
You'll enjoy coming to a place that values your work and appreciates your contributions. Each day you'll feel energized and committed as you are surrounded and working with some of the brightest Big Data minds in the industry. Reporting to a supportive leader, you'll be exposed to career path and growth opportunities so you can continue your journey with us.
We are building something great here. Come build it with us!
In this role, you willLead complex initiatives with broad impact and act as key participant in large scale software planning for the Technology area
Design, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadership
Review and analyze complex software enhancement initiatives for business, operational or technical improvements that require in depth evaluation of multiple factors including intangibles or unprecedented factors
Make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change
Strategically collaborate and consult with internal partners to resolve highly risky data engineering challenges
Required Qualifications:
5 years' experience in data engineering including relevant experience working with Hadoop or Google Cloud data solutions: creating/supporting Spark based processing, Kafka streaming, data modeling, business partnerships, and teamwork
5 years experience translating business requirements to technical requirements
2 years working with NoSQL data bases (KV, columnar) including data modeling and data structures
Desired Qualifications:
Hands-on experience working with Cloud Data Services, preferably Google cloud and experience with data migration to cloud native environment
Deep understanding of data warehouse, data cloud architecture, building data pipelines, and orchestration
Experience building, maintaining, and enhancing data pipelines using Spark and Apache Airflow
Experience building Spark Streaming or Apache Flink
Public Cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics is a plus
Excellent Python and SQL skills (including hands on experience building data pipelines with SQL)
Ability to understand the interaction between data flows and business processes
Excellent Python and SQL skills (including hands on experience building data pipelines with SQL)
Strong self-starter with a resilient, solution minded approach to complex problems
We Value Diversity
At Wells Fargo, we believe in diversity, equity and inclusion in the workplace; accordingly, we welcome applications for employment from all qualified candidates, regardless of race, color, gender, national origin, religion, age, sexual orientation, gender identity, gender expression, genetic information, individuals with disabilities, pregnancy, marital status, status as a protected veteran or any other status protected by applicable law.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.
Candidates applying to job openings posted in US: All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.
We need someone to build a Big Data Spark Center of Excellence within our Cyber Security Division.
No sponsorship is offered for this position.
You'll enjoy coming to a place that values your work and appreciates your contributions. Each day you'll feel energized and committed as you are surrounded and working with some of the brightest Big Data minds in the industry. Reporting to a supportive leader, you'll be exposed to career path and growth opportunities so you can continue your journey with us.
We are building something great here. Come build it with us!
In this role, you willLead complex initiatives with broad impact and act as key participant in large scale software planning for the Technology area
Design, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadership
Review and analyze complex software enhancement initiatives for business, operational or technical improvements that require in depth evaluation of multiple factors including intangibles or unprecedented factors
Make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change
Strategically collaborate and consult with internal partners to resolve highly risky data engineering challenges
Required Qualifications:
5 years' experience in data engineering including relevant experience working with Hadoop or Google Cloud data solutions: creating/supporting Spark based processing, Kafka streaming, data modeling, business partnerships, and teamwork
5 years experience translating business requirements to technical requirements
2 years working with NoSQL data bases (KV, columnar) including data modeling and data structures
Desired Qualifications:
Hands-on experience working with Cloud Data Services, preferably Google cloud and experience with data migration to cloud native environment
Deep understanding of data warehouse, data cloud architecture, building data pipelines, and orchestration
Experience building, maintaining, and enhancing data pipelines using Spark and Apache Airflow
Experience building Spark Streaming or Apache Flink
Public Cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics is a plus
Excellent Python and SQL skills (including hands on experience building data pipelines with SQL)
Ability to understand the interaction between data flows and business processes
Excellent Python and SQL skills (including hands on experience building data pipelines with SQL)
Strong self-starter with a resilient, solution minded approach to complex problems
We Value Diversity
At Wells Fargo, we believe in diversity, equity and inclusion in the workplace; accordingly, we welcome applications for employment from all qualified candidates, regardless of race, color, gender, national origin, religion, age, sexual orientation, gender identity, gender expression, genetic information, individuals with disabilities, pregnancy, marital status, status as a protected veteran or any other status protected by applicable law.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.
Candidates applying to job openings posted in US: All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.
Lead Software Engineer - Big Data
JPMorgan Chase -
Jersey, NJ
Python Developer (Big Data - Spark/ Hadoop)
ICONMA -
Jersey, NJ
Sr Lead Software Engineer- Solutions Architect - AWS, Spark, Data Lake
JPMorgan Chase -
Jersey, NJ
