Cloud Big Data Engineer @ Visa - Foster City, CA

Job Overview

2 days ago

Cloud Big Data Engineer

Visa - Foster City, CA

Company Description


Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you join a culture of purpose and belonging – where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world – helping unlock financial access to enable the future of money movement.

Join Visa: A Network Working for Everyone.


Job Description


Cybersecurity is at the beating heart of our culture. Our diligence and expertise is what makes us the undisputed leader in electronic payments. We’ve made it our priority to create a top-tier Security Architecture team, poised to defend us against any potential cyber threats. CyberSecurity Architecture team is looking for a Data Engineer worked on on prem data lake like Hadoop and migrating to cloud experience. Candidate will be a part of the Visa Security Analytics Engineering team and involved with administering data ingestion via Kafka streaming and performing Data parsing by developing data parsers for Data Engineering activities. The position will be based at Visa's headquarters in Foster City, California.

The successful candidate will be working on cutting-edge technologies to perform statistical profiling, inference, classification, clustering and predictive analysis. As a key member of the Data Engineering team, you will be working on large datasets of Security Data and implement Data mining, Data parsing contributing to data availability building machine learning models to help derive new insights to defend against cyber-attacks.

You will be working with world-class operation teams including Cyber Defense team and Data Science team to create awesome analytics for security and other business units. You'll need to have excellent communication and cross-group collaboration skills, be able to make forward progress despite ambiguous circumstances, be a self-starter, a quick learner of new technologies and have experience in Data engineering to maintain DataQuality and Integrity.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office two days a week, Tuesdays and Wednesdays with a general guidepost of being in the office 50% of the time based on business needs.


Qualifications

Basic Qualifications:

Preferred Qualifications
  • 3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)
  • 4+ years in Spark, Scala, Python, Java, and Unix to filter/cleanse/map/aggregate data is a must.
  • 2+ years' experience in one or more of the following: Kafka, Spark streaming, Sqoop, Oozie, Airflow, Control-M, Presto.
  • 2+ years' experience in one or more of the following: SQL, NOSQL, MongoDB or Cassandra.
  • Experience in migrating from On Prem Hadoop to Cloud (Azure/AWS/GCP/Databricks) is required.
  • Ability to communicate complex technology solutions to clients, technical, business and management teams
  • Proficiency in languages including, but not limited, to Java, Scala, Python, JavaScript, HTML.
  • Experience with authoring utilities / automation tools using, Java, Python, Groovy, and more.
  • Experience with highly distributed, scalable, concurrent, and low latency systems working with one or more of the following technologies: Druid, Elastic Search, Postgres SQL, NoSQL DB, MySQL.
  • Experience with data visualization and business intelligence tools like Power BI, Tableau etc. is a plus.
  • Experience in developing Restful APIs.
  • Experience with setting up and operationalize Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Ansible.
  • Experience working in an Agile and Test-Driven Development environment.
  • Demonstrated intellectual and analytical rigor, strong attention to detail, team oriented, energetic, collaborative, diplomatic, and flexible style.
  • Be able to work independently with minimal supervision.

Additional Information

Visa has adopted a COVID-19 vaccination policy to safeguard the health and well-being of our employees and visitors. As a condition of employment, all employees based in the U.S. are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.

Work Hours: Varies upon the needs of the department.

Travel Requirements: This position requires travel 5-10% of the time.

Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law, including the requirements of Article 49 of the San Francisco Police Code.

Similar Jobs

Senior Accountant - Remote

McAfee

San Jose, CA

Perform complex contract review and recommend accounting treatment, as needed for new/existing cloud contracts. Experience in technology a plus.

Cloud Engineering - Director

PRICE WATERHOUSE COOPERS

San Jose, CA

Designing dynamic large-scale cloud environments and implementing a variety of digital platforms and a perspective on the various cloud offerings in the…

Cloud Software Solutions Engineer

Intel

Santa Clara, CA

Software defined storage, and cloud networking topologies. Experience architecting, designing, developing, and implementing cloud solutions on AWS platforms.

Cloud Engineering - Director

PRICE WATERHOUSE COOPERS

Sacramento, CA

Designing dynamic large-scale cloud environments and implementing a variety of digital platforms and a perspective on the various cloud offerings in the…

Cloud Engineering - Director

PRICE WATERHOUSE COOPERS

San Francisco, CA

Designing dynamic large-scale cloud environments and implementing a variety of digital platforms and a perspective on the various cloud offerings in the…

Sector Cloud Product Manager - Senior Manager

PRICE WATERHOUSE COOPERS

San Jose, CA

Move easily between big picture thinking and managing relevant detail. Our team helps organisations align their business and operational requirements through…

Sector Cloud Product Manager - Senior Manager

PRICE WATERHOUSE COOPERS

San Francisco, CA

Move easily between big picture thinking and managing relevant detail. Our team helps organisations align their business and operational requirements through…

Sector Cloud Product Manager - Senior Manager

PRICE WATERHOUSE COOPERS

Sacramento, CA

Move easily between big picture thinking and managing relevant detail. Our team helps organisations align their business and operational requirements through…

Full-Stack Software Engineer (Elixir)

Paradox

San Mateo, CA

Comfortable working in cloud-based (AWS), *NIX, and shell environment. Contribute to a variety of software and product development initiatives across the…

GCP Cloud Engineering - Senior Manager

PRICE WATERHOUSE COOPERS

San Francisco, CA

Move easily between big picture thinking and managing relevant detail. 4+ years' of experience with "on-premises to cloud" migrations or IT transformations; and…

GCP Cloud Engineering - Senior Manager

PRICE WATERHOUSE COOPERS

San Jose, CA

Move easily between big picture thinking and managing relevant detail. 4+ years' of experience with "on-premises to cloud" migrations or IT transformations; and…

Full-Stack Software Engineer (Elixir)

Paradox

San Jose, CA

Comfortable working in cloud-based (AWS), *NIX, and shell environment. Contribute to a variety of software and product development initiatives across the…

Full-Stack Software Engineer (Elixir)

Paradox

Palo Alto, CA

Comfortable working in cloud-based (AWS), *NIX, and shell environment. Contribute to a variety of software and product development initiatives across the…

Full-Stack Software Engineer (Elixir)

Paradox

Sacramento, CA

Comfortable working in cloud-based (AWS), *NIX, and shell environment. Contribute to a variety of software and product development initiatives across the…

Full-Stack Software Engineer (Elixir)

Paradox

Santa Clara, CA

Comfortable working in cloud-based (AWS), *NIX, and shell environment. Contribute to a variety of software and product development initiatives across the…

GCP Cloud Engineering - Senior Manager

PRICE WATERHOUSE COOPERS

Sacramento, CA

Move easily between big picture thinking and managing relevant detail. 4+ years' of experience with "on-premises to cloud" migrations or IT transformations; and…

Technical Instructor (Contractor)

Datameer

San Francisco, CA

Datameer’s advanced data preparation, exploration and governance functionality makes it easy to transform big data into curated data sets to feed any analytics…

Full-Stack Software Engineer (Elixir)

Paradox

Mountain View, CA

Comfortable working in cloud-based (AWS), *NIX, and shell environment. Contribute to a variety of software and product development initiatives across the…

Full-Stack Software Engineer (Elixir)

Paradox

Santa Cruz, CA

Comfortable working in cloud-based (AWS), *NIX, and shell environment. Contribute to a variety of software and product development initiatives across the…

Full-Stack Software Engineer (Elixir)

Paradox

San Francisco, CA

Comfortable working in cloud-based (AWS), *NIX, and shell environment. Contribute to a variety of software and product development initiatives across the…

Target Supply Tech

Western Digital

Fremont, CA

Receive wafer sputter targets and track in ERP system. Provide status reports of weekly target usage and associated costs.

Analyst 3 - Business Analytics

Western Digital

Milpitas, CA

You’re an outstanding communicator and collaborator at all levels of the organization, and have a knack for clearly articulating complex problems and steps…

Software Development Manager

Amazon.com Services LLC

Santa Clara, CA

Experience with big data, cloud computing, or large-scale distributed systems for commercial online services that require high availability and performance.

Business Development Representative

Denodo Technologies

Palo Alto, CA

Founded in 1999, Denodo is privately held. We are seeking talented candidates with a desire to work in collaboration with a marketing team focused on exceeding…