Software Development Engineer, Big Data, AWS Elastic MapReduce (EMR) @ Amazon.com Services LLC - East Palo Alto, CA

Job Overview

12 days ago

Software Development Engineer, Big Data, AWS Elastic MapReduce (EMR)

Amazon.com Services LLC - East Palo Alto, CA

  • Programming experience with at least one software programming language.
  • 1+ years of experience in software development
Job summary
Want to change the world with Big Data and Analytics? Come join us on the Amazon Elastic Map Reduce (EMR) team in Amazon Web Services as a Software Development Engineer!

Amazon EMR is a web service which enables customers to run massive clusters with distributed big data frameworks like Apache Spark, Trino, PrestoDB, Hive, Tez, Flink, HBase, Hadoop and more, with the ability to effortlessly scale up and down as needed. We run large number of customer clusters, enabling processing on vast datasets.

We are developing innovative new features including our next-generation cluster management system, improvements for real-time processing of big data, and ways to enable customers to easily interact with their data. We’re looking for software development engineers to build them from the ground up.

We are looking for a hands-on software development engineer who will be designing and building extremely stable components and cutting-edge features for the savviest customers in the business.

You will have a chance to work with the open source software community and contribute back to open source projects e.g., JupyterLab, Apache Spark, Trino, PrestoDB, Hive, HBase, and Hadoop. You will need to be a high performing software developer with an understanding of big data and parallelization. You will have a stellar record of delivery, leadership and customer obsession. If you want to truly test your mettle against the hardest challenges in distributed systems to engineer solutions for large scale problems in a wide variety of domains, come join our group.

Your responsibilities will include:
  • Translation of complex functional and technical requirements into detailed software architecture and design
  • Deliver software systems and features with top-notch quality, on time
  • Develop new technologies for monitoring production clusters
  • Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.
  • Mentors junior engineers, define our technical culture, and help build a fast-growing team
In joining our team, you will get to work with a minimum of technical supervision, while playing a variety of roles as needed to respond efficiently to multiple program priorities. You will get to collaborate with some of the best and brightest software engineers, product managers and data scientists in the industry. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies - but most of all, you will get the satisfaction of making products that millions use everyday to great effect!

For more information please see:
Inclusive Team Culture
Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences.

Work/Life Balance
Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.

Mentorship & Career Growth
Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.

  • Masters/PhD in Computer Science with emphasis on distributed systems and Big Data architectures is a plus.
  • Background in building software development tools/experiences.
  • Experience with JupyterLab, Jupyter Enterprise Gateway, Zeppelin Notebooks
  • Experience designing and building highly-scaled distributed systems and web services
  • Thorough understanding of parallel algorithms, concurrency, multi-threading and asynchronous architectures
  • Experience working in an agile software development organization
  • Experience building with SOA using Java on Linux
  • Knowledge of and contribution to Hadoop ecosystem
  • Experience with one or more of Ruby, Python, Java, Go
  • Proven ability to effectively drive cross-team solutions that may have complex dependencies
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Similar Jobs

Software Development Engineer II - Backend

Hotwire

San Francisco, CA

Drive continuous improvement in our software and development process within an agile development team. A tried background with the Java programming language,…

Software Engineer (Apprentice Conversion)

IBM

San Jose, CA

Whether you are working on projects internally or for a client, software development is critical to the success of IBM and our clients worldwide.

Applications Development Engineer -Broad Band Plasma

KLA

Milpitas, CA

Perform product diagnosis, problem resolution, interface with software and systems engineering to verify that hardware and software problems have been resolved.

Embedded Software Engineer (Wireless Connectivity)

Fresh Consulting

Sunnyvale, CA

Understanding of embedded development constraints and BSP development experience. Relevant work experience, including software development experience coding in…

Staff Software Engineer DevOps

Intuitive

Sunnyvale, CA

Minimum 8+ years of software development or DevOps experience with minimum bachelor’s degree in Computer Science or Engineering.

Staff Software Engineer

Intuitive

Sunnyvale, CA

Partner with our simulation, software, robotics, and data teams to ensure that the solution you build can encompass all of their needs and make this solution…

Site Reliability Engineer-1398281

JPMorgan Chase Bank, N.A.

Palo Alto, CA

Provides support to drive the maturity of the software development lifecycle. Strong working knowledge of modern development technologies and tools such Agile,…

Software Automation Engineer

Tesla

Fremont, CA

Have a strong understanding of software fundamentals including software design, CI/CD, algorithm development, data structures, code modularity, and…

Sr Software Engineer- .NET / C#/ React web

PRA Health Sciences

Oakland, CA

We are looking to expand our core product development team with a backend developer who has five or more years experience in the development of web and web API…

Android Software Engineer III – Experience Platform

Expedia.com

San Francisco, CA

Advise on technical limitations of software design for products and provide alternative solutions. Are you the type of person who loves to bring outstanding…

System Software Engineer

Intel

Santa Clara, CA

The focus of this role will be on system-level software development in areas such as: OS kernel, Firmware development, Graphics or memory area simulation…

SOFTWARE ENGINEER

University of California Office of the President

Oakland, CA

Advanced knowledge of secure software development. Creates flowcharts and technical documentation to guide future software development projects.

Senior Director of Program Management

Tenable, Inc

Santa Clara, CA

5+ years of software development experience, including experience with leading projects. The Senior Director of Program Management role within the product…

Staff Database/DevOps Engineer - SWAT

ServiceNow

Santa Clara, CA

The ideal candidate for this position is a software engineer with a strong background in database technologies, performance analysis, and strong troubleshooting…

Software Engineer (SRE)

Comcentric

Palo Alto, CA

To be considered for this role, you must have a strong software development foundation with 5+ years of experience writing code in Java, Python, Go or other…

SENIOR SOFTWARE ENGINEER - PENSION ADMINISTRATION SYSTEM

University of California Office of the President

Oakland, CA

Advanced knowledge of secure software development. Creates flowcharts and technical documentation to guide future software development projects.

Senior Software Engineer

Intuitive

Sunnyvale, CA

Knowledge of C++ and Embedded software is plus. Data driven application development and data manipulation across multiple databases.

Senior Software Engineer

Walmart

Sunnyvale, CA

Bachelor’s degree in Computer Science and 3 years of experience in software engineering or related field OR 5 years of experience in software engineering or…

SENIOR ORACLE SUPPORT DEVELOPER

University of California Office of the President

Oakland, CA

Set the technical requirements for complex software specifications. Initiate changes in development, maintenance and system standards.

Software Engineer (SRE)

Comcentric

Cupertino, CA

Salary, Bonus, Stock, Sign-on Bonus ($40-80K). The Site Reliability Engineering Team requires a mix of Software Engineering background and Systems Engineering.

Software Engineer

Comcentric

Oakland, CA

Salary, Bonus, Stock, Sign-on Bonus ($40-80K). The Site Reliability Engineering Team requires a mix of Software Engineering background and Systems Engineering.

Director, DevOps Architect

KPMG

Santa Clara, CA

Aspects of this leadership position will also encompass both quality assurance and continuous site/software testing. 10+ years project management experience.

Sr. Associate, Cyber Security - Cloud DevOps

KPMG

Santa Clara, CA

A minimum of 3 years of experience in application development, security, infrastructure, cloud and related technology platforms.

Sr. Associate, Cyber Security – Cloud DevOps Engineer

KPMG

Santa Clara, CA

A minimum of 3 years of experience in application development, security, infrastructure, cloud and related technology platforms.

Ad