---

---

Location

Redmond, WA | United States

---

Job description

DESCRIPTION

Want to change the world with Big Data and Analytics? Come join us on the Amazon EMR team in Amazon Web Services!

Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Apache Spark, Hive, Presto, Hadoop, HBase and more, with the ability to effortlessly scale up and down as needed. We run a large number of customer clusters, enabling a variety of customer use cases including analytics and web-scale machine learning. The AWS DBS EMR organization is innovating within these open-source data processing frameworks with the aim of making EMR the premier platform for running big data workloads. A key aspect of achieving this goal is to enhance security and reduce cluster startup time on the EMR platform.

The AWS EMR Kamino & Observability team is seeking exceptional engineers to help achieve our mission of providing the world’s fastest cloud Big Data processing platform. As an engineer on the Kamino & Observability team, you will be responsible for building and maintaining set of microservices to update and validate images for EMR Releases with latest security updates and critical fixes on all EMR deployment options (EC2, EKS, and Serverless). You will develop features for pre-baking and configuring big data applications on images to achieve faster cluster start up time. You will be adding metrics for cluster monitoring such as CPU/Memory/Disk usage as well as job level metrics for big data applications like Spark and Hadoop. These metrics will help detect workload anomalies during big data jobs execution on EMR Clusters. You will create visualizations of these metrics through dashboards and generate actionable insights for customers. Your work will define an excellent customer experience for the EMR service during EMR cluster launch from faster start up to running jobs on clusters through monitoring.

Successful candidates will exhibit outstanding software development skills, an understanding of distributed systems and parallel data processing, and a strong record of delivery, also excel at leadership and customer obsession and have a real passion for massive-scale computing. By joining our team, you will collaborate with some of the best and brightest minds in the industry and work on cutting-edge software and systems. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies. Most of all, you will get the satisfaction of making products that millions use everyday to great effect!

To learn more about EMR:

- AWS EMR:
- AWS Big Data Blog:

Key job responsibilities
- Designing and building the next-generation technologies ensuring that EMR is the best environment for running large-scale data processing workloads.
- Working on complex problems in cloud-native distributed systems.
- Translating complex functional and technical requirements into detailed architecture and design.
- Delivering systems and features with top-notch quality, on time.
- Owning the end-to-end Software Development Life Cycle (SDLC).

A day in the life
Your role requires deep technical expertise, leadership acumen, a passion for software, data, and infrastructure solutions, excellent organizational and communication skills, and the ability to deliver results in a dynamic environment. You must be adept at managing complex software products, translating business cases into technical requirements, and creating reliable, scalable solutions.

You'll engage in diverse technical activities, coding in Java and other popular programming languages, or exploring innovative technologies in big data. Your expertise in building stable and scalable software and data solutions, along with your experience in databases and designing parallel systems, will be invaluable.

We are open to hiring candidates to work out of one of the following locations:

Redmond, WA, USA

BASIC QUALIFICATIONS

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

---

Job tags

---

---

Salary