Principal Engineer, Infra
Location
Bangalore | India
Job description
- The vision for the TLB team is to build data processing software that works on terabytes of streaming data in real time
- Engineer the next-gen Spark-like system for in-memory computation of large time-series dataset s - both Spark-like backend infra and library based programming model
- Build horizontally and vertically scalable system that analyses trillions of events per day within sub second latencies
- Utilize the latest and greatest of big data technologies to build solutions for use-cases across multiple verticals
- Lead technology innovation and advancement that will have big business impact for years to come
- Be part of a worldwide team building software using the latest technologies and the best of software development tools and processes
What Success Will Look Like
- Develop, build and maintain the stream processing, time-series analysis system which is at the heart of Conviva s products
- Responsible for release, deployment and scaling of Conviva platform
- Responsible for resiliency, high availability and scaling of Conviva platform
- Build features, enhancements and bug fixing for a CircleCI based CI/CD pipeline to be deployed as Docker containers on Kubernetes
- Adhere to the Agile model of software development to plan, estimate and ship per business priority
Who You Are What Youve Done
- 10+ years of work experience in development and release of data processing products
- Excellent programming and debugging skill - Proficient in writing code by Shell-scripting / Python / Scala / Java that is reliable, maintainable, secure, and performant
- Experience with big data technologies like Spark, Kafka, HDFS, Redis etc
- Experience with Kubernetes, Grafana, Prometheus, GitOps, Rancher, Helm, Jenkins, Vault, JFrog, Codacy, Cloudera Manager and Cloud infrastructure concepts on GCP
- Ownership of production infrastructure. Strong understanding of the initiation, planning, execution, and monitoring of everything from minor bug fixes to massive updates
- Deep understanding of distributed systems concepts and scalability challenges including multi-threading, concurrency, sharding, partitioning etc
- Excellent communication skills. Willingness to work under pressure. Hunger to learn and succeed. Comfortable with ambiguity. Comfortable with complexity.
- Engineering degree in software or equivalent from a premier institute
Job tags
Salary
