logo

JobNob

Your Career. Our Passion.

Lead Big Data Engineer - ETL/Hadoop


Annex India


Location

Vijayawada | India


Job description

Role: LEAD BIG DATA ENGINEERJob Description - As a Big data Architect, the candidate should be able to define the overall strategy and roadmap for Data-driven decision-making and work towards the implementation of Big Data Technology solutions.- Provide technical leadership and guidance towards creating cutting-edge technology solutions for the Bank.- Candidate should have in-depth and strong technical knowledge on Hive, Spark, Kafka, Streaming, SQL, Hadoop platform, and Python.- Hands-on experience on major components of the Hadoop ecosystem such as Spark, HDFS, Hive, Sqoop, Kafka, and Streaming is a must.- Architect, build and maintain scalable data pipelines and access patterns related to permissions and security.- Research, evaluate and utilize new technologies/tools/frameworks centered around high-volume data processing.- Work with the architecture engineering team to ensure quality solutions are implemented and engineering best practices adhered to- Develop set process for Data mining, Data modeling, and Data production.- Communicate architecture clearly with business and technical stakeholders.- Partner closely with cross-functional leaders (development/product management/business stakeholders/ sales etc.) to ensure a clear understanding of the solution that will be built.- Identify, propose, and prototype proof of concepts for your solutions. Ensure that the strategy is chosen based on a clear understanding of the costs and benefits associated with the approach.- Partner with commercialization teams as a technical expert drive revenue growth across a broad set of customers.- Participate in Business Development activities as a Solution Architect. Lead Architecture discussions, Solutioning, Estimation, Deployment model, etc.- Define guidelines and best practices to drive consistency across client implementation and make sure consistency is followed across the board.- Enable innovation through thought leadership by constantly evaluating cutting-edge technologies applicable to business and domain.- Groom the next level of junior Architects to the next level.- You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain.- You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews.- You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and adherence to the organizational guidelines and processes.Expertise You will Bring- Understanding of Big Data Hadoop Ecosystem components (Sqoop, Hive, Pig, Flume)- Additional experience working with- Hadoop, HDFS, cluster management- Hive, Pig and Map Reduce, and Hadoop ecosystem framework- HBase, Talend, NoSQL databases (ref:hirist.tech)


Job tags



Salary

All rights reserved