Digital Engineering lead Engineer
Location
Bangalore | India
Job description
Req ID: 270154
NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a Digital Engineering lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).
Data Engineer
- Design and Develop data pipelines utilizing Cloud technologies Azure/AWS/GCP
- Lead a team of Data Engineers. Responsible for technical delivery and act as advisory to any related technical challenges.
- Develop data transformations utilizing cloud native processing, python processing etc.
- Working with external on-prem partners to bring data into cloud environment.
- Designing and maintaining data flow design and schemas.
- Working with the Data Architect to translate functional specifications into technical specifications.
- Partner with data analyst, product owners and data scientists, to better understand requirements, solution designs, finding bottlenecks, resolutions, etc.
- Support/Enhance data pipelines and ETL using heterogeneous sources.
- Work with other internal technical personnel to troubleshoot issues and propose solutions.
- Support compliance with data stewardship standards and data security procedures.
- Apply proven communication and problem-solving skills to resolve support issues as they arise.
Required Skills
- Overall 8+ years' experience as Senior Data Engineer / Lead designing and developing Data pipelines utilizing Hadoop ecosystem and/or Cloud.
- 2+ years' experience in Data Virtualization toolsets Starburst or Dremio is a must
- Experience with Collibra is a nice a plus
- Programming - Python, Spark, or Java. Python highly preferred
- Experience with Query languages - SQL, Hive, Impala, Drill etc. SQL highly preferred
- You will transform data using data mapping and data processing capabilities like Python, SQL, Spark SQL etc.
- Strong development/automation skills. Must be very comfortable with reading and writing Python, Spark or Java code.
- Expands and grows data platform capabilities to solve new data problems and challenges.
- Ability to dynamically adapt to conventional big-data frameworks and tools with the use-cases required by the project.
- Experience in agile(scrum) development methodology
- Excellent inter-personal and teamwork skills
- Ability to work in a fast-paced environment and manage multiple simultaneous priorities
- Can-do attitude on problem solving, quality and ability to execute
- Masters or Bachelor's degree in engineering in Computer Science or Information Technology is desired
Job tags
Salary
