logo

JobNob

Your Career. Our Passion.

Data Engineer - Spark/Hadoop


TD Newton


Location

Pune | India


Job description

Job Description :Must have Requirements :To be successful in this role, you should meet the following requirements : - Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+. - Experience with most of the following technologies : Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services.- Sound knowledge on working Unix/Linux Platform- Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL.- Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.- Understanding of big data modelling techniques using relational and non-relational techniques- Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects (ref:hirist.tech)


Job tags



Salary

All rights reserved