Data Engineer

Location

Chennai | India

Job description

Job Title : Data EngineerÂ

Experience : 5-10 YearsÂ

Location : Pune /Bangalore/Chennai/Hyderabad/MumbaiÂ

Skills : Big Data (Hadoop, Hive, Hbase) + SQL + Data Engineer + Unix

Job Description :

• Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
• Utilize your programming skills in Python, Scala, and SQL for data solution development.
• Leverage Big Data technologies like Hadoop, Hive, Hbase, and Spark to handle large data sets.
• Employ Unix scripting for task automation and data processing.
• Utilize SQL and HQL expertise for database management and data manipulation.
• Implement coding best practices, ensuring software quality and maintainability.
• Optimize queries and tune performance for Hive and Spark applications.
• Collaborate with team members to design, develop, and implement robust data solutions.
• Keep up-to-date with the latest industry trends and technologies.

Good to have / Desirable Skills :

• A minimum of 5-7 years of industry experience in data engineering.
• Strong programming skills with at least 5 years of experience in Python, Scala, and SQL.
• Expertise in Big Data technologies such as Hadoop, Hive, Hbase, and Spark
• Proficiency in Unix scripting with a minimum of 5 years of experience.
• Deep knowledge of SQL and HQL.
• Solid understanding of coding best practices.
• Experience in query optimization and performance tuning, particularly for Hive and Spark.
• Excellent problem-solving skills and attention to detail.
• Strong communication and teamwork skills.

Competency for the Roles :

Big Data Expertise : The candidate should have a strong understanding of Big Data technologies such as Hadoop, Hive, Hbase, and Spark. They should be capable of managing and manipulating large datasets.

Job tags

Salary