Senior Data Analyst (Pig to Python)
Location
Bangalore | India
Job description
Role : Big Data Engineer
Experience: 4-6 years
We are seeking a skilled and experienced Big Data Engineer to join our dynamic team. The ideal candidate will possess a strong background in Big Data technologies with proficiency in Pig scripting and Python programming. As a Big Data Engineer, you will be responsible for understanding existing code written in Pig, documenting algorithm notes for business stakeholders, and rewriting the code in Python. Additionally, you will play a crucial role in future enhancements to our business algorithms by ensuring thorough documentation of the existing logic and facilitating smooth transitions.
Key Responsibilities: - Analyze and understand existing code written in Pig scripting language.
- Collaborate with business stakeholders to document algorithm notes and requirements.
- Rewrite existing Pig code in Python while ensuring functionality and efficiency.
- Work closely with the development team to implement and test new algorithms in Python.
- Document business logic thoroughly to enable future enhancements and modifications.
Qualifications: - Bachelor's degree in Computer Science, knowledge of Math and statistics is plus, Engineering, or related field.
- 4-6 years of experience in Big Data engineering with skills like
- Proficiency in Hadoop ecosystem components such as PIG, HDFS, YARN, MapReduce, Hive, HBase, Spark, etc.
- Proficiency in Pig scripting and Python programming.
- Strong understanding of Big Data technologies and frameworks such as Hadoop, Spark, etc.
- Experience with data processing and analysis using SQL.
- Excellent communication skills with the ability to translate technical concepts to non-technical stakeholders.
- Strong problem-solving and analytical skills.
- Ability to work independently and collaboratively in a fast-paced environment.
Job tags
Salary
