Location
Bangalore | India
Job description
Job Description:
We are seeking a skilled and experienced Big Data Developer/Data Engineer to join our clients team in Bengaluru. The ideal candidate should have a strong background in Java Spark Hadoop and Scala with 47 years of relevant work experience.
Responsibilities:
- Design develop and maintain largescale data processing systems leveraging Hadoop Spark and other Big Data technologies.
- Implement scalable and highperformance data pipelines for processing transforming and storing large volumes of data.
- Collaborate with crossfunctional teams to understand data requirements and design appropriate solutions.
- Optimize and tune data processing workflows for improved performance and efficiency.
- Develop and maintain documentation for data pipelines processes and systems.
- Monitor and troubleshoot data processing jobs to ensure reliability and availability.
- Stay updated with the latest developments in Big Data technologies and recommend best practices for implementation.
- Work closely with data scientists and analysts to support their data needs and provide actionable insights.
Requirements:
- Bachelors or Masters degree in Computer Science Engineering or related field.
- 47 years of handson experience in software development with expertise in Java Scala and Big Data technologies (Hadoop Spark).
- Proficiency in designing and building largescale distributed systems for data processing and analytics.
- Solid understanding of data structures algorithms and software engineering principles.
- Experience with cloud platforms (e.g. AWS Azure GCP) and containerization technologies (e.g. Docker Kubernetes) is a plus.
- Strong problemsolving skills and ability to work independently as well as part of a team.
- Excellent communication and interpersonal skills.
- Ability to thrive in a fastpaced and dynamic work environment.
data engineering,java,spark,hadoop,scala,python,big data technologies,data processing,amazon redshift,aws,airflow,azure,gcp,sql,athena,etl,machine learning,artificial intelligence,data modeling,data analysis,kafka,aws lambda,glue
Job tags
Salary
