...: 1 Deep knowledge of AWS ecosystem and security 2 Deep skills on Pyspark and Databricks 3 Good knowledge of Python programing
Professional Attributes : Good Communication Skill Good Team Player
Educational Qu...
...strategies for populating data lakes. This is not an infrastructure position. This person may be called upon to do complex coding using U-SQL, Scala or Python and T-SQL.
Data Engineers with Batch processing
Exper...
...transformation/ wrangling expertise in GCP BigQuery- Exposure to Cloud computing services like GCP/Azure/AWS- Experience in query languages like SQL, and Hive- Proficiency in writing logic in Python as per industry ...
...other Spark components as per project requirements.
Integrate Java applications with Kafka and Flink/Spark clusters to build end-to-end data processing pipelines.
Stay updated with the latest developments in F...
...Build data governance and security protocols and ensure adherence from analytics, tech and business teams
Build and lead the data engineering team, recognize their strengths, and lead them to take ownership of en...
Total - 9 - 12 yrs
Programming Languages: Java, Python, and Java script Frameworks: Angular, Spring Boot, .Net Core Cloud Technologies: AWS (Amazon Web Services), Azure Project Management: Agile Methodology, Program Management Big Data Technolog...
Experience in GCP Data Engineering. Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. Should have worked on handling big data. Strong communication skills. experience in ...
About the job
Requirements:
Looking for Experienced Java, Spark Developer with expertise in Apache Flink to join our dynamic team. The... ...and real-time data analytics using Apache Flink.
Profici...
...processing pipelines.
Stay updated with the latest developments in Flink, Java, Kafka, and Spark technologies.
Hands-on experience with Apache Spark/Flink, including Spark Core, Spark SQL, Spark Streaming, and Spark MLlib for data proc...
