logo

JobNob

Your Career. Our Passion.

Data Engineer


System Soft Technologies


Location

Delhi | India


Job description

Job Summary: A large global retailer is looking for a Data Engineer for join the Finance Data Factory team in the Finance Technology organization! -IBG -Data lake Current project is in Azure data bricks, but we are moving to GCP

Required Skills and Experience: 3-6 years of experience in building of large-scale data pipelines using big data technologies (Spark/Kafka/Cassandra/Hadoop/Hive/Presto/Airflow) 3-6 years of experience in systems design, algorithms, and distributed systems Experience with cloud infrastructure, such as Open Stack, Azure, GCP, or AWS PySpark, Parquet, Python Framework Development Azure DevOps and its interaction with Databricks and Data Factory On-premises big data technology Optimization in GBQ ETL & Data Warehousing concepts Strong in connecting to and ingesting from multiple source types to Google Cloud Storage or another cloud platform Large scale distributed systems experience, including scalability and fault tolerance

Preferred Skills: A continuous drive to explore, improve, enhance, automate, and optimize systems and tools. Strong computer science fundamentals in data structures and algorithms Exposure to information retrieval, statistics, and machine learning. Good understanding of metadata driven development


Job tags



Salary

All rights reserved