Data Engineer

T-systems Ict India

Location

Pune | India

Job description

Expert level understanding of distributed computing principles
Expert level knowledge and experience in Apache Spark
Hands on programming with Python / Scala
Proficiency with latest Hadoop, HDFS, Sqoop
Experience with building stream-processing systems, using technologies such Spark-Streaming
Experience with messaging systems, such as Kafka or RabbitMQ
Good understanding of Big Data querying tools, such as Hive, and Impala
Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
Strong understanding of SQL queries, joins, relational schemas
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Knowledge of ETL techniques and frameworks
Performance tuning of Spark Jobs
Experience with native Cloud data services GCP would be added advantage
Experience with designing and implementing Big data solutions
Practitioner of AGILE methodology e.g JIRA
Excellent communication, Presentation skills
Should have CICD and GIT hands on Experience
Data WareHouse knowledge is preferred.

Qualifications

Job tags

Salary