logo

JobNob

Your Career. Our Passion.

Data Engineer


YO HR Consultancy


Location

Secunderabad | India


Job description

Experience: 1-4 Years

Must Have : Python, SQL, Data Visualization, Cloud platform experience

Roles & Responsibilities

Lead the design and implementation of new platform feature & data products that will improve the experience of people working with data

Work on tooling for our Data Engineering teams, to automate tasks and make it easier for them to deliver value from our data

Contribute to the ongoing improvement of our engineering processes, standards and documentation

Mentor junior engineers and help them develop their skills

Requirements

Experience writing clean, robust and testable code, preferably in Python, whether functional or object-oriented

Strong understanding of SQL and knowledge of Data Warehousing concepts

Working knowledge of cloud-vendor technologies, such as AWS, GCP or Azure

Experience with infrastructure-as-code and CI/CD processes

Comfortable building & maintaining production-level data pipelines; batch, streaming or event-driven

Good To Have

Experience using AWS services, such as S3, Lambda, Kinesis, EMR, EKS, firehose.

Experience working with Apache Spark.

Exposure to Kubernetes and/or streaming technologies such as Apache Flink, Apache Kafka.

Worked with Data Lake Table Formats such as Apache Iceberg or Delta Lake

Familiarity with dbt, data modelling and data quality testing.

Skills: python,sql


Job tags



Salary

All rights reserved