Location
Pune | India
Job description
Experience : 5+ years
Qualification : Bachelors degree in Computer Science or related field or higher with relevant experience.
Required Skillset: Design and implement ETL processes to efficiently move and transform data between various systems.
Develop and maintain data pipelines, ensuring data integrity and reliability.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Utilize Python for data engineering tasks, ensuring efficient data processing.
Leverage REST APIs to consume and integrate external data sources.
Implement and maintain data solutions in Azure, including Azure Data Factory, Logic App, and Databricks.
Work with big data technologies such as Hadoop and pySpark to handle large datasets.
Collaborate with data stakeholders to understand their needs and contribute to the optimization of data processes.
Mandatory to have: Minimum of 5 years of experience in data engineering.
Proficiency in Python for data engineering tasks.
Expertise in designing and implementing ETL processes.
Strong knowledge of REST APIs for data integration.
Familiarity with cloud services, particularly Azure ADF, Logic App, and Databricks.
Experience with big data technologies, including Hadoop and pySpark.
Strong problem-solving skills and the ability to work with large datasets.
Good communication skills and the ability to work in a collaborative team environment.
Knowledge of Data Catalog.
Knowledge in working of Agile methodologies.
Qualification:- Working with internal and external stakeholders in an international environment.
Internship or work experience in Europe or US would be appreciated.
B.E or equivalent
Skills:
- Data Engineering
- Python
- Data Analysis
- Data Architecture
Job tags
Salary
