Hexaware Technologies
Location
Bangalore | India
Job description
Hi ,
We have an F2F weekend drive for Bangalore 2 & 3 March in Azure data engineer Job Description: Job Description : ETL – Data Engineer Responsibilities • Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables. • Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness • Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed. • Diagnose system performance issue related to data processing and implement solution to address them. • Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement. • Maintain integrity and quality across all pipelines and environments. • Understand and follow secure coding practice to make sure code is not vulnerable Skills • Should have Strong background in Software development with experience in ingest, transform and store data from large datasets using Pyspark in Azure Databricks with strong knowledge on distributed computing concepts. • Must have hands on experience in designing and developing ETL Pipelines in Pyspark in Azure Databricks with strong python scripting exposure like list comprehensions, Dictionary variables etc. • Must have minimum 5 years of exposure and good proficiency in data warehousing concepts. • Proficient in SQl and database Design concepts. • Hands on experience with good proficiency in Delta table and delta file operations like merge, Insert override, Partition overrides etc. • Hands on Experience in CICD in Azure DevOps/Harness and ADF/Stone branch for orchestration. • Knowledge of Azure cloud computing platform with Azure Synapse, ADLS. • Knowledge on GitHub and build management. • Passion for data and experience working within a data driven organization • Excellent presentation, communication (oral & written), and relationship building skills, across all levels of management If you are interested, kindly share the following details. Full name- Contact no- Email id- Qualification- Experience- Rel exp- CTC- ECTC- Notice period- Current location- Preferred location- Interview availability (2&3-March-24 , F2F)Job tags
Salary
