LEVEL UP HR SOLUTIONS
Location
Coimbatore | India
Job description
Responsibilities: Design, build, and maintain efficient data pipelines and ETL processes using Azure services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. Develop and maintain data models and data warehouses to support business requirements. Work closely with data scientists and analysts to understand their data requirements and implement solutions. Monitor and optimize data pipelines for performance and reliability. Collaborate with cross-functional teams to integrate data engineering solutions into business processes. Stay current with industry trends and best practices in data engineering and cloud technologies.
Requirements: Strong experience in Microsoft Azure and Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with object-oriented/object function scripting languages: Python, Scala, etc. Experience in ETL tools including Azure Data Factory Experience in Azure Data Lake, Azure SQL Azure Synapse. Strong SQL, Data querying, and Data analysis skills (Added value SparkSQL). Experience working with diverse set of data sources and off-the shelf/enterprise/bespoke applications. Experience in Azure Stream Analytics, Azure Analysis Service, Azure Data Catalog, ML Studio * Experience in Python/JSON (Added value) Experience with DevOps tools such as Azure DevOps, GitLab, Jenkins 4-8 years of experience in the related fieldJob tags
Salary
