Brainsource Technologies Private Limited
Location
Chennai | India
Job description
Technologies
Azure data factory Azure Data bricks Azure Synapse PySpark/SQL ADLS,BLOB Azure DevOps with CI/CD implementation.Azure data engineer -Developer/Support role
The role will leverage & enhance existing technologies in the area Data and analytics Solutions like Power BI, Azure data engineering technologies, Teradata/Snowflake, and other Azure services. The role will be responsible to develop and support IT products and solutions using these technologies and deploy them for business users Technical Requirements 5 to 8 Years of IT & Azure Data engineering technologies experience Prior experience in ETL, data pipelines, data flow techniques using Azure Data Services Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse and file formats like JSON & Parquet. Experience in creating ADF Pipelines to source and process data sets. Experience in creating Databricks notebooks to cleanse, transform and enrich data sets. Development experience in orchestration of pipelines Good understanding about SQL, Databases, Datawarehouse systems preferably Teradata Experience in deployment and monitoring techniques. Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources. Experience in handling operations/Integration with source repository Must have good knowledge on Datawarehouse concepts and Datawarehouse modelling. Working knowledge of SNOW including resolving incidents, handling Change requests /Service requests, reporting on metrics to provide insights. Collaborate with the project team to understand tasks to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data. Non-technical requirement: Work with project leaders to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data. Think and work agile, from estimation to development, including testing, continuous integration, and deployment. Manage numerous project tasks concurrently and strategically, prioritizing when necessary. Proven ability to work as part of a virtual team of technical consultants working from different locations (including onsite) around project delivery goals.Job tags
Salary