Azure Data Lead

Location

Bloomsbury, Greater London | United Kingdom

Job description

Key Skills:

Solid Hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have

Solid Hands-on experience with Delta Lake House with Delta tables - Must have

Solid Hands-on experience with Data warehousing - Must have

Solid Hands-on experience with Azure Data Factory - Must have

CI/CD Pipelines Integrations - Must have

Lead all the technical conversation with client and team coordination.

10+ Years of experience with Data Project

London Insurance market data experience

Responsibilities:

• Hand-on experience in Azure data platform architecture and developing data engineering pipelines

• Experience in working with both SQL and NoSQL databases.

• Hand-on experience in developing data solutions using Azure Data platform tools( Azure data lake gen2,Azure Sql, Azure Data Factory , Mapping Dataflows , Azure Databricks , logic app, Azure Synapse ,Azure Analysis Services and Azure Functions).

• Strong knowledge and experience in data lake and delta lake-based data platform development using Azure Databricks and Azure Synapse Analytics .

• Strong experience with at least one of the programming languages: Python, PySpark, Scala, R.

• Able to develop CI/CD pipelines for automated build and deploy

• Should be able to contribute to technical solutions and must be able to translate functional/technical into code, unit test and deliver to customer

• Experience with different database technologies (e.g., SQL database(s), Azure SQL)

• Strong Analytical & problem-solving skills

• Development, code review, unit testing, 

• Participation in Agile ceremonies 

• Good communication skill

• Insurance knowledge will be added advantage

Job tags

Salary

£65k - £70k per annum