A.P. Moller - Maersk
Location
Bangalore | India
Job description
Data Engineer
We are seeking for a n Azure Data Engineer who has strong experience in DWH and ETL technologies on Big Data and Azure cloud and experience in real time data processing.
One who has been in at least 2-3 Data engineering or ETL projects and has 5+Yrs Exp and Strong Coding skills in big data tech .
Candidates must have strong communication skills that allow you to regularly deal with the business, as well as with specialists from related fields including POs , architects, and other Engineers .
Candidate should be will ing to evaluate and learn new technologies .
Responsibilities & Skills Requirements
Project experience using Azure cloud, data lake storage, Data factory , Spark /Databricks , Python, Kafka
Exp erience in creating Batch and Realtime Data pipelines on Azur e
Experience in performance tuning of complex ETL mappings for relational and non-relational workloads
Advanced SQL programming , PySpark , PL/SQL or T-SQL, SparkSQL
Hadoop Data Serialization mechanism line PARQUET, AVRO, ORC.
Hands on experience in Azure, preferably data heavy / analytics applications leveraging relational and NoSQL databases, data warehouse and big data.
Design DWH model, ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model.
Exposure on the CICD pipelines for the Azure resources .
Facilitate data integration, data conformity, data integrity and ensure data structures are designed for flexibility to support future business needs and enhancements.
Understand the relationships across business information and units of data, Reverse engineer data from various source systems.
Ensure that data transformations are well documented follow best practices and understood by business users and developers.
Have experience cleansing, manipulating and analysing large datasets both structured and Unstructured.
Exceptional data analysis, critical thinking, communication, problem solving and cross-group collaboration skills
Job tags
Salary
