Location
Chennai | India
Job description
Description here
Lead Data Engineer JD : Qualifications - 5 to 10 years of hands-on Big Data Engineering experience
- Excellent communication and collaboration skills
- Demonstrated strong leadership skills in leading a team
Key responsibilities include:
- Create and maintain data pipelines to transform and load data from data lake into Datawarehouse models
- Implement automated Data Quality measures to sieve out bad quality data for timely rectifications by data sources
- Design, construct and maintain Data Warehouse models to support data analytics needs.
- Create and maintain data science sandbox, machine learning tools, Databricks, data marts, data catalogue, data lineage, etc
- Work and collaborate with data analytics team at all stages of CRISP-DM Methodology
- Align to SP data policies, standards and market best practices and document as required
- Familiarity with PySpark, Python and SQL scripting languages
- Adops the ETL(t) concept towards data modelling and data mart provisioning
- Understands how Fabric consumes data for visualization and provide the necessary data
- Familiarity with the current Azure Data Tech Stack (e.g. SQL Server, Azure Synapse, Azure ML Studio, Azure Data Factory, Big Data, Data Lake, Azure Databricks, Fabric, Purview, IOT Hub etc.)
- Familiar with DevOps CI/CD Concepts
- Reviews and approves CI/CD pipelines
- Provide guidance to junior data engineers
- Provides leadership and backlog prioritization for the Data Engineering scrum team
About Encora Encora is a global company that offers Software and Digital Engineering solutions, with more than 9000 Encorians around the world. Our technology practices include Cloud Services, Product Engineering & Development, Data Modernization & Engineering, Digital Experience, DevSecOps, Cybersecurity, Quality Engineering, Generative AI, among others.
At Encora Inc. we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Job tags
Salary
