logo

JobNob

Your Career. Our Passion.

Data Engineering Lead


Careernet


Location

Hyderabad | India


Job description

Company:

A Large Global Organization Key Skills:

Informatica IICS, SQL, Snowflake DB, People Management, Lead Roles and Responsibilities: Establishing technical designs to meet business and technical requirements as the primary data engineering lead. Developing and maintaining all components of data engineering solutions and pipelines based on requirements and design specifications using appropriate tools and technologies. Optimizing solutions (ETL/data pipelines) to balance performance, functionality, cost, and other operational requirements. Conducting peer reviews for quality, consistency, and rigor of production-level solutions. Creating design and development documentation based on standards for knowledge transfer, training, and maintenance. Defining and promoting best practices and standards for code management, automated testing, and deployments. Collaborating with business and product teams to understand high-level business requirements and translate them into technical needs. Leveraging existing or creating new standard data pipelines within company to deliver business value through various use cases. Developing automated tests for CI/CD pipelines and ensuring the quality of developed solutions. Mentoring and training junior team members in data engineering practices. Assessing and resolving data pipeline issues to ensure performance and timely execution. Leading data engineering efforts to modernize and replace legacy solutions and platforms. Partnering with Data Engineering Manager, Product Owner, and Data Analysts to create implementation plans, including timelines and complexity assessments. Gathering and organizing large and complex data assets, and performing relevant analysis. Actively contributing to the Data Engineering community and defining leading practices and frameworks. Communicating results and findings to stakeholders at various levels in a clear and structured manner. Remaining up-to-date on company standards, industry practices, and emerging technologies. Skills Required: 8+ years of experience in data engineering, integration, data warehousing, business intelligence, business analytics, or a comparable role with relevant technologies and tools. Experience in Big Data integration, including cloud-based platforms such as AWS, and Snowflake. Proficiency in data structures and algorithms. Demonstrated experience in scripting languages (Python, R, SQL, Shell scripting). Experience with job scheduling and orchestration tools (Control-M and Airflow) is a plus. Strong proficiency in relevant technologies such as databases (relational and NoSQL), distributed systems, and microservices. Experience working with large datasets, and performance and query optimization. Experience working in cross-functional teams to solve complex data architecture and engineering problems. Demonstrated ability to learn new data and software engineering technologies quickly. Experience with agile/scrum development processes and concepts. Ability to work in a fast-paced, evolving environment and manage multiple priorities. Strong technical analysis and problem-solving skills related to data and technology solutions. Excellent written, verbal, and interpersonal communication skills. Pragmatic approach to solving complex issues with attention to detail. Service-oriented, flexible, and approachable team player. Fluent in English (other languages a plus). Knowledge of pharmaceutical and healthcare data is a plus. Education:

Bachelor's Degree or equivalent in Computer Science, Engineering, or a relevant field.


Job tags



Salary

All rights reserved