Innova Solutions
Location
Secunderabad | India
Job description
· Key Responsibilities:
o 8+ years of strong experience in designing and implementing a fully operational solution on ETL, Snowflake, Data Warehouse.
o Responsible to Ingest data from files, streams, and databases.
o Should be familiar with bulk loading concepts, external tables and advanced snowflake concept etc
o Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems.
o Responsible to handle high volume data loads/migrations.
o Responsible to handle end to end lifecycle from analysis through deployment.
o Analyse, code and performance tuning UDFs, UDTF, Procedures using SQL, Python and/or JavaScript.
o Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
o Hands-on experience with Snowflake utilities like Snow SQL, Snow Pipe, experience in administering Snowflake, experience with data loading from cloud (Azure),AWS & APIs etc.
o Collaborate with cross-functional teams to ensure data quality, consistency, and integrity.
o Troubleshoot and resolve data-related issues in a timely manner.
o Build, monitor, and maintain data warehouses and ETL processes.
o Optimize and tune SQL queries for performance and reliability.
o Experienced in designing optimal data load and data processing ETL jobs.
o Responsible to guide and lead the team.
o Responsible to guide the team in agile methodology.
o Should have prior experience working with cloud technologies.
o Understanding data pipelines and modern ways of automating data pipeline using cloud-based implementation and Testing and clearly document the requirements to create technical and functions specs
o Collaborate with data analysts and clients to understand data requirements and translate them into efficient data processing solutions.
o Experience in using Scheduling tools (Control M)
· Qualifications:
o Bachelor's degree in computer science, data engineering, or a related field.
o Minimum of 6 years of professional experience in data engineering.
o Proficiency in Snowflake, Informatica & SQL.
o Strong understanding of data warehousing concepts and best practices.
o Experience in optimizing data pipelines for performance and scalability.
o Strong problem-solving and troubleshooting skills.
o Excellent communication and collaboration skills.
o Ability to work independently and as part of a team (Mid-Level)
o Should have prior experience working in agile .
· Key Skills: ETL, Informatic, IICS(Cloud Service) Data Processing, Data Migration, Data Warehousing, Snowflake, and AWS.
Job tags
Salary
