Location
India | India
Job description
Job Title: Data Engineer
Location: Remote (Offshore – India)
Duration: Contract Opportunity
Job Description: We are seeking a highly skilled Senior Data Engineer with over 10 years of overall experience, including a minimum of 4 years specifically in Big Data with prior expertise in ETL processes. The ideal candidate should possess a strong background in working with Azure Databricks, Delta Lake, Parquet, and Snowflake, along with hands-on experience in utilizing Jenkins and Groovy scripts for seamless integration.
Responsibilities: - Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions.
- Utilize your expertise in Azure Databricks, Delta Lake, Parquet, and Snowflake to develop and maintain robust data pipelines.
- Implement ETL processes, ensuring data quality, reliability, and optimal performance.
- Work closely with DevOps teams to integrate and automate data workflows using Jenkins and Groovy scripts.
- Hands-on experience with Spark and Hive to develop scalable and efficient data processing applications.
- Troubleshoot and optimize existing ETL processes for enhanced performance.
- Stay abreast of industry trends and advancements in Big Data technologies.
Qualifications: - Bachelor's degree in Computer Science, Engineering, or a related field.
- Minimum of 10 years of overall professional experience.
- At least 4 years of hands-on experience in Big Data with a focus on ETL processes.
- Proficiency in working with Azure Databricks, Delta Lake, Parquet, and Snowflake.
- Strong programming skills, particularly with Spark, Hive, and experience in ETL processing.
- Previous experience using Jenkins and Groovy scripts for CI/CD processes.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills with the ability to collaborate effectively in a team environment.
Job tags
Salary
