Location
Sahibzada Ajit Singh Nagar | India
Job description
- Design and implement data architectures: This involves analyzing business needs, selecting appropriate technologies, and creating blueprints for data ingestion, transformation, storage, and processing using Databricks.
- Build and optimize data pipelines: Develop efficient and reliable data flows that move data from various sources to destinations, ensuring data quality, performance, and security.
- Collaborate with stakeholders: Work closely with data engineers, analysts, and business users to understand requirements, translate them into technical solutions, and communicate effectively.
- Monitor and troubleshoot issues: Proactively identify and resolve performance bottlenecks, data quality problems, and other technical challenges in the data pipelines.
- Stay up-to-date with the latest technologies: Continuously learn about new features and capabilities of Databricks and related technologies to adapt and improve solutions.
- Document and share knowledge: Create clear and concise documentation of architectures, designs, and processes to ensure knowledge transfer and maintainability.
Qualifications:
- Experience: 12+ years of experience in data architecture or engineering with Databricks.
Technical skills:
- Proficiency in SQL, Python, and Scala.
- Understanding of big data concepts and frameworks (Spark, Hadoop, etc.).
- Knowledge of cloud platforms (AWS, Azure, GCP) is a plus.
- Familiarity with data security and governance best practices.
Soft skills:
- Excellent communication and collaboration skills.
- Problem-solving and analytical skills.
- Ability to work independently and as part of a team.
Job tags
Salary
