Squareroot Consulting Pvt Ltd
Location
New Delhi | India
Job description
Job Description :We are seeking a highly skilled and motivated experienced Data Architect to join our dynamic team with expertise in Scala, Kafka, Spark, Big Data, and Batch Processing. As a Data Architect, you will play a crucial role in designing, implementing, and maintaining the data architecture that supports our organization's data-driven initiatives. Your expertise in Scala, Spark, and Kafka will be essential in building scalable and efficient data processing solutions.Key Responsibilities :Data Architecture Design : - Collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient data architecture solutions.- Design end-to-end data pipelines and architectures that support data integration, processing, and analytics.Scala, Spark, and Kafka Expertise :- Utilize your strong proficiency in Scala programming language to develop robust and scalable data processing applications.- Design and implement Spark-based solutions for large-scale data processing and analytics.- Implement and optimize Kafka for real-time data streaming and event-driven architectures. Data Modeling :- Develop and maintain conceptual, logical, and physical data models to ensure data consistency, integrity, and availability.- Design data structures that support both operational and analytical requirements. Data Governance and Security : - Establish and enforce data governance policies to ensure the quality, accuracy, and security of data.- Implement security measures to protect sensitive data and comply with relevant regulations.Collaboration and Communication : - Work closely with data engineers, analysts, and other stakeholders to understand data requirements and provide guidance on best practices.- Communicate complex technical concepts to non-technical stakeholders in a clear and understandable manner.Performance Optimization : - Identify and implement optimizations to improve the performance and efficiency of data processing pipelines.- Troubleshoot and resolve issues related to data processing and integration.Qualifications :- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.- Proven experience as a Data Architect with a focus on Scala, Spark, and Kafka.- Strong proficiency in Scala programming language.- In-depth knowledge of Apache Spark for large-scale data processing.- Experience in designing and implementing Kafka-based data streaming solutions.- Understanding of data governance principles and security best practices.- Excellent communication and collaboration skills. Preferred Skills :- Certification in Scala, Spark, or Kafka.- Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).- Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).- Familiarity with machine learning and advanced analytics (ref:hirist.tech)
Job tags
Salary
