Tekfortune IT India Pvt. Ltd.
Location
Pune | India
Job description
Title : Databricks Platform Administrator - SupportExperience : 4 to 10 YearsWork Location : Pune, Chennai & Bangalore LocationShift Timing : Max till 11PMNotice Period : Immediate to 45 DaysKey Skills : Databricks Support, SQL, Integration, Setup & Configuration of Databrick ClustersJob Description :We are seeking a highly skilled and experienced Databricks Engineer to join our growing team and play a crucial role in enhancing our data processing and analytics capabilities.As a Databricks Engineer you will be responsible for dealing with the most complex situations related to development, design, implementation, and maintenance of our Databricks environment to ensure optimal performance, scalability, and reliability while aligning with our audit and security standards. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers to build robust data pipelines and deliver actionable insights. Key Responsibilities : 1. Databricks Environment Management :Set up and configure Databricks clusters to meet specific project requirementsOptimize Databricks configurations for performance and cost-effectivenessEnsure the security and integrity of the Databricks environment2. Data Pipeline Development :Collaborate with data scientists and analysts to understand data requirementsDesign and implement scalable and efficient data processing pipelines using DatabricksTroubleshoot and optimize existing data pipelines for improved performance3. Integration and Collaboration :Work closely with cross-functional teams to integrate Databricks solutions into the overall data architectureCollaborate with software engineers to incorporate Databricks functionality into custom applications4. Monitoring and Maintenance :Implement robust monitoring and logging solutions for Databricks clustersConduct regular maintenance tasks, including updates and patches, to ensure system stabilityGenerate/ review consumption reports, identify abnormal consumption and take corrective action.Qualifications :Bachelor's degree in computer science, Engineering, or a related fieldMaster's Degree preferredProven experience as a Databricks Engineer or similar roleStrong proficiency in Apache Spark and DatabricksExperience with cloud platforms such as AWS, Azure, or Google CloudProficient in programming languages such as Python, Scala, or JavaSolid understanding of data architecture and ETL processes.Preferred Qualifications :Databricks CertificationExperience with big data technologies and distributed computingFamiliarity with machine learning frameworks (ref:hirist.tech)
Job tags
Salary
