Impetus
Location
Bangalore | India
Job description
Locations: Noida/Gurgaon/Indore/Bangalore/Pune/Hyderabad Experience: 5-12 years
Job Description Hands on experience in deploying Production grade Databricks cluster Hands on experience in Shell scripting/Perl/Python/Hive/SQL Sound UNIX abilities involving user management, security & permissions Sound knowledge about the Hardware (CPU, memory, disk, network, Firewalls etc.) Serve as the primary “Databricks account owner”, working with our platform operations staff to oversee billing, subscription levels, workspaces, host AWS accounts, audit logs, and high-level usage monitoring of the hundreds of users on the platform Work closely with the Privacera/Ranger DevOps Engineer on data access governance policy administration Work closely with our AWS cloud devops team on compute, storage and network resource management, ensuring that has a comprehensive view of resource consumption across AWS and Databricks Collaborate closely with our IDP team to ensure proper operation of our SAML and SCIM identity management integrations Work to implement Databricks delegated account administration with the various divisions and functions across the company Serve as the primary Databricks workspace administrator and work to build out a team of workplace admins across the company In all admin use cases, leverage the Databricks platform APIs to build out the capability to work through IaC automation with Terraform Provide primary platform technical assist to our Qlik CDC Data Factory team and other teams building data engineering and ML engineering pipelines Work collaboratively and proactively with software engineers and site reliability engineers across the platform engineering organization and the user community to anticipate, troubleshoot and resolve Databricks performance, connectivity, and security issues as they present themselves Research, adopt and relate new technologies to solve issues that arise while adhering to company security and standards. A minimum of 2 years hands-on staging and production experience in each of the following areas Working with a team of 5 or more software engineers using Gitlab, Jenkins, or Azure DevOps. Infrastructure and configuration management tools including Terraform, Ansible or Chef Container orchestration services, especially Docker & Kubernetes Systems administration scripting methods such as Python, Bash or PowerShell. Roles & Responsibilities Good aptitude and attitude, Flexible to upskill and cross-train. Willing to provide onsite/night overlaps Assist in operational enablement in different environments Assist use cases team in deploying artifacts in cloud environments Work with Infra, security & networking teams to resolve firewall and port issues in cloud Monitor daily operations – service restoration, Debug job failures Assist use cases teams in troubleshooting failures Identify manual process and activities and automate using shell, Python, etc. Utilize existing Incident management process & tools for issues tracking & resolution Continuous monitoring, Troubleshooting, and debugging of issues in the cloud eco-system Prepare knowledge base and documents on environment configuration, deployment, etc. Contribute to improve the efficiency of the assignment by quality improvements & innovative suggestions Contribute in developing a knowledge base on collaboration with other team members Maintain customer loyalty through Integrity and accountabilityJob tags
Salary
