Location
Noida | India
Job description
Years of experience : 4 to 10 Years
Hands on experience in deploying Production grade Databricks cluster
- Hands on experience in Shell scripting/Perl/Python/Hive/SQL
- Sound UNIX abilities involving user management, security & permissions
- Sound knowledge about the Hardware (CPU, memory, disk, network, Firewalls etc.)
- Serve as the primary “Databricks account owner”, working with our platform operations staff to oversee billing, subscription levels, workspaces, host AWS accounts, audit logs, and high-level usage monitoring of the hundreds of users on the platform
- Work closely with the Privacera/Ranger DevOps Engineer on data access governance policy administration
- Work closely with our AWS cloud devops team on compute, storage and network resource management, ensuring that has a comprehensive view of resource consumption across AWS and Databricks
- Collaborate closely with our IDP team to ensure proper operation of our SAML and SCIM identity management integrations
- Work to implement Databricks delegated account administration with the various divisions and functions across the company
- Serve as the primary Databricks workspace administrator and work to build out a team of workplace admins across the company
- In all admin use cases, leverage the Databricks platform APIs to build out the capability to work through IaC automation with Terraform
- Provide primary platform technical assist to our Qlik CDC Data Factory team and other teams building data engineering and ML engineering pipelines
- Work collaboratively and proactively with software engineers and site reliability engineers across the platform engineering organization and the user community to anticipate, troubleshoot and resolve Databricks performance, connectivity, and security issues as they present themselves
- Research, adopt and relate new technologies to solve issues that arise while adhering to company security and standards.
A minimum of 2 years hands-on staging and production experience in each of the following areas
- Working with a team of 5 or more software engineers using Gitlab, Jenkins, or Azure DevOps.
- Infrastructure and configuration management tools including Terraform, Ansible or Chef
- Container orchestration services, especially Docker & Kubernetes
- Systems administration scripting methods such as Python, Bash or PowerShell.
Job tags
Salary
