Lead Information Security Engineer - Hadoop and Cloud Admin
The Wells Fargo Foundation
Location
Bangalore | India
Job description
About Wells Fargo:
enables global talent capabilities for Wells Fargo Bank NA., by supporting business lines and staff functions across Technology, Operations, Risk, Audit, Process Excellence, Automation and Product, Analytics and Modeling. We are operating in Hyderabad, Bengaluru, and Chennai locations
Department Overview: The Data Products & Services team's mission in Cyber Security Data Science is to Provide a modern, well-managed, and easy-to-use data ecosystem for all cyber security analysts, data scientists, incident responders, and threat hunters toself-serveanalytical data to support accelerated threat detection, prevention and response, and to confidently secure and protect Wells Fargo's customers and assets
Democratize cybersecurity analytical data and enable a truly federated model where any entitled user can onboard, discover, reuse, shape and consume self-describing, trustworthy, and highly reliableanalytical dataapplied to diverse analytical uses.
Empower data scientists, analysts and engineers with on-demand access to trustworthy and reliable cyber security data, available in aform that they needfor their jobs, and using self-serve data platforms and services, that automatically enforce our data standards and controls.
About the Role: We have an excellent opportunity for Lead Information Security Engineer who would be working within Data Eco System team.The person selected for this position will work in a team that performs hadoop admin activities such as Installing, Configuring and Monitoring Hadoop Services
Responsibilities - Finding gaps & implementing required monitoring and observability for Hadoop clusters.
- Experience in understanding Hadoop multiple data processing engines such as interactive hql, real time streaming, data science
- Experience in architecting, designing, installation, configuration and management of Apache Hadoop, MapR Distribution, Cloudera Distribution Platform (CDP)
- Ability to lead a team efficiently and beresponsible for Administration, Installation, Configuration, Maintenance of different Hadoop component like HDFS, Hive, Spark, Hbase, MapR DB, Zookeeper, Cloudera, Oozie, Pig, Flume, Sqoop.
- Work closely with the Bigdata Dev Team, Application Support Team, Network Team, Analytical Team and Database Team to make sure that all the big data applications are highly available and performing as expected.
- Take care of the day-to-day support as part of on-call & assist with 24.7 on call and triage rotation. Troubleshooting application errors and ensuring fixes so that they do not occur again.
- Collaborating with application teams to install operating system and MapR updates, patches, version upgrades when required.
- Monitor the cluster connectivity and performance. Implement cluster observability by using different monitoring tool like Splunk/Grafana/Prometheus.
- Handle issues related to volume, quota management, volume replications.
- Manage & resolve ongoing core issues and work with vendors to fix issues permanently.
- Experience in understanding and managing Hadoop Log Files.
- Help application, production support and development team for troubleshooting different types of Jobs issues like Map Reduce, Spark, Hive , Sqoop..Etc..
- Manage scheduled backup and recovery tasks, resource and security management.
- Develop automation, installation, and monitoring of Hadoop ecosystem components.
- Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
- Automation of different services using (bash/Python scripting).
- Implement Data Security using groups/roles.
- Integration to other Hadoop platforms. Implement and manage Cluster security,
- Cluster maintenance as well as creation and removal of nodes
- Performance tuning of Hadoop clusters and Hadoop MapReduce routines.
- Help to fix ongoing IRIS vulnerability and help to improve platform security.
- Screen cluster job performances and capacity planning and batch processing to handle data store in Yarn platform.
- Diligently teaming with the infrastructure, network, database, application, and business analytical/intelligence teams to guarantee high data quality and availability.
- Develop documentation and playbooks to operate Hadoop infrastructure, update confluence pages.
- Exposure on Cloud technologies - Google Cloud Platform, Docker, Kubernetes, Ansible, Chef or Terraform
- Strong Airflow Admin Skills.
Essential Qualifications
- Bachelor's and/or master's degree in computer science or information systems
- 7+ years of experience in architecting, administrating, configuring, installation, and maintenance of Open Source Big-data applications, with focused experience on MapR distribution & operational experience on Cloudera Distribution.
- 4+ years of experience with big data tools such as Knox, HBase, Hive, Impala, Sqoop, Spark, Kafka, Atlas, Ranger
- 4+ years of Shell Scripting (Bash, Python, Perl)
- 3+ years of experience managing RDBMS solutions such as MySQL, Postgres, Oracle
- Proven experience configuring Ranger for use in multitenant environments
- Proven experience with Kerberos and Active Directory
- Good understanding of High availability
- Excellent knowledge of UNIX/LINUX OS
- Good understanding of OS concepts, process management and resource scheduling
Desired Qualifications
- Experience with data devaluation via encryption, masking, and tokenization solutions
- Experience with public cloud implementations, Google Cloud preferred.
- Cloud certifications such as Google Cloud Engineer preferred.
- Experience with implementing Attribute Based Access Control using Atlas and Ranger
- Experience using automation tools such as Ansible, Puppet, etc.
- Experience with AI/ML implementations in cloud environments
- Experience with Monitoring and Alerting Tools (Grafana, Nagios, etc.)
- Experience using Log Aggregation (Splunk, etc.)
We Value Diversity
At Wells Fargo, we believe in diversity, equity, and inclusion in the workplace accordingly, we welcome applications for employment from all qualified candidates, regardless of race, color, gender, national origin, religion, age, sexual orientation, gender identity, gender expression, genetic information, individuals with disabilities, pregnancy, marital status, status as a protected veteran or any other status protected by applicable law.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation, and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.
Posting End Date:
26 Mar 2024
We Value Diversity
At Wells Fargo, we believe in diversity, equity and inclusion in the workplace accordingly, we welcome applications for employment from all qualified candidates, regardless of race, color, gender, national origin, religion, age, sexual orientation, gender identity, gender expression, genetic information, individuals with disabilities, pregnancy, marital status, status as a protected veteran or any other status protected by applicable law.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.
Candidates applying to job openings posted in US:All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.
Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.
Applicants with Disabilities
To request a medical accommodation during the application or interview process, visit .
Drug and Alcohol Policy
Wells Fargo maintains a drug free workplace. Please see our to learn more.
Job tags
Salary