Huquo
Location
Bangalore | India
Job description
Job Description :The architect will play a crucial role in designing, implementing and maintaining data and technology solutions that align with our client's business goals and objectives. This role requires a deep understanding of AWS data services, good understanding of AWS Infra & Ops services, and the ability to translate business requirements into scalable and efficient solutions.Job Responsibilities :1. Data Architecture and Cloud Strategy - MUST HAVE- Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs.- Design, implement and manage cloud-based data infrastructure on AWS, ensuring scalability, reliability, and cost-efficiency.- Utilize AWS services (S3, Glue, EMR, Redshift, Lambda, Kinesis, etc.) to build and optimize data pipelines and storage solutions.- Champion the use of data warehouse architecture and optimize its performance for analytical and operational workloads.- Architect and implement data integration solutions for API ingestion, enabling data from diverse sources to be captured, transformed, and ingested into our data warehouse.- Manage data integration pipelines to support real-time and batch data processing.2. Workflow Orchestration :- Design, configure, and maintain workflow orchestration using Talend Management Console or Apache Airflow to automate ETL processes and data pipeline executions.- Monitor and optimize job scheduling, error handling, and performance of data workflows.3. Security and Compliance :- Implement data security protocols, access controls, and encryption to safeguard sensitive data.- Ensure compliance with data privacy regulations and industry standards.4. Collaboration and Documentation :- Collaborate with cross-functional teams to understand data requirements and provide data solutions to meet their needs.- Maintain comprehensive documentation for data engineering and data architecture processes and solutions.5. Infra & Operations :- Guide the team in setting up cloud Infra and automations.- Guide the operations team in setting up automated monitoring & alerts mechanism (ref:hirist.tech)
Job tags
Salary
