Location
Secunderabad | India
Job description
Role: BigData Architect
Experience 6+ years
Location Hyderabad
Responsibilities
- Participate in design architecture, support projects, review information elements, including models, glossary, flows, and data usage.
- Provide guidance to the team in achieving the project goals/milestones.
- Contribute to multiple delivery teams, define best practices, build reusable components, build capability, align industry trends, and actively engage with wider data communities.
- Build real-time and batch ETL/ELT solutions using open-source technology like Spark/Flink/Storm/Kafka streaming.
- Create a data model (ER and Dimension model) to help data consumers create a high-performance consumption layer.
- Investigate new technologies, data modeling methods, and information management systems to determine which ones should be incorporated into data architecture and develop implementation timelines and milestones.
- Create or support production software/systems by identifying and resolving performance bottlenecks for production systems.
- Run multiple projects simultaneously following both waterfall and Agile methodologies.
- Maintain data quality by introducing data governance/validation framework.
Required Skill
- Prior experience in database concepts like Online Transaction Processing (OLTP), Online Analytical Processing (OLAP), Start and Snowflake Schema, Normalization and Demoralization, etc.
- Expertise in SAP, Talend, and Apache Nifi will be advantageous.
- Familiar with open-source workflow management software like Airflow/Oozie.
- Hands-on in managing the Engineering team and own Architecture best practices.
- Excellent coding experience in Big Data technologies like Hadoop, KAFKA, Hive, Spark , Flink, Storm, etc.
- Experience in any two of the cloud services - GCP/AWS/Azure.
- Good understanding of cloud data lake implementation, preferably GCP.
- Expert in Python and SQL.
Job tags
Salary
