Data Engineer Architect (Fivetran)
Location
Chennai | India
Job description
Position: Data Engineering Architect (Fivetran and Snowflake/postgres)
Purpose of the Position: As a Data Engineering Architect (Fivetran), this position requires candidates who are enthusiastic about data and driven to help in the organization's Analytics challenges. As a member of the team, you will help our clients on their data and analytics journey, by building data pipelines, improving consistency, and building the necessary infrastructure to support their analytics platform.
Key Result Areas and Activities:
- Generating documentation around descriptions, models dependencies, model SQL, sources, and tests. creating lineage graphs of the data pipeline, providing transparency and visibility into what the data is describing, how it was produced, as well as how it maps to business logic
- Will be responsible for working with external data for clients and ensuring that solutions are correctly built for collecting real-time data.
- Candidate should be able to perform and deliver under large and complex env.
- Involve in Design of pipelines
- Develop models to transform data into useful, actionable information
- Create Models and Identify Patterns.
- Build, test, and maintain database pipeline architectures
- Collaborate with management to understand company objectives
- Create new data validation methods and data analysis tool
- Ensure compliance with data governance and security policies
- Design and implement data models and transformations to support business needs
Work and Technical Experience:
- Experience designing and developing data integration solutions using ETL tools – Fivetran, DBT
- Hands-on experience in the implementation of cloud data warehouses using Snowflake, PostGres
- Hands-on experience in any cloud technologies, such as AWS, Azure, and/or Google Cloud
- Proficiency in SQL and database table design - able to write structured and efficient queries on large data sets
- Experience in a role performing data warehouse and analytics solution design and development using a variety of techniques
- Ability to understand data pipelines and modern ways of automating data using cloud-based and on-premise technologies
- Understanding of data architecture design, data modeling, and physical database design and tuning
- Knowledge of data visualization tools such as Power BI and/or Tableau
- Hands-on coding experience in Python, Spark, and/or Scala
- Experience in Developing and maintain Fivetran, DBT models, packages and documentation
- Experience in Designing and maintaining the Snowflake data architecture, ensuring scalability, security and high availability
- Experience in Developing and optimizing ETL processes using Snowflake's capabilities and other tools to load, transform and deliver data
- Experience with CI/CD and DevOps practices in the context of Snowflake
Must have :
- Experience working in Datawarehouse/ETL Projects
- 5+ years of working with Fivetran,
- 4+ years of Snowflake/PostGres ETL experience or equivalent
- Programming skills: PLSQL/ Database knowledge/Python
- Sound knowledge in AWS/Red Shift
- ETL Performance Tuning
- Team Managing skills
- Good Oral and Written Communication
- Experience with cloud data platforms (e.g., AWS, Azure)
- Fivetran and Snowflake/postgres
Good To Have:
- Fair knowledge of ETL testing
- Familiarity with data orchestration tools
- Experience of working within the Pharmaceuticals sector
- Snowflake and other Cloud technologies certifications preferred.
- Certification in DBT Tool or related data engineering technologies preferred.
- Exposure to DBT will be advantage.
Qualifications :
- Degree in Computer Science, Software Engineering, or a related field
Qualities:
- Is able to influence and implement change; demonstrates confidence, strength of conviction and sound decisions.
- Believes in head-on dealing with a problem; approaches in logical and systematic manner; is persistent and patient; is able to independently tackle the problem, is not over-critical of the factors that led to a problem and is practical about it; follow up with developers on related issues.
- Able to consult, write, and present persuasively
- Able to work in a self-organized and cross-functional team
- Able to iterate based on new information, peer reviews, and feedback
- Able to work seamlessly with clients across multiple geographies
- Research focused mindset.
Job tags
Salary
