Location
Secunderabad | India
Job description
- Be a founding member of the data engineering team
- Help to attract talent to the team by networking with your peers, by representing PepsiCo at conferences and other events, and by discussing our values and best practices when interviewing candidates
- Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics
- Ensure that we build high quality software by reviewing peer code check-ins
- Define best practices for product development, engineering, and coding as part of a world class engineering team
- Work on a product team leveraging our core technology platforms, which include Direct Commerce, Supply Chain, Marketing Automation, Mobile, and Data
- Collaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms
- Lead feature development in collaboration with other engineers; validate requirements / stories, assess current system capabilities, and decompose feature requirements into engineering tasks
- Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineers
- Develop software in short iterations to quickly add business value
- Introduce new tools / practices to improve data and code quality; this includes researching / sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers
- Support data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issues
Qualifications o4+ years experience developing data pipelines / ETLs
oDeep understanding of database design and engineering
oStrong familiarity with automated test frameworks
oCurrent skills in following technologies:
o Python
o Airflow, Luigi, or similar orchestration platforms
o Relational databases - Postgres, MySQL, or similar
o AWS, Azure, or similar cloud platforms
o GitHub or similar source control
o Automated build process and tools
Fluent with Agile processes and tools such as Jira or Pivotal Tracker; must have experience running Agile teams, continuous integration, automated testing, and test-driven development.
Job tags
Salary
