Location
Bangalore | India
Job description
The Data Engineer will play a key role in designing, developing, and maintaining data architecture, ensuring the efficient and reliable flow of information across various systems. Primary responsibilities will include building robust data pipelines, optimizing data workflows, engineering best practices for sustainable and scalable delivery, and collaborating with cross-functional teams to support our data-driven decision-making processes.
- Build and maintain data pipelines between source data and analytical databases.
- Implement and evangelize engineering best practices for sustainable and scalable delivery.
- Work with solution architect, Data Modelers, BI Analysts and Product Managers to take an active role in solution design.
- Help identify MVP and iterative design approach in an agile framework.
- Identify necessary business rules for extracting data along with functional and technical risks related to data sources.
- Develop initial Queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define path to deployment.
- Bachelor's degree in a relevant field (e.g., Statistics, Mathematics, Computer Science, Business) or equivalent practical experience.
- Proven experience as a Data Engineer with a minimum of 2-3 years in a similar role.
- Proficiency in data engineering tools such as SQL, Python, R, or other relevant languages.
- Experience with data visualization tool Power BI.
- Strong analytical and problem-solving skills with a keen attention to detail.
- Excellent communication skills to convey complex data findings to non-technical stakeholders.
- Self-motivated with the ability to work both independently and collaboratively in a fast-paced environment.
- Proven experience with Python, MySQL, PySpark, NoSQL, SQL Server, Windows, Linux(Shell, API, Batch scripting), GIT, Documentation, Azure, Data Warehousing
- Preferred experience with PostgreSQL, Full Stack Web Dev, UNIX, API Development, Automation Development, MS Office tools development, PBI/Tableau/Google Analytics, DevOps Automation
Job tags
Salary
