Staff Data Engineer

Location

Bangalore | India

Job description

• For our Customer Experience AI ML COE team, we seek Hands-On Data Engineer who can work on designing & implementing high quality scalable data and analytics applications/platforms in agile environment

• Your ability to lead the data architecture, design, and implementation of maintainable, high-quality, and high-performing data analytics systems and AI applications is essential for success in this role
• Understanding of data modelling, transformation in big data environment and prior experience of building data pipelines using industry proven data platforms is must for this role

What you will do

• Actively seek out and solve tough data engineering problems.
• Develop and Implement Data Arch, Data Warehouse and Hot/Warm/Cold data storage policy in cost optimized way to support AI/ML/Data use cases across the company.
• Build large scale data pipelines with stream processing and batch processing involving high volume and variety of data.
• Build Architecture and Data pipelines to perform data ingestion, cleansing, transformation to provide data in proper format and timely basis for predictive analytics problems.
Who you are and what you bring
• B.E/B.Tech in Computer Science or Electrical Engineering from top tier college and 70% marks.
• 5-10 years experience designing, implementing large scale data engineering and data science distributed systems
• Advanced, inside-out knowledge of multiple data store system in relational and NoSQL databases, messaging queues, preferably a polyglot programmer who can code in at least 2 high-level languages (Java / Ruby / Python / JS / Go / Elixir)
• Expert and hands-on experience of fault-tolerant data engineering systems (Hadoop / HDFS / Cassandra / MongoDB / Spark etc.) and multi-datacenter/cloud architectures with at-least 1 cloud platform (AWS, Microsoft Azure, GCP) preferably AWS.
• Experience working with at least one Data and Machine learning platform (AWS, Palantir, Databricks, Snowflake etc) solving big data predictive analytics problems.
• Experience working as part of a product team, along with engineers and product managers, to define the problem and execute the data engineering and data science solutions.
• Ability to understand business concerns and formulate them as technical problems that can be solved using data and math/stats/ML.
• Experience in dealing with large scale, noisy, and unstructured data. Experience with time series data will be advantageous
• Ability to work on a fast-paced environment & Experience with IoT based systems preferred
• Demonstrable proficiency writing clean and concise code in Java, Python or R
• Passion for driving continual improvement initiatives on engineering best practices like coding, testing or monitoring. Excellent written and verbal communication skills.

Job tags

Salary