Location
Coimbatore | India
Job description
ConverSight is a SaaS B2B start-up providing an AI-powered augmented analytics platform for the next generation of business leaders. Our conversational intelligent platform uses Natural Language Processing and machine learning to converge the distance between data and insights.
We are looking for a Senior Data Engineer to understand business requirements for data analytics projects and build high-quality data processing/transformation programs. This role offers the opportunity to contribute as an individual contributor and module lead, bringing innovation at every step and fostering effective communication within the team and with customers.
Responsibilities
- Understand business requirements for the given data analytics project and build high quality data processing/transformation programs.
- Perform Data profiling and produce outcome in business terms.
- Design, develop and optimize the program by analysing bottle necks and resolving those in timely manner.
- Proactively surface the challenges or data quality issues and work to resolve the same in the right way.
- Contribute as individual contributor as well as module lead with very high degree of commitment and integrity.
- Bring innovation in every steps. Follow test driven development.
- Make effective communication within the team and with the customers.
Requirements
- Minimum of Bachelor's degree.
- 5+ Years of relevant experience.
- Certification or advanced courses in SQL/ML.
- Highly skilled in Advanced SQL.
- Highly skilled in Python, Data Engineering tools set like Pandas/Polars Dataframes, data-pipeline development etc.
- Experience in using any one of the data lake implementation like Delta Lake or Iceberg etc.
- Knowledge in Parquet and apache Arrow ecosystem.
- Analytical problem solving skills.
- Experience working in cloud based solutions.
- Very strong in both row level and bulk data processing approaches.
- Ability to arrive at design quickly without any major hand holding.
- Added Advantage for the right candidate:
- Ability to do detailed EDA and Feature Engineering
- Ability to work with Geo Special data
- Ability to write ML programs (Clustering, Regression, Classification)
- Has certification/Master’s degree in relevant area
Job tags
Salary
