CompletumHealth Inc
Location
Delhi | India
Job description
Real-Time Data Engineer About us:
At Completum, we aim to transform lives by helping people reverse diabetes and regain health. Completum leverages data to drive innovation and growth in the field of Health & Science. Our platform empowers smarter decisions through advanced analytics, machine learning, and artificial intelligence. We believe Diabetes can be reversed. Life is a finite phenomenon, and we believe strongly in living it to the healthiest. Diabetes hits close to home & often, we live a solitude-driven treatment with little help beyond a doctor. We don’t have enough in our ecosystem to help with treatment, support, or monitoring. Let’s help our near ones live a diabetes-free life. Completum roadmap includes creating a global diabetes reversal company with services in the American and ASEAN markets. As Completum prototypes and refines the product/platform, future modules will be rolled out to appropriate geographies. We are looking for a skilled Cloud Data Engineer to join our growing data team who have proven experience working in Product Companies/Product build outs . The Data Engineer will build, optimize, and maintain the data pipelines that feed our analytics systems, machine learning models and make real-time decisions. This role requires strong software engineering skills, data modeling experience, and a solid understanding of real-time data frameworks primarily in the space Complex Event processing architectures. Job Responsibilities Develop, construct, test, and maintain real-time data architectures which may include document stores, Indexers, data lakes with data pipelines. Build processes supporting real-time data transformation, data structures, metadata, dependency, and workload management. Build complex event processing architecture and pipelines driven/configured from data processing policies/configuration/YAMLs OR DSLs. Work with stakeholders to understand and translate business needs into technical requirements. Integrate Machine learning solutions, configuration management into DSL based real-time workflows for push down to various components within the platform. Write API modules to SAAS services available outside the Completum tech stack. This will include 3rd party companies e.g. testing agencies, government agencies, digital platforms etc.. Load large, complex data sets (PDS, JPEGs, Medical records, Events) into data frameworks like Spark, MongoDB, etc. Optimize data delivery systems for speed, scale, and reliability. Construct DEVOPS integrated Test driven development code with potential one click deployments. Perform root cause analysis on data issues and propose solutions. Monitor and troubleshoot data pipelines to ensure optimal performance. Collaborate with Data Scientists to implement models in production environments. Follow software engineering best practices around version control, documentation, testing, and deployment. Skill Sets for Role Bachelor’s degree in computer science, Engineering, or related field. 5+ years of experience building data pipelines, ETLs, and data models. Proficiency with Python, C# for manipulating, transforming, and processing data. Experience with Kafka or similar streaming (Spark) frameworks in Azure/Dot net/Open Source stacks. Ability to build DSL based architecture is a must Working with rules engines such as Activiti, Drools etc. would be highly desirable.. Working knowledge of SQL databases (Postgres, MySQL) and NoSQL databases (Cassandra, MongoDB). Experience with API based frameworks such as Postman, Mulesoft etc. Experience with cloud data platforms (AWS, Azure, GCP) Familiarity with container technologies like Docker and Kubernetes Strong analytic, problem-solving, and troubleshooting abilities Excellent written and verbal communication skills. Ability to work independently and collaboratively in a fast-paced environment. Soft Skills Required High level of personal initiative and energy. Very good verbal and written communication skills. Capable of working autonomously with minimal to no daily oversight. Strong experience leading a team to deliver high-quality software solutions. Must raise issues as required, clearly defining the issue and potential solutions. Common sense approach to problems. Capable of adapting written processes when required and capturing improvements to the process for later review. Technical Skill Sets (Mandatory) Advanced Experience with implementing NOSQL databases e.g. – MongoDB, Cassandra, Redis and other services Experience working with Cloud based data warehouses e.g. Snowflake, Azure SQL Data Warehouse, or Google BigQuery experience would be nice to have Advanced Experience with building data pipelines - using a variety of different technologies: Azure Data Factory, Kafka Streams, DBT, Python & Spark. API integration works with technologies such as Mule, POSTMAN etc. Candidates must have direct work experience developing and deploying at least one project where they implemented the full cloud data pipeline documented on their resume. Working experience in a Product company is a MUST Advanced understanding of SQL. Need to be well versed in Software engineering principles around Object Oriented Programming & SOLID principles. Excellent development experience with Python, C# (3-4 Years). Strong ability to gather and track requirements. Must have experience with DevOps. i.e. (Git +CI/CD + IaC). Experience with Docker containers, including containerizing services and deploying containers in a cloud environment. Knowledge of the following would be an asset Open-source contributions of any sort. Experience with BI platforms such as Spotfire, Tableau, PowerBI, Zoomdata, SuperSet, etc. Data cataloging and governance techniques. Strong Agile methodology knowledge. How to Apply Interested candidates should submit their resume and a cover letter detailing their relevant experience and qualifications to [email protected] . Please include "Real-Time Data Engineer” in the email's subject line. We offer a competitive salary, benefits, and immense opportunities for impact in improving lives. If you're a talented, compassionate nutrition professional looking to join a mission-driven team, we want to hear from you!Job tags
Salary
