logo

JobNob

Your Career. Our Passion.

Data Engineer


V2 Tech Venture Private Limited


Location

Bangalore | India


Job description

Job Description

As a Lead Data Engineer at V2Solutions, you will lead the design, development, and deployment of data engineering solutions that have a significant impact on our clients' business. You will work closely with Principal Engineers and collaborate on projects related to trading platforms and analytics. Your primary responsibilities will include designing and organizing a PB-scale Data Warehouse, analyzing TB-scale real-time data, and optimizing data pipeline architecture. You will also be responsible for implementing process improvements, building infrastructure for data extraction and transformation, and preparing data for prescriptive and predictive modeling.

Responsibilities:
Data Analysis: Analyze and organize raw data to derive valuable insights and support decision-making processes.
Data Pipeline Architecture: Create and maintain optimal data pipeline architecture, ensuring efficient data processing and delivery.
Process Improvements: Identify, design, and implement internal process improvements, such as automating manual processes, optimizing data delivery, and enhancing infrastructure for scalability.
Data Infrastructure: Build and maintain the infrastructure required for optimal data extraction, transformation, and loading (ETL) from diverse data sources using SQL and AWS 'big data' technologies.
Modeling and Algorithm Development: Prepare data for prescriptive and predictive modeling, including building algorithms and prototypes to support data-driven decision-making.


Requirements:
Experience: 8-12 years of experience as a Data Engineer, with a proven track record of successful data engineering projects.
Big Data Expertise: Extensive experience in building and optimizing 'big data' data pipelines, architectures, and data sets.
Tool Proficiency: Proficiency with big data tools such as Spark, Flink, Kafka, Airflow, and other relevant technologies.
Database Skills: Strong experience with relational SQL and NoSQL databases, including but not limited to Postgres and Cassandra.
Problem Solving: Ability to perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Interested candidates please share your resume on [HIDDEN TEXT]


Job tags



Salary

All rights reserved