Logic Planet
Location
Bangalore | India
Job description
Calling all talented data engineers with 4-6 years of experience or more!
We are looking for both senior and lead data engineers who are proficient in Python, PySpark, SQL, Databricks, Kafka, Cloud, AWS, and GIT. This is your chance to showcase your expertise and make a significant impact in the world of data.
Skills Required :
- Proficient in Python, PySpark, SQL
- Hands-on experience with Databricks, Kafka, and Cloud technologies (preferably AWS)
- Strong knowledge of version control systems, especially GitHub
- Familiarity with related development processes
- GIT proficiency
Roles and Responsibilities :
1. Data Engineering :
- Develop, construct, test, and maintain data architectures (databases, large-scale processing systems, data lakes, etc.).
-Design, build, and maintain efficient, reusable, and reliable Python and PySpark code.
- Implement ETL processes to transform raw data into a usable and accessible format.
- Work with stakeholders to understand data requirements and provide effective solutions.
2. Cloud and Big Data Technologies :
- Utilize cloud platforms, particularly AWS, for data storage, processing, and analysis.
- Implement and optimize data pipelines using technologies such as Databricks and Kafka.
- Stay abreast of emerging technologies in cloud and big data and make recommendations for adoption.
3. Source Control and Dev Process :
- Implement and maintain source control processes using GitHub.
- Collaborate with development teams to ensure efficient and organized source code management.
- Contribute to the continuous improvement of development processes.
Benefits :
- Medical insurance coverage.
- Provident Fund (PF) and Gratuity benefits.
- Five working days a week to maintain a healthy work-life balance.
Job tags
Salary
