Logic Planet
Location
Bangalore | India
Job description
Skills Required :- Proficient in Python, PySpark, SQL- Hands-on experience with Databricks, Kafka, and Cloud technologies (preferably AWS)- Strong knowledge of version control systems, especially GitHub- Familiarity with related development processes- GIT proficiencyRoles and Responsibilities :1. Data Engineering :- Develop, construct, test, and maintain data architectures (databases, large-scale processing systems, data lakes, etc.).- Design, build, and maintain efficient, reusable, and reliable Python and PySpark code.- Implement ETL processes to transform raw data into a usable and accessible format.- Work with stakeholders to understand data requirements and provide effective solutions.2. Cloud and Big Data Technologies :- Utilize cloud platforms, particularly AWS, for data storage, processing, and analysis.- Implement and optimize data pipelines using technologies such as Databricks and Kafka.- Stay abreast of emerging technologies in cloud and big data and make recommendations for adoption.3. Source Control and Dev Process :- Implement and maintain source control processes using GitHub.- Collaborate with development teams to ensure efficient and organized source code management.- Contribute to the continuous improvement of development processes.4. Collaboration and Communication :- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders.- Communicate effectively with technical and non-technical stakeholders to gather requirements and provide updates.5. Quality Assurance :- Implement best practices for data quality assurance and validation.- Perform testing and debugging to ensure data accuracy and reliability.Benefits :- Medical insurance coverage.- Provident Fund (PF) and Gratuity benefits.- Five working days a week to maintain a healthy work-life balance. (ref:hirist.tech)
Job tags
Salary
