Penguin International
Location
Gurgaon | India
Job description
Company Overview:
Penguin International, a renowned research and analytics firm, is seeking a talented Junior Data Engineer. This role is a fantastic opportunity for individuals with a passion for data engineering, especially in areas like web scraping, data automation, and cloud-based data management. Join our team to contribute to innovative projects and develop your skills in a dynamic environment. Key Responsibilities: Data Automation and Web Scraping Pipelines: Develop, deploy, and maintain data automation and web scraping pipelines. Play a pivotal role in the end-to-end delivery of complex data engineering projects. Write and optimize data extraction pipelines and workflows, adapting to evolving product features. Technical Leadership and Cloud Environment Management: Provide technical guidance in cloud environments, focusing on scaling and replicating pipelines. Lead data infrastructure, deployment, and testing activities, with hands-on experience in CI/CD. Data Quality and Operational Excellence: Enhance data quality and reliability of web extraction and automation pipelines. Uphold standards and best practices for platform efficiency and operational excellence. Stakeholder Management and Documentation: Manage stakeholder relationships and maintain comprehensive documentation for reproducibility. Qualifications: Bachelor’s degree in Computer Science, Engineering, or a related field. At least 6 months of experience in data engineering, preferably with exposure to data automation. Expertise in Python, especially in web scraping and API development. Familiarity with technologies such as Airflow, Redis, Celery, Selenium, MongoDB, Flask/Django/FastAPI, and Docker. Understanding of AWS environments, including EKS. Experience in data extraction/automation pipelines at scale. Eagerness to learn new technologies and programming languages. Strong analytical, problem-solving, and communication skills. Team player with a meticulous attention to detail.Job tags
Salary
