logo

JobNob

Your Career. Our Passion.

Software Engineer (Python)


Aggregate Intelligence, Inc


Location

Coimbatore | India


Job description

Develop and maintain web scraping scripts and applications using Python.
Collaborate with cross-functional teams to identify data sources, extraction requirements, and project goals.
Extract, transform, and load (ETL) data from various websites and APIs efficiently.
Implement data quality checks and error handling mechanisms to ensure robust scraping pipelines.
Optimize web scraping performance and scalability.
Stay up-to-date with the latest web scraping technologies and best practices.
Troubleshoot and resolve any issues related to web scraping processes.
Work on enhancing and maintaining existing web scraping systems.

Requirements

Experience: 1-2 Years

We are seeking a Python Developer with a passion for web scraping to join our dynamic team. If you have a keen eye for data extraction, a strong coding background, and a desire to work on exciting web scraping projects, this role is for you.

A minimum of 1-2 years of prior experience with crawling systems and frameworks is required.

Bachelors degree in Computer Science, Information Technology, or a related field.

Proven experience with web scraping using Python, including libraries like Scrapy, Beautiful Soup, Selenium, and Puppeteer.

Strong understanding of web technologies such as HTML, JavaScript, CSS, and protocols.

Proficiency in data formats like XML, JSON, and familiarity with XPath.

Experience in solving CAPTCHA challenges and handling anti-bot mechanisms.

Knowledge of database systems and SQL for data storage and retrieval. Knowledge in MongoDB would be an advantage

Solid understanding of Git for version control.

Strong problem-solving skills and attention to detail.

Excellent communication and teamwork skills.

Ability to work independently and meet project deadlines.


Job tags



Salary

All rights reserved