Roles and Responsibilities :
- Experienced in Python, with knowledge of Scrapy framework
- Maintaining the running web crawlers full-stack application
- Design-build web crawlers to scrape data and URLs.
- Integrate the data crawled and scraped into our databases
- Create more/better ways to crawl relevant information
- Builds and maintain new API integrations to support continuing increases in data volume and complexity
- Python Tech stack (Python library: Requests, Urllib, Beautifulsoup)
- 0.5-3+ years of experience in Python.
- Experience with web crawler projects.
- Should have knowledge in scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-Harvest and others.
- Python, SQL / MySQL, Scrapy Framework via Python; Beautiful soup
- Good communication skills.
Minimum of 0.5 - 3 Year(s) Of Experience