gentoo.mahdi.cz

  

dev-python:Protego

Pure-Python robots.txt parser with support for modern conventions
https://github.com/scrapy/protego
Protego-0.3.1	BSD
download~amd64 ~x86	pypi
Protego-0.2.1	BSD
downloadamd64 arm64 x86	pentoo