.. PyCrawler documentation master file, created by sphinx-quickstart on Sun Jan 06 13:15:57 2013. You can adapt this file completely to your liking, but it should at least contain the root `toctree` directive. Welcome to PyCrawler's documentation! ===================================== PyCrawler is a Breadth-first multithread crawler This projects depends on the following packages: * Queue * urllib2 * urlparse * time * Set * threading * datetime * logging * HTMLParser import HTMLParser Contents: .. toctree:: :maxdepth: 2 project code Indices and tables ================== * :ref:`genindex` * :ref:`modindex` * :ref:`search`