The docs module needs to offer an easy way to include documentation for multiple libs. The problem is that there are a lot of different ways to create online documentation. From something self made like pygame to generated api documentation with epydoc like pyglet to standardized documentation with Sphinx like pygame2.
I think the easiest way to get this solved would be to include sphinx documentation with [[http://bitbucket.org/scherfke/django-sphinxdoc/|django-sphinxdoc]]. Non-sphinx docs could be either converted to shpinx or - if not possible - included either in raw format (html) or with some customized hackery.