Commits

Stephen Tanner committed f04a52f

More tweaks. Trying to figure out how to get the links back from the Future/Task.

  • Participants
  • Parent commits 83ffc36

Comments (0)

Files changed (2)

-import ipdb
 #@author stanner
 #This is an async web scraper. It uses modules for indivudal sites to handle descrepencies
 #between the way they are organized and accessed.
 
 
 
-
 if __name__ == "__main__":
     # execute only if run as a script
     main()
-import ipdb
 #This file will hold the helper functions to allow the scavenger app to handle the
 #generic features of fetching links and parsing posts.
 from bs4 import BeautifulSoup
         links = bs_page.find_all("a", class_="title")
 
         filtered = self.filter_links(links)
-        ipdb.set_trace()  ######### Break Point ###########
 
         return filtered
 
 
             page = yield from self._GET(href, compress='True')
             pages.append(page)
+
         return pages