Changes 2/19/14
NSF:
- The array storing the xml documents wasn't clearing after completion of a scrape, fixed that
- Correctly implemented checking for local files before downloading, the only problem now is if you break before downloading a file, next time it will stop the program due to a bad zip file, I'll have to fix that
- run.py is getting extremely long and hard to navigate, and I am thinking of splitting it into a utilities file, a main file, and an xml parsing file
- Attempted to fix up console output a bit
I would encourage you to follow your instincts on splitting up run.py. Abstraction -- that's the key to keep our heads from exploding! ;-)
ReplyDelete