Changes 2/25/14
NSF:
- Fixed concurrent modification
- Added a handler for Ctrl+C (break) to delay breaking until after a scrape has completed if one is currently in progress
- Added a function that writes the current filename to a file called .breakpoint if the program breaks while scraping.
- This will prevent the program from skipping a file that has been downloaded but not yet scraped.
- I haven't yet implemented reading of .breakpoint, but I plan to have it remove the filename it contains from the remove array in removeDownloaded() thus keeping the filename in the queue to scrape.
Javascript:
No comments:
Post a Comment