Friday, March 7, 2014

Changes 3/7/14

NSF:

  • Added header to csv that prints out all the tags
  • Switched write codec to unicode for file, as there were some unicode characters causing errors (such as the 1/2 character)
  • Looked at the ruby parser and converted some of the xpath tags to my format
  • Michelle is scraping different for different fields than what was originally in the google doc, so I will have to ask her about that
  • I'm not sure what the proper way to handle a comma within the scrape is.  If I write it to the file, it messes up the csv format

No comments:

Post a Comment