Google Refine and easier HTML parsing

After spending most of the day BANGING my head on using Regex and GREL to handle HTML parsing.

I thought, there MUST be a better way to parse HTML !!!

I know several of you who have thought the same thing.  So, I took the time today to find out where and how this could be improved directly in Google Refine or with an extension.
It just so happens Google Refine already has a wonderful extension with another language itself: Jython

Enter BeautifulSoup  (love the name?) a Jython library for powerful HTML parsing and entity extraction.



Here's more on how to use it easily within Refine:

http://code.google.com/p/google-refine/wiki/StrippingHTML

Enjoy!
-Thad

Comments

Post a Comment

Popular posts from this blog

Display HTML content from a URL within OpenRefine using IFRAMES

Image
OpenRefine has a powerful feature with its Custom Tabular Exporter. Which can be used to fetch and preview URLs to review their HTML content in your web browser.  Handy for doing small reconciling tasks at times. :) 1. Create an empty <iframe> element with the src URL as shown (you can also add any iframe attribute options you need like width, height, etc - https://developer.mozilla.org/en-US/docs/Web/HTML/Element/iframe ):  2. Choose EXPORT --> Custom Tabular Exporter and select the URL column(s) and any others you may wish to view alongside the HTML content: 3. Choose Download tab and select HTML Table and then click Preview button.  This should launch another browser tab window. 4. The HTML Table is rendered with the iframe content being fetched as shown:
Read more

How to fix the Corsair mouse scroll wheel not working or erratic behavior

Image
Corsair Sabre Pro Gaming Mouse partial disassembly (model # RGP0091 and perhaps similar models with similar problems) How to open the Corsair Sabre Pro Champion Series mouse in 7 steps: OPTIONAL:  In the front of the mouse, carefully but with some force lift up vertically each mouse button until it clicks remaining upward which will help expose visibility of the locations of 2 non-removable clips on opposite sides of the mouse usb cable that are part of the bottom half of assembly. Insert a screwdriver or plastic wedge tool between the front and bottom assemblies to gently pry apart the top and bottom halves while also pushing forward on 1st clip location to push it back just enough to make clearance for top assembly to gap apart with some force from inserted 2nd screwdriver or plastic wedge tool to assist in separating top and bottom half assembly.  WARNING: The clips are plastic and part of the bottom assembly itself.  They do not remove.  They only need to be pus...
Read more