Open Data Tools

Wikidata

Large free knowledge base and repository for structured data for the Wikipedia.

http://www.wikidata.org

Quandl

Search engine for financial, economic and social datasets.

http://www.quandl.com

ScraperWiki

Community for the creation and reuse of data scrapers with support for Ruby, Python and PHP and free scraper and data hosting.

http://scraperwiki.com

data-science-blogs - github

A curated list of data science blogs.

https://github.com/rushter/data-science-b...

Greasemonkey

Firefox Add-on to execute own Javascript files in the browser, which can be used to realize screen scrapers in Javascript.

http://addons.mozilla.org/de/firefox/addo...

Safecast

Global sensor network for collecting and sharing radiation measurements.

http://blog.safecast.org

Pachube

Service to create public or private API feeds from real-time data from sensors devices or environments, free and paid plans.

http://pachube.com

Scrapy (Python)

Scraping and web crawling framework for Python.

http://scrapy.org

Django Dynamic Scraper (Python/D...

Django app build on top of Scrapy to manage scrapers via the Django admin interface.

http://django-dynamic-scraper.readthedocs...

Nokogiri (Ruby)

Ruby library for scraping web pages.

http://nokogiri.org

Mechanize (Perl/Python/Ruby)

Library with versions in Perl, Python and Ruby for the automating interaction with websites and for website scraping.

http://mechanize.rubyforge.org

Stackoverflow - Overview Scrapin...

Overview on coding questions site Stackoverflow with different HTML scraping solutions for various programming languages.

http://stackoverflow.com/questions/2861/o...

google-refine

Powerful tool from Google for cleaning up and transforming messy data.

http://code.google.com/p/google-refine/

EXMERG

Tool for merging data from different spreadsheet or CSV files and creating dynamic charts.

http://www.exmerg.com

Google docs - spreadsheets

Google tool to create and share structured data (spreadsheets) online, can be used in combination with other Google tools like Google Chart Tools or google-refine.

http://www.google.com/google-d-s/spreadsh...

CKAN - the Data Hub Software

Open source software for publishing, sharing and finding data, used as a basis for many data catalogues.

http://ckan.org

Socrata

Open Data company providing a platform for institutions to publish and manage public data, used for many data catalogues.

http://www.socrata.com

Google Fusion Tables

Data management tool from google to import, merge, publish, visualize and share data in the cloud.

http://www.google.com/fusiontables/

Google Correlate

Tool from Google to find searches that correlate with real-world data (e.g. correlation between searches like "how to treat the flu" and actual flu activity).

http://correlate.googlelabs.com