Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; WP_MatchesMapRegex has a deprecated constructor in /home/stevensa/public_html/wp-includes/class-wp.php on line 635

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Translation_Entry has a deprecated constructor in /home/stevensa/public_html/wp-includes/pomo/entry.php on line 14

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; POMO_Reader has a deprecated constructor in /home/stevensa/public_html/wp-includes/pomo/streams.php on line 12

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; POMO_FileReader has a deprecated constructor in /home/stevensa/public_html/wp-includes/pomo/streams.php on line 106

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; POMO_StringReader has a deprecated constructor in /home/stevensa/public_html/wp-includes/pomo/streams.php on line 150

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; POMO_CachedFileReader has a deprecated constructor in /home/stevensa/public_html/wp-includes/pomo/streams.php on line 189

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; POMO_CachedIntFileReader has a deprecated constructor in /home/stevensa/public_html/wp-includes/pomo/streams.php on line 204

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; WP_Widget_Factory has a deprecated constructor in /home/stevensa/public_html/wp-includes/widgets.php on line 405

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Jetpack has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/class.jetpack.php on line 25

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Jetpack_User_Agent_Info has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/class.jetpack-user-agent.php on line 61

Deprecated: Array and string offset access syntax with curly braces is deprecated in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/shortcodes.php on line 79

Deprecated: Array and string offset access syntax with curly braces is deprecated in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/shortcodes.php on line 109

Deprecated: Unparenthesized `a ? b : c ? d : e` is deprecated. Use either `(a ? b : c) ? d : e` or `a ? b : (c ? d : e)` in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/shortcodes/soundcloud.php on line 131

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; safecss has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/custom-css/custom-css.php on line 1448

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Jetpack_RSS_Links_Widget has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/widgets/rsslinks-widget.php on line 9

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Jetpack_Image_Widget has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/widgets/image-widget.php on line 9

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Jetpack_Notifications has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/notes.php on line 25

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Jetpack_Subscriptions has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/subscriptions.php on line 39

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Jetpack_Subscriptions_Widget has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/subscriptions.php on line 519

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/load.php on line 545

Warning: Unterminated comment starting line 10 in /home/stevensa/public_html/wp-content/themes/themuse-child/functions.php on line 10

Deprecated: Function get_magic_quotes_runtime() is deprecated in /home/stevensa/public_html/wp-content/themes/themuse-parent/framework/BootsTrap.php on line 6

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-content/themes/themuse-parent/framework/core/REQUEST.php on line 13

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Nav_Menu_Widget has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Nav_Menu_Widget.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Archives has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Archives.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Calendar has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Calendar.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Categories has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Categories.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_flickr has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Flickr.php on line 5

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Login has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Login.php on line 4

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Meta has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Meta.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_newsletter has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Newsletter.php on line 5

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Pages has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Pages.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Recent_Comments has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Recent_Comments.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Recent_Posts has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Recent_Posts.php on line 4

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Search has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Search.php on line 5

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Tag_Cloud has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Tag_Cloud.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Text has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Text.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TFuse_Widget_Twitter has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/widgets/TFuse_Widget_Twitter.php on line 2

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-content/themes/themuse-parent/framework/helpers/GENERAL.php on line 405

Deprecated: Function create_function() is deprecated in /home/stevensa/public_html/wp-content/themes/themuse-parent/framework/core/INIT.php on line 84

Deprecated: The behavior of unparenthesized expressions containing both '.' and '+'/'-' will change in PHP 8: '+'/'-' will take a higher precedence in /home/stevensa/public_html/wp-content/themes/themuse-parent/framework/extensions/reservationform/config/utils.php on line 4

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TF_SEO_SitemapGeneratorXmlEntry has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/framework/extensions/seo/helpers/SEO.php on line 4

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; TF_SEO_SitemapGeneratorPage has a deprecated constructor in /home/stevensa/public_html/wp-content/themes/themuse-parent/framework/extensions/seo/helpers/SEO.php on line 21

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; S2_Form_widget has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/subscribe2/include/widget.php on line 2

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Sharing_Service_Total has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/sharedaddy/sharing-service.php on line 352

Deprecated: Methods with the same name as their class will not be constructors in a future version of PHP; Sharing_Post_Total has a deprecated constructor in /home/stevensa/public_html/wp-content/plugins/jetpack/modules/sharedaddy/sharing-service.php on line 374
Data Viz in 6 Weeks. Wk 5: Data | Creative Technology
Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Warning: count(): Parameter must be an array or an object that implements Countable in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/theme_includes/THEME_FUNCTIONS.php on line 1681

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 1697

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 1697

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 1697

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Indirect modification of overloaded property WP_Post::$Array has no effect in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Warning: Illegal string offset 'output_key' in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Indirect modification of overloaded property WP_Post::$Array has no effect in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Warning: Illegal string offset 'output_key' in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Indirect modification of overloaded property WP_Post::$Array has no effect in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Warning: Illegal string offset 'output_key' in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Indirect modification of overloaded property WP_Post::$Array has no effect in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Warning: Illegal string offset 'output_key' in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Array to string conversion in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Notice: Indirect modification of overloaded property WP_Post::$Array has no effect in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Warning: Illegal string offset 'output_key' in /home/stevensa/public_html/wp-includes/nav-menu.php on line 601

Warning: count(): Parameter must be an array or an object that implements Countable in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/theme_includes/THEME_FUNCTIONS.php on line 1681

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Warning: count(): Parameter must be an array or an object that implements Countable in /home/stevensa/public_html/wp-content/themes/themuse-parent/theme_config/theme_includes/THEME_FUNCTIONS.php on line 1681

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 1697

Data Viz in 6 Weeks. Wk 5: Data

An adventurer has brought to life the floating home from Pixar movie Up

Data
Data Viz isn’t just about cool visualizations; it’s also about data. This week we tackled the subject of data: Big Data, Open Data, curating data, data wrangling tools, as well as a little bit of stats.

What is Big Data?
I’ve always found the term Big data a bit curious because of its similarity to Big Pharma, Big Oil, Big Sugar and Big Tobacco; all largely pejorative terms that refer more to the powerful super-giant corporations that dominate each industry than to the product being harvested or manufactured. Big Anything implies profit at any cost and money-no-object special interest lobbying power.

So, when big data was coined and popularized in the 1990s and the 2000s, was it a deliberate nod to those other Big industries? I’ve looked into a few histories of the term, but can’t find anything that addresses the question. Any thoughts?

Definitions of big data typically focus on what makes the data (i.e. the product) unique rather than the corporations who have vested interests in it (despite our growing awareness of these corporations and security services). For example, Wikipedia describes big data as ”a blanket term for any collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications”.

In 2001, Gartner characterized Big Data as growing along 3 different axes — the 3 V’s — not just volume, but variety and velocity as well.

  • Data volume: Yes, big data is big. We’ve all heard the stats about how more data has been collected in the last second than all of previous human history. (Okay, that’s not exactly true—yet; but it may be just a matter of time.)
  • Variety: Big data comes in a wide range of forms: text, image, sound, social media, metadata, location data, transaction data or sensor data. Sources can be human or automated (i.e. things talking to things in the Internet of Things); formal or informal; structured or not. Originating from a range of sources using different units, terms, definitions, protocols, quality standards and languages, big data is messy.
  • Velocity: Big data travels fast but is also very volatile. In social media, information can flow in nearly real time or suddenly go viral. As a result, data needs to be frequently updated or else become obsolete.

Big data – the new oil
When data becomes a commodity, then it stands to reason that the more data the better, right? Maybe not. In many cases, the challenge isn’t to make more data, but to figure out what to do with what we already have. In other words, the challenge is curation rather than creation. Curation is about finding meaning in data, storytelling and adding value to data. And, of course, this is data visualization’s mission.

Some common curation tasks involve:

  • Consolidating data from different sources
  • Tidying it up to make it internally consistent. For example, even if you are using two different files from the same city’s Open Data portal, you can be sure that no City bureaucrats spent any precious time making sure their department’s date formats, naming protocols or number of decimal places were consistent with those from some other department, just to make your job easier. You can expect to have to do that yourself.
  • Structuring unstructured data
  • Restructuring data to make it more useful for visualizations
  • Editing out unnecessary data to reduce processing load on your visualization program
  • Verifying accuracy of data from unfamiliar sources
  • Updating and maintaing data

Maybe not the most glamourous side of data viz, but important none the less.

This week’s tools
In keeping with this week’s theme, we used the second half of the class to try our hands at a number of open source tools for wrangling and scraping data:

The verdict? Investing a little time to learn XPath code goes a long way, when combined with GoogleDocs and Scrape Similar. Here’s a couple of good tutorials:

Next week
Metaphor in data visualization
Processing and D3.js programming tools for custom designed data visualizations

DataViz in 6 Weeks is my blog about teaching Introduction to Visual Analytics at OCAD University in Toronto. Comments, follows and shares welcome. #DataVizInSixWeeks

Anne Stevens I am a multidisciplinary designer working in data visualization, interaction design, innovation and critical design. I am particularly interested in non-screen based physical representations of data and tangible user interfaces.


Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466

Deprecated: Function get_magic_quotes_gpc() is deprecated in /home/stevensa/public_html/wp-includes/formatting.php on line 3466