{"id":20657,"date":"2015-04-06T05:00:53","date_gmt":"2015-04-06T11:00:53","guid":{"rendered":"https:\/\/tested-neuron.flywheelsites.com\/?p=20657"},"modified":"2015-04-08T20:07:00","modified_gmt":"2015-04-09T02:07:00","slug":"big-data-buzz-intel-action-gaps","status":"publish","type":"post","link":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/","title":{"rendered":"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action?"},"content":{"rendered":"

I recently gave a talk at<\/strong> the American Association for the Advancement of Science about Big Data and Analytics and why it matters for development. Unlike other speakers who warned about risks associated with big data\u2014when too much is known about too many people without their consent\u2014I discussed the problem of data gaps and data poverty in the developing world. The challenge of measuring of poverty is different because if we don\u2019t have the data, we can\u2019t know whether we\u2019re making progress in fighting this stain on our collective moral conscience.<\/p>\n

If we don\u2019t have the data, we can\u2019t know whether we\u2019re making progress in fighting this stain on our collective moral conscience<\/i> Tweet This Quote<\/a><\/span><\/p><\/blockquote>\n

The World Bank for example, monitors poverty in 155 countries, but we only have recent poverty estimates for half of them, and those estimates are already five years old. This is problematic for an institution whose stated goal is to eliminate extreme poverty over the next 15 years. How will we know when we get there?<\/p>\n

As we\u2019re learning from our staff and others working in data-starved environments\u2014high frequency and real-time data from a variety of new sources can be really useful. We can use digital signals to see what’s happening in a country at a micro-level to target interventions like the distribution of food, medicine, and other essential services. For example, in areas where mobile penetration is high, mobile airtime and the geographic distribution of pre-paid credits can signal in real-time that incomes are fluctuating and where it\u2019s happening. Similarly, the movement of mobile phones across geographies reveals migration patterns that are useful in tracking the spread of diseases like Ebola. While this data is not perfect, it’s often the best we have and an entirely new source of intelligence.<\/p>\n

We need to test theories before acting on them<\/i> Tweet This Quote<\/a><\/span><\/p><\/blockquote>\n

But beyond the data buzz, its important that we subject data to hypotheses to ensure our theories are sound and \u2018data proxies\u2019 are reliable. We need to test theories before acting on them. One challenge is that N is not equal all. Tim Harford reminds us that correlations can be misleading and are often just wrong. In several examples above, the patterns we observe in call detail records are not related to all people who live in a specific geography but people with phones. So we need to recognize these limitations and acknowledge what data does and doesn\u2019t t tell us.<\/p>\n

\"bigdata_0UDotIs\"<\/a><\/p>\n

Then there is the challenge of data noise. As Nate Silver reminds us most big data is just noise and that noise is increasing must faster than the signal. He writes, \u201cthere are so many hypotheses to test, so many data sets to mine\u2014but a relatively constant amount of objective truth.\u201d Formulating good questions is always difficult but even more critical when parsing through very large data sets and looking for meaningful correlations. In a recent publication, “Big Data in Action for Development<\/a>,” the World Bank Group collaborated with Second Muse<\/a>, a global innovation agency, to explore big data’s transformative potential for socioeconomic development. The report develops a conceptual framework to work with big data in the development sector.<\/p>\n

The emergent field of big data analytics and data science is a combination of statistics, computer science and social science. The first two without the third can lead to spurious and often dangerous conclusions. Imagine a health intervention that completely misses vulnerable populations because they don’t own GPS-enabled smart phones. We have learned from Google\u2019s flu trends that big data sets need to be regularly ground-truthed and subjected to scrutiny.<\/p>\n

It\u2019s important to be clear about what data does and doesn’t tell us. Only then can we move from data to knowledge and from intelligence to actionable insight.<\/i> Tweet This Quote<\/a><\/span><\/p><\/blockquote>\n

As someone who works with large data sets within a global development institution, I’m a firm believer in the power of real-time data. But our analytics must be backed by credible hypotheses and sound social science. It\u2019s important to be clear about what data does and doesn’t tell us. Only then can we move from data to knowledge and from intelligence to actionable insight.<\/p>\n

\n

This originally appeared on the World Bank blog, Voices<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

I recently gave a talk at the American Association for the Advancement of Science about Big Data and Analytics and why it matters for development. Unlike other speakers who warned…<\/p>\n","protected":false},"author":102,"featured_media":20663,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[476,1547,1553,1529],"tags":[1405,1987,1989,1988,298,1650,331,491,1614,1934],"class_list":["post-20657","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-article","category-emerging-markets","category-metrics-and-evaluation","category-technology","tag-aleem-walji","tag-big-data","tag-data-informed-decisions","tag-data-science","tag-development","tag-ict4d","tag-innovation","tag-policy","tag-walji","tag-world-bank"],"acf":[],"yoast_head":"\nBeyond the Big-Data Buzz: How Can We Move From Intelligence To Action? - UNREASONABLE<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action? - UNREASONABLE\" \/>\n<meta property=\"og:description\" content=\"I recently gave a talk at the American Association for the Advancement of Science about Big Data and Analytics and why it matters for development. Unlike other speakers who warned...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/\" \/>\n<meta property=\"og:site_name\" content=\"Unreasonable\" \/>\n<meta property=\"article:published_time\" content=\"2015-04-06T11:00:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-04-09T02:07:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1400\" \/>\n\t<meta property=\"og:image:height\" content=\"500\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Aleem Walji\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/alwalji\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Aleem Walji\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/\"},\"author\":{\"name\":\"Aleem Walji\",\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/#\/schema\/person\/88182b0eea911183524fb478f841d492\"},\"headline\":\"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action?\",\"datePublished\":\"2015-04-06T11:00:53+00:00\",\"dateModified\":\"2015-04-09T02:07:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/\"},\"wordCount\":729,\"commentCount\":61,\"image\":{\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg\",\"keywords\":[\"Aleem Walji\",\"big data\",\"data informed decisions\",\"data science\",\"Development\",\"ict4d\",\"innovation\",\"Policy\",\"Walji\",\"world bank\"],\"articleSection\":[\"Article\",\"Emerging Markets\",\"Metrics & Evaluation\",\"Technology\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/\",\"url\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/\",\"name\":\"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action? - UNREASONABLE\",\"isPartOf\":{\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg\",\"datePublished\":\"2015-04-06T11:00:53+00:00\",\"dateModified\":\"2015-04-09T02:07:00+00:00\",\"author\":{\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/#\/schema\/person\/88182b0eea911183524fb478f841d492\"},\"breadcrumb\":{\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#primaryimage\",\"url\":\"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg\",\"contentUrl\":\"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg\",\"width\":1400,\"height\":500,\"caption\":\"Photo from Creative Commons\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/unreasonablegroup.com\/articles\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/#website\",\"url\":\"https:\/\/unreasonablegroup.com\/articles\/\",\"name\":\"Unreasonable\",\"description\":\"We believe in the power of business to drive lasting, scalable change.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/unreasonablegroup.com\/articles\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/#\/schema\/person\/88182b0eea911183524fb478f841d492\",\"name\":\"Aleem Walji\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/unreasonablegroup.com\/articles\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/bd55b596f19ed3c4bb0f067fbf44c51ff9d9cb81a60baf7a67ffafedc73faa52?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/bd55b596f19ed3c4bb0f067fbf44c51ff9d9cb81a60baf7a67ffafedc73faa52?s=96&d=mm&r=g\",\"caption\":\"Aleem Walji\"},\"description\":\"Aleem is Chief Innovation Advisor within the Leadership, Learning, and Innovation Vice Presidency at the World Bank Group. He was the first CEO of the Aga Khan Foundation in Syria, managing a portfolio of health, education, rural development, water management, and microfinance programs, and he was Head of Global Development Initiatives at Google.org.\",\"sameAs\":[\"http:\/\/wbi.worldbank.org\/wbi\/content\/aleem\",\"http:\/\/www.linkedin.com\/pub\/aleem-walji\/7\/3b\/734\",\"https:\/\/x.com\/https:\/\/twitter.com\/alwalji\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action? - UNREASONABLE","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/","og_locale":"en_US","og_type":"article","og_title":"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action? - UNREASONABLE","og_description":"I recently gave a talk at the American Association for the Advancement of Science about Big Data and Analytics and why it matters for development. Unlike other speakers who warned...","og_url":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/","og_site_name":"Unreasonable","article_published_time":"2015-04-06T11:00:53+00:00","article_modified_time":"2015-04-09T02:07:00+00:00","og_image":[{"width":1400,"height":500,"url":"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg","type":"image\/jpeg"}],"author":"Aleem Walji","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/alwalji","twitter_misc":{"Written by":"Aleem Walji","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#article","isPartOf":{"@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/"},"author":{"name":"Aleem Walji","@id":"https:\/\/unreasonablegroup.com\/articles\/#\/schema\/person\/88182b0eea911183524fb478f841d492"},"headline":"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action?","datePublished":"2015-04-06T11:00:53+00:00","dateModified":"2015-04-09T02:07:00+00:00","mainEntityOfPage":{"@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/"},"wordCount":729,"commentCount":61,"image":{"@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#primaryimage"},"thumbnailUrl":"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg","keywords":["Aleem Walji","big data","data informed decisions","data science","Development","ict4d","innovation","Policy","Walji","world bank"],"articleSection":["Article","Emerging Markets","Metrics & Evaluation","Technology"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/","url":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/","name":"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action? - UNREASONABLE","isPartOf":{"@id":"https:\/\/unreasonablegroup.com\/articles\/#website"},"primaryImageOfPage":{"@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#primaryimage"},"image":{"@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#primaryimage"},"thumbnailUrl":"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg","datePublished":"2015-04-06T11:00:53+00:00","dateModified":"2015-04-09T02:07:00+00:00","author":{"@id":"https:\/\/unreasonablegroup.com\/articles\/#\/schema\/person\/88182b0eea911183524fb478f841d492"},"breadcrumb":{"@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#primaryimage","url":"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg","contentUrl":"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg","width":1400,"height":500,"caption":"Photo from Creative Commons"},{"@type":"BreadcrumbList","@id":"https:\/\/unreasonablegroup.com\/articles\/big-data-buzz-intel-action-gaps\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/unreasonablegroup.com\/articles\/"},{"@type":"ListItem","position":2,"name":"Beyond the Big-Data Buzz: How Can We Move From Intelligence To Action?"}]},{"@type":"WebSite","@id":"https:\/\/unreasonablegroup.com\/articles\/#website","url":"https:\/\/unreasonablegroup.com\/articles\/","name":"Unreasonable","description":"We believe in the power of business to drive lasting, scalable change.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/unreasonablegroup.com\/articles\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/unreasonablegroup.com\/articles\/#\/schema\/person\/88182b0eea911183524fb478f841d492","name":"Aleem Walji","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/unreasonablegroup.com\/articles\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/bd55b596f19ed3c4bb0f067fbf44c51ff9d9cb81a60baf7a67ffafedc73faa52?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bd55b596f19ed3c4bb0f067fbf44c51ff9d9cb81a60baf7a67ffafedc73faa52?s=96&d=mm&r=g","caption":"Aleem Walji"},"description":"Aleem is Chief Innovation Advisor within the Leadership, Learning, and Innovation Vice Presidency at the World Bank Group. He was the first CEO of the Aga Khan Foundation in Syria, managing a portfolio of health, education, rural development, water management, and microfinance programs, and he was Head of Global Development Initiatives at Google.org.","sameAs":["http:\/\/wbi.worldbank.org\/wbi\/content\/aleem","http:\/\/www.linkedin.com\/pub\/aleem-walji\/7\/3b\/734","https:\/\/x.com\/https:\/\/twitter.com\/alwalji"]}]}},"jetpack_featured_media_url":"https:\/\/unreasonablegroup.com\/articles\/wp-content\/uploads\/2000\/04\/AleemDataPoverty.jpg","_links":{"self":[{"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/posts\/20657","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/users\/102"}],"replies":[{"embeddable":true,"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/comments?post=20657"}],"version-history":[{"count":8,"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/posts\/20657\/revisions"}],"predecessor-version":[{"id":20667,"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/posts\/20657\/revisions\/20667"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/media\/20663"}],"wp:attachment":[{"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/media?parent=20657"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/categories?post=20657"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/unreasonablegroup.com\/articles\/wp-json\/wp\/v2\/tags?post=20657"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}