ISIS: STATE OF TERROR
LINKSBlogs of War
Making Sense of Jihad
Views from the Occident
American Al Qaeda Members
News, analysis and primary source documents on terrorism, extremism and national security.
Saturday, May 4, 2013
Forecasting Terrorist Attacks With Big Data and the Wisdom of Crowds... Or NotBack in January, I was playing around with Google Trends, the free service that tracks when specific search terms have been historically popular on a scale from 1 to 100. I noticed that in addition to its tracking function, there was a humble checkbox labeled "forecast" that predicted when the search terms would recur for some months into the future.
I was intrigued by this idea, since searches theoretically represent a mass conglomeration of factors that feed into an extraordinarily large data set. Out of curiosity, I plugged in "terrorist" and "attack" and clicked the forecast checkbox. I tweeted my results, which I read as predicting a terrorist attack around May 2013.
More Google Trends prognosticating, this time for the terms terrorist and attacktwitpic.com/brzqo1
The actual attack came in April. A two-week margin of error isn't bad, all in all, especially when you consider that search traffic might not peak until after an event took place.
So the question now becomes: Is this ridiculous, or is it meaningful? Could the raw wild data set of people's search queries somehow tap into something that gives us a reliable window on what will happen in the future?
Significant terrorist attacks are outliers. They happen so infrequently and are so diverse as to defy easy statistical generalizations. The data surrounding them tends to be clumpy. So the fact that several attempted terrorist attacks since September 11 have been thwarted in the period between April and June, and in September through November, may not be meaningful but might shape the Google trends data enough to make it forecast May and September as likely peaks in searches for "terrorist attack."
September is also a consistent peak month for such queries, almost certainly because of renewed media interest in 9/11 anniversaries. And April results may be similarly skewed by the anniversary of the Oklahoma City bombing, which is also a significant date for domestic extremists on other grounds.
This may be reflected in the current Trends forecast, in which searches for "attack" spike sharply once more in April and May 2014, while "terrorist" rises less dramatically. "Attack" shows lesser peaks in July (the anniversary of two different attacks in London) and September, when "terrorist" also peaks, although less dramatically.
Google Trends predicts search patterns. So per Trends, expect mass shootings in August 2013 and January 2014.twitpic.com/bryxldAs of today, Trends is still predicting peaks in August and January. Clumpy past data may again be contributing to the spikes -- Aurora took place in July 2012, and the Sikh Temple shooting in August -- but the past data is somewhat less clearly tilted toward those months.
It's intriguing to look at all of this and think there might be something to it -- that somehow the mass of all Google search queries, essentially crowdsourcing taken to its extreme, might somehow tap into knowledge or conditions that can predict serious events. One near-success is not nearly enough to go on, but it's interesting enough to keep track and see what the future holds.
Buy J.M. Berger's book, Jihad Joe: Americans Who Go to War in the Name of Islam
Views expressed on INTELWIRE are those of the author alone.
Tweets referencing this post:
ISIS: THE STATE
Jessica Stern and J.M. Berger co-author the forthcoming book, "ISIS: The State of Terror," from Ecco, an imprint of HarperCollins. The book, which will debut in early 2015, will examine the rise of the Islamic State in Iraq and Syria, its potential fall, how it is transforming the nature of extremist movements, and how we should evaluate the threat it presents. Jessica Stern is a Harvard lecturer on terrorism and the author of the seminal text Terror in the Name of God: Why Religious Militants Kill. J.M. Berger is author of the definitive book on American jihadists, Jihad Joe: Americans Who Go to War in the Name of Islam, a frequent contributor to Foreign Policy, and editor of Intelwire.com.