MULTIFACETED MEDIA GROUP
LINKSBlogs of War
Gunpowder & Lead
Long War Journal
Making Sense of Jihad
Views from the Occident
American Al Qaeda Members
News, analysis and primary source documents on terrorism, extremism and national security.
Saturday, May 4, 2013
Forecasting Terrorist Attacks With Big Data and the Wisdom of Crowds... Or NotBack in January, I was playing around with Google Trends, the free service that tracks when specific search terms have been historically popular on a scale from 1 to 100. I noticed that in addition to its tracking function, there was a humble checkbox labeled "forecast" that predicted when the search terms would recur for some months into the future.
I was intrigued by this idea, since searches theoretically represent a mass conglomeration of factors that feed into an extraordinarily large data set. Out of curiosity, I plugged in "terrorist" and "attack" and clicked the forecast checkbox. I tweeted my results, which I read as predicting a terrorist attack around May 2013.
More Google Trends prognosticating, this time for the terms terrorist and attacktwitpic.com/brzqo1
The actual attack came in April. A two-week margin of error isn't bad, all in all, especially when you consider that search traffic might not peak until after an event took place.
So the question now becomes: Is this ridiculous, or is it meaningful? Could the raw wild data set of people's search queries somehow tap into something that gives us a reliable window on what will happen in the future?
Significant terrorist attacks are outliers. They happen so infrequently and are so diverse as to defy easy statistical generalizations. The data surrounding them tends to be clumpy. So the fact that several attempted terrorist attacks since September 11 have been thwarted in the period between April and June, and in September through November, may not be meaningful but might shape the Google trends data enough to make it forecast May and September as likely peaks in searches for "terrorist attack."
September is also a consistent peak month for such queries, almost certainly because of renewed media interest in 9/11 anniversaries. And April results may be similarly skewed by the anniversary of the Oklahoma City bombing, which is also a significant date for domestic extremists on other grounds.
This may be reflected in the current Trends forecast, in which searches for "attack" spike sharply once more in April and May 2014, while "terrorist" rises less dramatically. "Attack" shows lesser peaks in July (the anniversary of two different attacks in London) and September, when "terrorist" also peaks, although less dramatically.
Google Trends predicts search patterns. So per Trends, expect mass shootings in August 2013 and January 2014.twitpic.com/bryxldAs of today, Trends is still predicting peaks in August and January. Clumpy past data may again be contributing to the spikes -- Aurora took place in July 2012, and the Sikh Temple shooting in August -- but the past data is somewhat less clearly tilted toward those months.
It's intriguing to look at all of this and think there might be something to it -- that somehow the mass of all Google search queries, essentially crowdsourcing taken to its extreme, might somehow tap into knowledge or conditions that can predict serious events. One near-success is not nearly enough to go on, but it's interesting enough to keep track and see what the future holds.
Buy J.M. Berger's book, Jihad Joe: Americans Who Go to War in the Name of Islam
Tweets referencing this post:
Book: Jihad Joe: Americans Who Go to War in the Name of Islam (Reviews)
E-Book: Beatings and Bureaucracy: The Founding Memos of Al Qaeda
E-Book: Interview online jihadist Abu Suleiman Al Nasser (Abridged)
Sourcebook: The 9/11 Investigation (coming soon)
Sourcebook: Al Qaeda in America
Sourcebook: Ali Mohamed
Sourcebook: Gitmo Detainees
Sourcebook: Siege at Mecca
Sourcebook: Islamic Extremism in Egypt
Sourcebook: The Sadat Assassination
JIHAD JOEJihad Joe: Americans Who Go To War In The Name Of Islam, the new book by INTELWIRE's J.M. Berger, is now available in both Kindle and hardcover editions. Order today!
Jihad Joe is the first comprehensive history of the American jihadist movement, from 1979 through the present. Click here to read more about the critical acclaim Jihad Joe has earned so far, including from the New York Times, Publisher's Weekly, Redstate.com and many more.
J.M. Berger on Marathon Bombings
Marathon Bombing: Issues to Watch
Background on Marathon Bombers Tamerlan Tsarnaev a...
A day in the life of a terrorism analyst, 2013 edi...
On Comparing White Nationalists to Anarchists
Best-Liked on the Most-Wanted
A Closer Look at the SPLC's Hate List
Inspire 10: Still sucks
Should we disrupt terrorists on the Internet?
New York Pipe Bomb Suspect Linked to Revolution Muslim
The Utility of Lone Wolves
Interview with Online Jihadist Abu Suleiman Al Nasser
A Way Forward for CVE: The Five Ds
How Terrorists Use The Internet: Just Like You
PATCON: The FBI's Secret War on the Militia Movement
Interview About Jihad With Controversial Cleric Bilal Philips
Forgeries on the Jihadist Forums
U.S. Gave Millions To Charity Linked To Al Qaeda, Anwar Awlaki
State Department Secretly Met With Followers of Blind Sheikh
State Department Put 'Political Pressure' On FBI To Deport Brother-in-Law Of Osama Bin Laden In 1995
FBI Records Reveal Details Of Nixon-Era Racial Profiling Program Targeting Arabs
Gaza Flotilla Official Was Foreign Fighter in Bosnia War
U.S. Had 'High Confidence' Of UBL Attack In June 2001
Behind the Handshake: The Rumsfeld-Saddam Meeting