Data Mining


Mining the Web for Feelings, Not Facts -- Alex Wright  -- New York Times  -- August 23, 2009
Metacomputing

An emerging field known as sentiment analysis, fueled by social networking, is taking shape around one of the computer world's unexplored frontiers: translating human emotions into hard data, which could eventually transform the experience of searching for information online.


Yottabytes and the Data Analysis Challenge -- Steven Aftergood  -- Secrecy News  -- July 6, 2009
Metacomputing

The increasing capability of high-resolution military and intelligence sensors is producing ever growing quantities of data that could overwhelm the capacity to analyze them without new approaches to data management and analysis, according to a newly released report from the JASON defense advisory panel.


Crawling the Web to Foretell Ecosystem Collapse -- Alexis Madrigal  -- Wired News  -- March 19, 2009
Geoengineering

The six billion people on Earth are changing the biosphere so quickly that traditional ecological methods can't keep up. Humans, though, are acute observers of their environments and bodies, so scientists are combing through the text and numbers on the Internet in hopes of extracting otherwise unavailable or expensive information.


'Dark Web' Project Takes On Cyber-Terrorism -- Steven Kotler  -- Fox News  -- October 12, 2007
Metacomputing

Dark Web, a giant, searchable database at the University of Arizona's Artificial Intelligence Lab, is an attempt to uncover, cross-reference, catalogue and analyze all online terrorist-generated content on the at least 7000 to 8000 terrorist sites.


Scientists Use the "Dark Web" to Snag Extremists and Terrorists Online -- Staff  -- National Science Foundation  -- September 10, 2007
Metacomputing

A team of computational scientists have created a new technology they are calling the "Dark Web" which aims to systematically collect and analyze all terrorist-generated content on the Web.


US plans massive data sweep -- Mark Clayton  -- Christian Science Monitor  -- February 9, 2006
Surveillance Technology

The US government is developing a massive computer system that can collect huge amounts of data and, by linking far-flung information from blogs and e-mail to government records and intelligence reports, search for patterns of terrorist activity.


With Terror in Mind, a Formulaic Way to Parse Sentences -- Noah Shachtman  -- New York Times  -- March 3, 2005
Metacomputing

With CIA backing, a U.S. company has developed a method to parse electronic documents almost instantly and diagram all of the sentences inside, helping turn chatter into information that is relevant and usable.


Defense Dept. hopes to enlist AI in war against terrorism -- Therese Poletti  -- San Jose Mercury News  -- August 2, 2004
Artificial Intelligence

The U.S. Defense Department hopes an elite group of AI scientists will develop more tools to help intelligence analysts find terrorists before they strike.


What We Don?t Know Can Hurt Us -- Heather Mac Donald  -- City Journal  -- June 1, 2004
Surveillance Technology

The author argues that privacy advocates are hindering development of sophisticated pattern-analysis and data mining tools for detecting terrorist networks.


Common Sense and Computer Analysis -- Heather MacDonald  -- Washington Post  -- May 30, 2004
Surveillance Technology

The author argues that placing privacy restrictions on government use of machines for intelligence gathering is neither practical or necessary.

    follow me on Twitter