The investment arms of the CIA and Google are both backing a company that monitors the web in real time â€” and says it uses that information to predict the future.
The company is called Recorded Future, and it scours tens of thousands of websites, blogs and Twitter accounts to find the relationships between people, organizations, actions and incidents â€” both present and still-to-come. In a white paper, the company says its temporal analytics engine â€œgoes beyond searchâ€ by â€œlooking at the â€˜invisible linksâ€™ between documents that talk about the same, or related, entities and events.â€
Which naturally makes the 16-person Cambridge, Massachusetts, firm attractive to Google Ventures, the search giantâ€™s investment division, and to In-Q-Tel, which handles similar duties for the CIA and the wider intelligence community.
Itâ€™s not the very first time Google has done business with Americaâ€™s spy agencies.
This appears to be the first time, however, that the intelligence community and Google have funded the same startup, at the same time.
Americaâ€™s spy services have become increasingly interested in mining â€œopen source intelligenceâ€ â€” information thatâ€™s publicly available, but often hidden in the daily avalanche of TV shows, newspaper articles, blog posts, online videos and radio reports.
U.S. spy agencies, through In-Q-Tel, have invested in a number of firms to help them better find that information. Visible Technologies crawls over half a million web 2.0 sites a day, scraping more than a million posts and conversations taking place on blogs, YouTube, Twitter and Amazon. Attensity applies the rules of grammar to the so-called â€œunstructured textâ€ of the web to make it more easily digestible by government databases. Keyhole (now Google Earth) is a staple of the targeting cells in military-intelligence units.
Recorded Future strips from web pages the people, places and activities they mention. The company examines when and where these events happened (â€œspatial and temporal analysisâ€) and the tone of the document (â€œsentiment analysisâ€). Then it applies some artificial-intelligence algorithms to tease out connections between the players. Recorded Future maintains an index with more than 100 million events, hosted on Amazon.com servers. The analysis, however, is on the living web.
â€œWeâ€™re right there as it happens,â€ Ahlberg told Danger Room as he clicked through a demonstration. â€œWe can assemble actual real-time dossiers on people.â€