PDA

View Full Version : U.S. Develops Software That Could Track Global Press



Gold9472
10-12-2006, 08:55 AM
US develops software that could track global press

http://www.thenews.com.pk/daily_detail.asp?id=27986

10/12/2006

WASHINGTON: The US Department of Homeland Security plans to develop software that analyses and summarises opinions expressed in articles, providing a possible tool for better monitoring what is written about the United States in the global press. The department says it will spend 2.4 million dollars over the next three years supporting research at three US universities using computer science to analyse human language in texts.

‘The work is really designed to get information extraction that would help the DHS review statements for sentiments or beliefs contained in statements, and to provide intelligence analysts within DHS,’ said Homeland Security spokesperson Christophe Kelly.

Kelly said the software would offer the department staff ‘another resource to conduct their work’, even though the project has raised eyebrows among press freedom advocates. Janyce Wiebe of the University of Pittsburgh in Pennsylvania, who will direct the research project, said that the funding will go towards basic research and not any monitoring of the global press.

The research will seek to ‘develop accurate and robust techniques for extracting and summarizing information about events and opinions described in a text,’ Wiebe said. Researchers from Cornell University and the University of Utah will also participate in the work, in a field computer scientists call ‘natural language processing.’

‘Their focus is to develop simpler, more efficient software, algorithms and mathematical architectures for use in a broad range of computing applications,’ Kelly at the DHS said. The research team has gathered more than 270,000 articles from 180 news sources from around the world-including AFP-between June 2001 and May 2002 covering a range of subjects including elections in Zimbabwe, relations between China and Taiwan, treatment of detainees at Guantanamo and the Kyoto protocol.

Each article has been manually annotated ‘with the meanings we want the software to learn to understand,’ Wiebe said. The software envisaged by the DHS-funded research would be capable of tracking the ambiguities of human language, distinguishing the meaning of a sentence depending on context and summarizing descriptions and opinions that appear in several different texts.

The researchers and DHS officials decline to discuss the possible uses of such software. ‘It’s just too early to speculate about what it would evolve into,’ Kelly said.

Several press freedom organizations have expressed concern that the US government wants to create a data base of certain media, particularly outlets that are the most critical of Washington.