Application of Natural Language Processing and Evidential Analysis to Web-Based Intelligence Information Acquisition

Article English OPEN
Danilova, N. ; Stupples, D. (2012)

The quality of decisions made in business and government relates directly to the quality of the information used to formulate the decision. This information may be retrieved from an organization's knowledge base (Intranet) or from the World Wide Web. Intelligence services Intranet held information can be efficiently manipulated by technologies based upon either semantics such as ontologies, or statistics such as meaning-based computing. These technologies require complex processing of large amount of textual information. However, they cannot currently be effectively applied to Web-based search due to various obstacles, such as lack of semantic tagging. A new approach proposed in this paper supports Web-based search for intelligence information utilizing evidence-based natural language processing (NLP). This approach combines traditional NLP methods for filtering of Web-search results, Grounded Theory to test the completeness of the evidence, and Evidential Analysis to test the quality of gathered information. The enriched information derived from the Web-search will be transferred to the intelligence services knowledge base for handling by an effective Intranet search system thus increasing substantially the information for intelligence analysis. The paper will show that the quality of retrieved information is significantly enhanced by the discovery of previously unknown facts derived from known facts.
  • References (21)
    21 references, page 1 of 3

    [1] Berners-Lee, T., “The Semantic Web”. Scientific American, May 1, 2001.

    [2] Rumsfeld, D., News transcript: DoD news briefing. Washington D.C.: U.S.Department of Defence,2002.

    [3] Pugh, W., & Henzinger, M. (2001). Patent No. 768947. USA.

    [4] Gomes, B., & Smith, B. (2000). Patent No. 684542. USA

    [5] Autonomy. (2009, September 29). Autonomy Technology Overview. Retrieved 01 06, 2012, from Autonomy: my%20Technology/20090928_PI_WP_TechOverview_web.pdf

    [6] Zhou, B., Xiong, Y., & Liu, W., “Efficient Web-page main text extraction towards online news analysis”. IEEE International Conference on e-Business Engineering, 2009 (ICEBE '09), (pp. 37 - 41).

    [7] Adam, G., Bouras, C., & Poulopoulos, V., “CUTER: An efficient useful text extraction mechanism”. Advanced Information Networking and Applications Workshops (WAINA), 2009, pp. 703-708. Institute of Electrical and Electronics Engineers ( IEEE ).

    [8] Hu, G., & Zhao, Q., “Study to eliminating noisy information in Webpages based on data mining”. Sixth International Conference on Natural Computation (ICNC 2010), Volume 2, pp. 660 - 663.

    [9] Fu, L., Meng, Y., Xia, Y., & Yu, H., “Web-content extraction based on Web-page layout analysis”. Second International Conference on Information Technology and Computer Science (ITCS 2010), Ukraine, pp. 40 - 43.

    [10] Yi, L., Liu, B., & Li, X., “Eliminating noisy information in Web-pages for data mining”. Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, 2009, New York, NY, USA: ACM, pp. 296 - 305.

  • Similar Research Results (1)
  • Metrics
    views in OpenAIRE
    views in local repository
    downloads in local repository

    The information is available from the following content providers:

    From Number Of Views Number Of Downloads
    City Research Online - IRUS-UK 0 56
Share - Bookmark