Learning and Representing Temporal Knowledge in Recurrent Networks

Article English OPEN
Borges, Rafael ; Garcez, A. ; Lamb, L. C. (2011)

The effective integration of knowledge representation, reasoning, and learning in a robust computational model is one of the key challenges of computer science and artificial intelligence. In particular, temporal knowledge and models have been fundamental in describing the behavior of computational systems. However, knowledge acquisition of correct descriptions of a system's desired behavior is a complex task. In this paper, we present a novel neural-computation model capable of representing and learning temporal knowledge in recurrent networks. The model works in an integrated fashion. It enables the effective representation of temporal knowledge, the adaptation of temporal models given a set of desirable system properties, and effective learning from examples, which in turn can lead to temporal knowledge extraction from the corresponding trained networks. The model is sound from a theoretical standpoint, but it has also been tested on a case study in the area of model verification and adaptation. The results contained in this paper indicate that model verification and learning can be integrated within the neural computation paradigm, contributing to the development of predictive temporal knowledge-based systems and offering interpretable results that allow system researchers and engineers to improve their models and specifications. The model has been implemented and is available as part of a neural-symbolic computational toolkit.
  • References (42)
    42 references, page 1 of 5

    [1] A. S. d'Avila Garcez, L. C. Lamb, and D. M. Gabbay, Neural-Symbolic Cognitive Reasoning, ser. Cognitive Technologies. Springer, 2009.

    [2] E. A. Feigenbaum, “Some challenges and grand challenges for computational intelligence,” Journal of ACM, vol. 50, no. 1, pp. 32-40, 2003.

    [3] L. G. Valiant, “Three problems in computer science,” Journal of ACM, vol. 50, no. 1, pp. 96-99, 2003.

    [4] S. Bader and P. Hitzler, “Dimensions of neural-symbolic integration - a structured survey,” in We Will Show Them! Essays in Honour of Dov Gabbay, S. Arte¨mov, H. Barringer, A. d'Avila Garcez, L. Lamb, and J. Woods, Eds. College Publications, International Federation for Computational Logic, 2005, pp. 167-194.

    [5] J. Lehmann, S. Bader, and P. Hitzler, “Extracting reduced logic programs from artificial neural networks,” Applied Intelligence, vol. 32, no. 3, pp. 249-266, 2010.

    [6] I. Cloete and J. Zurada, Eds., Knowledge-Based Neurocomputing. Cambridge, MA: MIT Press, 2000.

    [7] E. M. Clarke, E. A. Emerson, and J. Sifakis, “Model checking: algorithmic verification and debugging,” Commun. ACM, vol. 52, no. 11, pp. 74-84, 2009.

    [8] M. Fisher, D. Gabbay, and L. Vila, Eds., Handbook of temporal reasoning in artificial intelligence. Elsevier, 2005.

    [9] A. Pnueli, “The temporal logic of programs,” in FOCS '77: 18th IEEE Symp. Found. Comp. Sci. IEEE Computer Society, 1977, pp. 46-67.

    [10] D. Zhang and J. Tsai, Machine Learning Applications in Software Engineering. River Edge, NJ: World Scientific, 2005.

  • Metrics
    No metrics available
Share - Bookmark