We describe a Belief-Desire-Intention-like architecture for an explorer agent in which the psychological constructs of surprise and curiosity play an important role in decision-making, particularly in the selection of view-points during the process of exploring unknown environments. Taking into account previous studies about the psychological constructs involved in exploratory behaviour, the agent is equipped in advance with the basic desires for maximal information gain (reduce curiosity), and maximal surprise. However, to reflect Berlyne’s theory that says that the tendency to explore the environment occurs in the absence of known drives, we considered also the basic desire for minimal hunger as a representative example of those additional basic desires that can restrain exploration. This surprise– curiosity-based exploration strategy was confronted with a “cold” classical exploration strategy in environments populated with entities. The results of this experiment indicate that the classical strategy outperforms slightly the surprise–curiosity-based one with respect to the exploration performance measures of the time/energy required to explore all the environment completely, and the time/energy required to explore all the entities. However, the classical strategy was outperformed by the surprise–curiosity-based one with respect to the time/ energy required to explore all different entities, and consequently, with more evidence, with respect to the number of steps (trips between two entities) required to explore all different entities. This is a valuable result for resource-bounded, active learning agents that benefit from choosing the more informative data from which they learn while ignoring time-consuming/expensive, redundant data. This impor- tant result is confirmed by the results of the analysis of the agents’ behaviour exhibited along the traversing paths in the environment. The experiment also provided results concerning the robustness of the surprise–curiosity-based approach by assessing the influence of surprise and curiosity in several environments of different complexity and with different amplitudes for the visual field of the agent.
Keywords
Exploration of unknown environments
Journal
Journal of Cognitive Systems Research, Vol. 19, pp. 62-87, Ron Sun, April 2012
Cited by
Year 2020 : 1 citations
Vignero, L., & Demey, L. (2020). The perfect surprise: a new analysis in dynamic epistemic logic. Logic Journal of the IGPL, 28(3), 341-362.
Year 2019 : 2 citations
Reisenzein, R., Horstmann, G., & Schützwohl, A. (2019). The cognitive?evolutionary model of surprise: A review of the evidence. Topics in cognitive science, 11(1), 50-74.
Foster, M. I., & Keane, M. T. (2019). The role of surprise in learning: different surprising outcomes affect memorability differentially. Topics in cognitive science, 11(1), 75-87.
Year 2017 : 2 citations
Davis, D. N., & Ramulu, S. K. (2017). Reasoning with BDI Robots: From simulation to physical environment–Implementations and Limitations. Paladyn, Journal of Behavioral Robotics, 8(1), 39-57.
Schutzwohl, A., Reisenzein, R., & Horstmann, G. (2017). The Cognitive-Evolutionary Model of Surprise: A Review of the Evidence.
Year 2016 : 1 citations
Madani, K., Sabourin, C., & Ramík, D. M. (2016). Artificial curiosity emerging human-like behavior: Toward fully autonomous cognitive robots. In Computational Intelligence (pp. 501-516). Springer, Cham.
Year 2015 : 2 citations
Wu, Qiong. "Computational Curiosity (A Book Draft)." arXiv preprint arXiv:1502.04780 (2015).
Kalde, Nassim, Olivier Simonin, and François Charpillet. "Comparison of Classical and Interactive Multi-Robot Exploration Strategies in Populated Environments." Acta Polytechnica 55.3 (2015): 154-161.
Year 2014 : 1 citations
Ramík, Dominik M., Kurosh Madani, and Christophe Sabourin. "At Odds with Curious Cats, Curious Robots Acquire Human-Like Intelligence." Neural Networks and Artificial Intelligence. Springer International Publishing, 2014. 112-123.
Year 2013 : 1 citations
Reisenzein, R., Hudlicka, E., Dastani, M., Gratch, J., Hindriks, K., Lorini, E., Meyer, J.-J.Ch.,"Computational modeling of emotion: Toward improving the inter-and intradisciplinary exchange",2013,"IEEE Transactions on Affective Computing",4,3, 6517842,246,266,,1,"http://www.scopus.com/inward/record.url?eid=2-s2.0-84886495049&partnerID=40&md5=a6346d0bce4d6bd348aa981e130e56fc",Article,Scopus
Year 2012 : 2 citations
Ramik, D. M. (2012). Contribution to complex visual information processing and autonomous knowledge extraction: application to autonomous robotics (Doctoral dissertation, Université Paris-Est).
Hindriks, Koen, Emiliano Lorini, and John-Jules Ch Meyer. "Computational Modeling of Emotion: Toward Improving the Inter-and Intradisciplinary Exchange."
