You have already added 0 works in your ORCID record related to the merged Research product.
You have already added 0 works in your ORCID record related to the merged Research product.
A sensing architecture for empathetic data systems
A sensing architecture for empathetic data systems
Today's increasingly large and complex databases require novel and machine aided ways of exploring data. To optimize the selection and presentation of data, we suggest an unconventional approach. Instead of exclusively relying on explicit user input to specify relevant information or to navigate through a data space, we exploit the power and potential of the users' unconscious processes in addition. To this end, the user is immersed in a mixed reality environment while his bodily reactions are captured using unobtrusive wearable devices. The users' reactions are analyzed in real-time and mapped onto higher-level psychological states, such as surprise or boredom, in order to trigger appropriate system responses that direct the users' attention to areas of potential interest in the visualizations. The realization of such a close experience-based human-machine loop raises a number of technical challenges, such as the real-time interpretation of psychological user states. The paper at hand describes a sensing architecture for empathetic data systems that has been developed as part of such a loop and how it tackles the diverse challenges.
- University of Augsburg Germany
- Pompeu Fabra University Spain
- University of Florence Italy
- University of Pisa Italy
Microsoft Academic Graph classification: Computer science Data system Exploit Surprise media_common.quotation_subject media_common Wearable technology business.industry business Human–machine system Architecture Human–computer interaction Mixed reality Boredom medicine.symptom medicine
Dewey Decimal Classification: ddc:004
exploring data, mixed reality, real-time, human-machine interface, signal processing, Human-machine; Mixed-reality environment; Psychological state; Relevant informations; System response; Technical challenges; Unconventional approaches; Wearable devices, Human-machine, Mixed-reality environment, Psychological state, Relevant informations, System response, Technical challenges, Unconventional approaches, Wearable devices
exploring data, mixed reality, real-time, human-machine interface, signal processing, Human-machine; Mixed-reality environment; Psychological state; Relevant informations; System response; Technical challenges; Unconventional approaches; Wearable devices, Human-machine, Mixed-reality environment, Psychological state, Relevant informations, System response, Technical challenges, Unconventional approaches, Wearable devices
Microsoft Academic Graph classification: Computer science Data system Exploit Surprise media_common.quotation_subject media_common Wearable technology business.industry business Human–machine system Architecture Human–computer interaction Mixed reality Boredom medicine.symptom medicine
Dewey Decimal Classification: ddc:004
1612
[1] Bee, N., Prendinger, H., Nakasone, A., Andr´e, E., and Ishizuka, M. Autoselect: What you want is what you get: Real-time processing of visual attention and affect. In Perception and Interactive Technologies, International Tutorial and Research Workshop, PIT 2006, Kloster Irsee, Germany, June 19-21, 40-52.
[2] Bell, G., Hey, T., & Szalay, A. (2009). Beyond the Data Deluge. Science, 323(5919), 1297-1298.
[3] Bernardet, U., Inderbitzin, M., Wierenga, S., Va¨ljama¨e, A., Mura, A., & Verschure, P.F.M.J. (2008). Validating presence by relying on recollection: Human experience and performance in the mixed reality system XIM. In L. G. Anna Spagnolli (Ed.), 11th Annual International Workshop on Presence Padova Italy (Vol. 54), 16-18.
[4] Bernardet, U., & Verschure, P.F.M.J. (2010). iqr: a tool for the construction of multi-level simulations of brain and behaviour. Neuroinformatics, 8(2), 113-134. [OpenAIRE]
[5] Betella, A., Carvalho, R., Sanchez-Palencia, J., Bernardet, U., & Verschure, P.F.M.J. Embodied Interaction with Complex Neuronal Data in Mixed-Reality. Virtual Reality International Conference (VRIC 2012). [OpenAIRE]
[6] Buscher, G., Dengel, A., Biedert, R., & Elst, L. V. Attentive documents: Eye tracking as implicit feedback for information retrieval and beyond. ACM Trans. Interact. Intell. Syst. 1, 2 (Jan. 2012), 9:1-9:30.
[7] Gilroy, S.W., Cavazza, M., Chaignon, R., Ma¨kela¨, S.-M., Niranen, M., Andr´e, E., Vogt, T., Urbain, J., Billinghurst, M., Seichter, H., & Benayoun, M. E-tree: emotionally driven augmented reality art. In ACM Multimedia (2008), 945-948.
[8] Lanata´, A., Armato, A., Valenza, G., & Scilingo, E.P., 2011. Eye tracking and pupil size variation as response to affective stimuli: A preliminary study. 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth), 78-84.
[9] von Landesberger, T., Kuijper, A., Schreck, T., Kohlhammer, J., van Wijk, J.J., Fekete, J.D., & Fellner, D.W. Visual analysis of large graphs: State-of-the-art and future research challenges. Comput. Graph. Forum 30, 6 (2011), 1719-1749. [OpenAIRE]
[10] Lessiter, J., Miotto, A., Freeman, J., Verschure, P.F.M.J., & Bernardet, U. (2011). CEEDs: Unleashing the Power of the Subconscious. Procedia Computer Science, 7, 214-215. [OpenAIRE]
- 1
- 2
citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).10 popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.Average influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).Average impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.Average citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).10 popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.Average influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).Average impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.Average
Citations provided by BIP!Popularity provided by BIP!
- University of Augsburg Germany
- Pompeu Fabra University Spain
- University of Florence Italy
- University of Pisa Italy
Today's increasingly large and complex databases require novel and machine aided ways of exploring data. To optimize the selection and presentation of data, we suggest an unconventional approach. Instead of exclusively relying on explicit user input to specify relevant information or to navigate through a data space, we exploit the power and potential of the users' unconscious processes in addition. To this end, the user is immersed in a mixed reality environment while his bodily reactions are captured using unobtrusive wearable devices. The users' reactions are analyzed in real-time and mapped onto higher-level psychological states, such as surprise or boredom, in order to trigger appropriate system responses that direct the users' attention to areas of potential interest in the visualizations. The realization of such a close experience-based human-machine loop raises a number of technical challenges, such as the real-time interpretation of psychological user states. The paper at hand describes a sensing architecture for empathetic data systems that has been developed as part of such a loop and how it tackles the diverse challenges.