Semantic Representation of Domain Knowledge for Professional VR Training
DOI:
https://doi.org/10.52825/bis.v1i.64Keywords:
semantic web, ontologies, virtual reality, training, scenariosAbstract
Domain-specific knowledge representation is an essential element of efficient management of professional training. Formal and powerful knowledge representation for training systems can be built upon the semantic web standards, which enable reasoning and complex queries against the content. Virtual reality training is currently used in multiple domains, in particular, if the activities are potentially dangerous for the trainees or require advanced skills or expensive equipment. However, the available methods and tools for creating VR training systems do not use knowledge representation. Therefore, creation, modification and management of training scenarios is problematic for domain experts without expertise in programming and computer graphics. In this paper, we propose an approach to creating semantic virtual training scenarios, in which users’ activities, mistakes as well as equipment and its possible errors are represented using domain knowledge understandable to domain experts. We have verified the approach by developing a user-friendly editor of VR training scenarios for electrical operators of high-voltage installations.
Downloads
References
R. Patoni. (). “Alen 3D,” [Online]. Available: https://www.scribd.com/document/245796121/ALEN-3D.
N. Gavish, T. Guti´ errez, S. Webel, J. Rodr´ıguez, M. Peveri, U. Bockholt, and F. Tecchia, “Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks,” Interactive Learning Environments, vol. 23, no. 6, pp. 778–798, 2015.
DOI: 10.1080/10494820.2013.815221. eprint: https://doi.org/10.1080/10494820.2013.815221.
Schneider Electric. (2017). “HoloLens Application on Premset,” [Online]. Available: https://www.youtube.com/watch?v=RpXyagutoZg.
J. Floty ´ nski and K. Walczak, “Ontology-Based Representation and Modelling of Synthetic 3D Content: A State-of-the-Art Review,” Computer Graphics Forum, vol. 35, pp. 329–353, 2017. DOI: 10.1111/cgf.13083.
W. Bille, O. De Troyer, B. Pellens, and F. Kleinermann, “Conceptual modeling of articulated bodies in virtual environments,” in Proceedings of the 11th International Conference on Virtual Systems and Multimedia (VSMM), H. Thwaites, Ed., Archaeolingua, Ghent, Belgium: Archaeolingua, 2005, pp. 17–26.
F. Kleinermann, O. De Troyer, H. Mansouri, R. Romero, B. Pellens, and W. Bille, “Designing semantic virtual reality applications,” in In Proceedings of the 2nd INTUITION International Workshop, Senlis, 2005, pp. 5–10.
B. Pellens, O. De Troyer, W. Bille, F. Kleinermann, and R. Romero, “An ontology-driven approach for modeling behavior in virtual environments,” in Proceedings of On the Move to Meaningful Internet Systems 2005: Ontology Mining and Engineering and its Use for Virtual Reality (WOMEUVR 2005) Workshop, R. Meersman, Z. Tari, and P. Herrero, Eds., Springer-Verlag, Agia Napa, Cyprus: Springer-Verlag, 2005, pp. 1215–1224.
O. De Troyer, F. Kleinermann, B. Pellens, and W. Bille, “Conceptual modeling for virtual reality,” in Tutorials, posters, panels and industrial contributions at the 26th Int. Conference on Conceptual Modeling - ER 2007, J. Grundy, S. Hartmann, A. H. F. Laender, L. Maciaszek, and J. F. Roddick, Eds., ser. CRPIT, vol. 83, Auckland, New Zealand: ACS, 2007, pp. 3–18.
O. De Troyer, F. Kleinermann, H. Mansouri, B. Pellens, W. Bille, and V. Fomenko, “Developing semantic VR-shops for e-Commerce.,” Virtual Reality, vol. 11, no. 2-3, pp. 89–106, 2007.
M. Guti´ errez, “Semantic virtual environments, EPFL,” 2005. [11] M. Guti´ errez, D. Thalmann, and F. Vexo, “Semantic virtual environments with adaptive multimodal interfaces.,” in MMM, Y.-P. P. Chen, Ed., IEEE Computer Society, Jan. 26, 2005, pp. 277–283, ISBN: 0-7695-2164-9.
E. Kalogerakis, S. Christodoulakis, and N. Moumoutzis, “Coupling ontologies with graphics content for knowledge driven visualization,” in VR ’06 Proc. of the IEEE conference on Virtual Reality, Alexandria, Virginia, USA, Mar. 2006, pp. 43–50.
M. Attene, F. Robbiano, M. Spagnuolo, and B. Falcidieno, “Semantic Annotation of 3D Surface Meshes Based on Feature Characterization,” in Proceedings of the Semantic and Digital Media Technologies 2nd International Conference on Semantic Multimedia, ser. SAMT’07, Genoa, Italy: Springer-Verlag, 2007, pp. 126–139, ISBN: 978-3-540-77033-
F. Robbiano, M. Attene, M. Spagnuolo, and B. Falcidieno, “Part-Based Annotation of Virtual 3D Shapes,” 2013 International Conf. on Cyberworlds, vol. 0, pp. 427–436, 2007.
M. Attene, F. Robbiano, M. Spagnuolo, and B. Falcidieno, “Characterization of 3D Shape Parts for Semantic Annotation,” Comput. Aided Des., vol. 41, no. 10, pp. 756–763, Oct. 2009, ISSN: 0010-4485. DOI: 10.1016/j.cad.2009.01.003.
L. De Floriani, A. Hui, L. Papaleo, M. Huang, and J. Hendler, “A semantic web environment for digital shapes understanding,” in Semantic Multimedia, Springer, 2007, pp. 226–239.
L. Papaleo, L. De Floriani, J. Hendler, and A. Hui, “Towards a semantic web system for understanding real world representations,” in Proceedings of the Tenth International Conference on Computer Graphics and Artificial Intelligence, 2007.
P. Kapahnke, P. Liedtke, S. Nesbigall, S. Warwas, and M. Klusch, “ISReal: An Open Platform for Semantic-Based 3D Simulations in the 3D Internet,” in International Semantic Web Conference (2), 2010, pp. 161–176.
S. Albrecht, T. Wiemann, M. G¨ unther, and J. Hertzberg, “Matching CAD object models in semantic mapping,” in Proceedings ICRA 2011 Workshop: Semantic Perception, Mapping and Exploration, SPME, 2011.
M. Fischbach, D. Wiebusch, A. Giebler-Schubert, M. E. Latoschik, S. Rehfeld, and H. Tramberend, “SiXton’s curse - Simulator X demonstration,” in Virtual Reality Conference (VR), 2011 IEEE, M. Hirose, B. Lok, A. Majumder, and D. Schmalstieg, Eds., 2011, pp. 255–256. [Online]. Available: http://dx.doi.org/10.1109/VR.2011.5759495.
M. E. Latoschik and H. Tramberend, “Simulator X: A Scalable and Concurrent Software Platform for Intelligent Realtime Interactive Systems,” in Proceedings of the IEEE VR 2011, 2011.
D. Wiebusch and M. E. Latoschik, “Enhanced Decoupling of Components in Intelligent Realtime Interactive Systems using Ontologies,” in Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), proceedings of the IEEE Virtual Reality 2012 workshop, 2012, pp. 43–51.
P. Drap, O. Papini, J.-C. Sourisseau, and T. Gambin, “Ontology-based photogrammetric survey in underwater archaeology,” in European Semantic Web Conference, Springer, 2017, pp. 3–6.
M. Trellet, N. Ferey, M. Baaden, and P. Bourdot, “Interactive visual analytics of molecular data in immersive environments via a semantic definition of the content and the context,” in Immersive Analytics (IA), 2016 Workshop on, IEEE, 2016, pp. 48–53.
Trellet, M., F´erey, N., Floty ´ nski, J., Baaden, M., Bourdot, P., “Semantics for an integrative and immersive pipeline combining visualization and analysis of molecular data,” Journal of Integrative Bioinformatics, vol. 15 (2), pp. 1–19, 2018.
Y. Perez-Gallardo, J. L. L. Cuadrado, A´ . G. Crespo, and C. G. de Jesu´s, “GEODIM: A Semantic Model-Based System for 3D Recognition of Industrial Scenes,” in Current Trends on Knowledge-Based Systems, Springer, 2017, pp. 137–159.
J. Floty ´ nski, M. Krzyszkowski, and K. Walczak, “Semantic Composition of 3D Content Behavior for Explorable Virtual Reality Applications,” in Proc. of EuroVR 2017, LNCS,
J. Barbic, M. D’Cruz, M. E. Latoschik, M. Slater, and P. Bourdot, Eds., Springer, 2017, pp. 3–23. DOI: 10.1007/978-3-319-72323-5_1.
J. Floty ´ nski and K. Walczak, “Knowledge-based representation of 3D content behavior in a service-oriented virtual environment,” in Proceedings of the 22nd International Conference on Web3D Technology, Brisbane (Australia), June 5-7, 2017,, ACM, New York, 2017, Article No 14, ISBN: 978-1-4503-4955-0. DOI: 10.1145/3055624.3075959.
Downloads
Published
How to Cite
Conference Proceedings Volume
Section
License
Copyright (c) 2021 Jakub Flotyński, Paweł Sobociński, Sergiusz Strykowski, Dominik Strugała, Paweł Buń, Filip Górski, Krzysztof Walczak
This work is licensed under a Creative Commons Attribution 4.0 International License.
