Joining SUMO and Unreal Engine to Create a Bespoke 360 Degree Narrow Passage Driving Simulator
DOI:
https://doi.org/10.52825/scp.v5i.1104Keywords:
SUMO, Unreal Engine, Narrow Passage, Co-SimulationAbstract
The use of simulators is widespread in driver behavioural research. The ability of driving simulators to achieve the high levels of behavioural fidelity desired by behavioural researchers is argued to be resultant of the physical fidelity of the simulator. Whilst attempts to maximise the physical fidelity of simulators have often been focused on the hardware capabilities of the simulator, the software of the simulator has been argued to be as important. This is because the software of a simulator controls the intelligence and the heterogeneity of the behaviours of the simulated vehicles, as well as the quality of the graphics of the simulation.
Despite the importance of intelligent simulated agents, previous driving simulator studies have tended to simplify the behaviours of simulated vehicles and the scenarios that are presented to participants. This is particularly true of simulator studies investigating the decision-making of drivers at narrow passages, a relatively unregulated but hazardous situation in which two opposing vehicles must negotiate how to safely pass through a road narrowing, in which the interactive nature of the interaction has often been neglected. Following a review of the requirements for a representative narrow passage driving simulator, it is argued that co-simulation, an approach which combines multiple simulator types to create a global simulation, provides the best approach to creating intelligent simulated agents within an immersive environment for narrow passage behavioural research. As such, the development of a simulator for narrow passage behavioural research that combines SUMO and Unreal Engine is described. In particular, the development of a novel narrow passage behavioural model within SUMO that utilises previous behavioural findings is highlighted. To this end, it is argued that this approach facilitates higher levels of behavioural fidelity for narrow passage interaction studies and provides a framework for the investigation of other driver behaviours.
Downloads
References
R. G. Mortimer, “Effect of Low Blood-Alcohol Concentrations in Simulated Day and Night Driving,” Percept. Mot. Skills, vol. 17, pp. 399–408, Aug. 1963, doi: https://doi.org/10.2466/pms.1963.17.2.399.
J. C. F. De Winter, P. M. Van Leeuwen, and R. Happee, “Advantages and Disadvantages of Driving Simulators: A Discussion,” in Proceedings of Measuring Behavior, Aug. 2012, pp. 47–50. Accessed: Dec. 16, 2021. [Online]. Available: http://ec.europa.eu/transport/roadsafety_library/publications/trainer_deliverable_2_1.pdf
O. Carsten and A. H. Jamson, “Driving Simulators as Research Tools in Traffic Psychology,” in Handbook of Traffic Psychology, Academic Press, 2011, pp. 87–96. doi: https://doi.org/10.1016/B978-0-12-381984-0.10007-4.
R. A. Wynne, V. Beanland, and P. M. Salmon, “Systematic review of driving simulator validation studies,” Saf. Sci., vol. 117, pp. 138–151, Aug. 2019, doi: https://doi.org/10.1016/J.SSCI.2019.04.004.
V. D. Calhoun and G. D. Pearlson, “A selective review of simulated driving studies: Combining naturalistic and hybrid paradigms, analysis approaches, and future directions,” Neuroimage, vol. 59, no. 1, pp. 25–35, Jan. 2012, doi: https://doi.org/10.1016/J.NEUROIMAGE.2011.06.037.
F. Bella, A. Garcia, F. Solves, and M. A. Romero, “Driving Simulator Validation for Deceleration Lane Design,” 2007. Accessed: Apr. 16, 2022. [Online]. Available: https://trid.trb.org/view/801356
S. T. Godley, T. J. Triggs, and B. N. Fildes, “Driving simulator validation for speed research,” Accid. Anal. Prev., vol. 34, no. 5, pp. 589–600, Sep. 2002, doi: https://doi.org/10.1016/S0001-4575(01)00056-2.
X. Yan, M. Abdel-Aty, E. Radwan, X. Wang, and P. Chilakapati, “Validating a driving simulator using surrogate safety measures,” Accid. Anal. Prev., vol. 40, no. 1, pp. 274–288, Jan. 2008, doi: https://doi.org/10.1016/J.AAP.2007.06.007.
M. Risto and M. H. Martens, “Driver headway choice: A comparison between driving simulator and real-road driving,” Transp. Res. Part F Traffic Psychol. Behav., vol. 25, no. PART A, pp. 1–9, Jul. 2014, doi: https://doi.org/10.1016/J.TRF.2014.05.001.
W. D. Käppler, “Views on the role of simulation in driver training,” 1993.
L. Evans, Traffic Safety . Science Serving Society, 2004. Accessed: Jan. 08, 2021. [Online]. Available: https://www.scienceservingsociety.com/ts/text.htm
J. M. Hoc, “Towards a cognitive approach to human-machine cooperation in dynamic situations,” Int. J. Hum. Comput. Stud., vol. 54, no. 4, pp. 509–540, 2001, doi: https://doi.org/10.1006/ijhc.2000.0454.
M. Rettenmaier, S. Dinkel, and K. Bengler, “Communication via motion – Suitability of automated vehicle movements to negotiate the right of way in road bottleneck scenarios,” Appl. Ergon., vol. 95, p. 103438, Sep. 2021, doi: https://doi.org/10.1016/j.apergo.2021.103438.
L. Miller, J. Kraus, J. Leitner, T. Stoll, and M. Baumann, “Solving Cooperative Situations: Strategic Driving Decisions Depending on Perceptions and Expectations About Other Drivers,” in Proceedings of the 21st Congress of the International Ergonomics Association, Jun. 2021, vol. 221 LNNS, pp. 742–750. doi: https://doi.org/10.1007/978-3-030-74608-7_91.
M. Zimmermann et al., “Carrot and stick: A game-theoretic approach to motivate cooperative driving through social interaction,” Transp. Res. Part C Emerg. Technol., vol. 88, pp. 159–175, Mar. 2018, doi: https://doi.org/10.1016/j.trc.2018.01.017.
N. Lütteken, M. Zimmermann, and K. J. Bengler, “Using gamification to motivate human cooperation in a lane-change scenario,” IEEE Conf. Intell. Transp. Syst. Proceedings, ITSC, pp. 899–906, 2016, doi: https://doi.org/10.1109/ITSC.2016.7795662.
T. Stoll, M. Lanzer, and M. Baumann, “Situational influencing factors on understanding cooperative actions in automated driving,” Transp. Res. Part F Traffic Psychol. Behav., vol. 70, pp. 223–234, 2020, doi: https://doi.org/10.1016/j.trf.2020.03.006.
P. Youssef, K. L. Plant, and B. Waterson, “Narrow passage interactions: A UK-based exploratory survey study to identify factors affecting driver decision-making,” Transp. Res. Part F Traffic Psychol. Behav., vol. 100, pp. 402–418, Jan. 2024, doi: https://doi.org/10.1016/j.trf.2023.12.009.
M. Rettenmaier and K. Bengler, “The Matter of How and When: Comparing Explicit and Implicit Communication Strategies of Automated Vehicles in Bottleneck Scenarios,” IEEE Open J. Intell. Transp. Syst., vol. 2, pp. 282–293, Aug. 2021, doi: https://doi.org/10.1109/OJITS.2021.3107678.
H. Weinreuter, J. Imbsweiler, N. R. Strelau, B. Deml, and F. Puente León, “Prediction of human driver intentions at a narrow passage in inner city traffic,” Tech. Mess., vol. 86, no. 1, pp. 127-S131, 2019, doi: https://doi.org/10.1515/teme-2019-0063.
G. J. Blaauw, “Driving Experience and Task Demands in Simulator and Instrumented Car: A Validation Study,” Hum. Factors, vol. 24, no. 4, pp. 473–486, Nov. 1982, doi: https://doi.org/10.1177/001872088202400408.
J. D. Lee, N. Ward, E. Boer, T. L. Brown, S. A. Balk, and O. Ahmad, “Exploratory Advanced Research: Making driving simulators more useful for behavioral research-Simulator characteristics comparison and model-based transformation,” Iowa City, Oct. 2013.
B. Phillips and T. Morton, “Making Driving Simulators More Useful for Behavioral Research,” Iowa, Mar. 2015.
U. Neisser, Cognition and reality : principles and implications of cognitive psychology. San Francisco: W.H. Freeman, 1976.
G. Reymond, A. Kemeny, J. Droulez, and A. Berthoz, “Role of Lateral Acceleration in Curve Driving: Driver Model and Experiments on a Real Vehicle and a Driving Simulator,” Hum. Factors, vol. 43, no. 3, pp. 483–495, Sep. 2001, doi: https://doi.org/10.1518/001872001775898188.
F. Bella, “Driving simulator for speed research on two-lane rural roads,” Accid. Anal. Prev., vol. 40, no. 3, pp. 1078–1087, May 2008, doi: https://doi.org/10.1016/J.AAP.2007.10.015.
M. Dagdelen, G. Reymond, A. Kemeny, M. Bordier, and N. Maïzi, “Model-based predictive motion cueing strategy for vehicle driving simulators,” Control Eng. Pract., vol. 17, no. 9, pp. 995–1003, Sep. 2009, doi: https://doi.org/10.1016/J.CONENGPRAC.2009.03.002.
Q. Hussain, M. Almallah, W. K. M. Alhajyaseen, and C. Dias, “Impact of the geometric field of view on drivers’ speed perception and lateral position in driving simulators,” Procedia Comput. Sci., vol. 170, pp. 18–25, Jan. 2020, doi: https://doi.org/10.1016/J.PROCS.2020.03.005.
P. Padmos and M. V. Milders, “Quality Criteria for Simulator Images: A Literature Review,” Hum. Factors J. Hum. Factors Ergon. Soc., vol. 34, no. 6, pp. 727–748, Dec. 1992, doi: https://doi.org/10.1177/001872089203400606.
E. J. Haug et al., “Feasibility Study and Conceptual Design of a National Advanced Driving Simulator,” Iowa City, 1990.
J. E. Korteling, “Visual Information in Driving Simulators : Literature Study and Research Proposal,” Soesterberg, 1991.
M. Pinto, V. Cavallo, and T. Ohlmann, “The development of driving simulators: toward a multisensory solution,” Trav. Hum., vol. 71, pp. 62–95, Jan. 2008, Accessed: Dec. 17, 2021. [Online]. Available: https://www.cairn.info/revue-le-travail-humain-2008-1-page-62.htm
N. A. Kaptein, J. Theeuwes, and R. van der Horst, “Driving Simulator Validity: Some Considerations,” Transp. Res. Rec. J. Transp. Res. Board, vol. 1550, no. 1, pp. 30–36, Jan. 1996, doi: https://doi.org/10.1177/0361198196155000105.
S. Wright, “Supporting intelligent traffic in the Leeds driving simulator,” University of Leeds, 2000.
A. C. Bailey, A. H. Jamson, A. M. Parkes, and S. Wright, “Recent and future development of the Leeds driving simulator,” in Driving simulation conference, 1999, pp. 45–61.
M. Rettenmaier, C. Requena Witzig, and K. Bengler, “Interaction at the Bottleneck – A Traffic Observation,” in Advances in Intelligent Systems and Computing, Sep. 2020, vol. 1026, pp. 243–249. doi: https://doi.org/10.1007/978-3-030-27928-8_37.
J. Imbsweiler, M. Ruesch, R. Palyafári, B. Deml, and F. León, “Entwicklung einer Beobachtungsmethode von Verhaltensströmen in kooperativen Situationen im innerstädtischen Verkehr,” 2016.
J. Imbsweiler, T. Stoll, M. Ruesch, M. Baumann, and B. Deml, “Insight into cooperation processes for traffic scenarios: modelling with naturalistic decision making,” Cogn. Technol. Work, vol. 20, no. 4, pp. 621–635, 2018, doi: https://doi.org/10.1007/s10111-018-0518-7.
J. Imbsweiler et al., “Die Rolle der expliziten Kommunikation im Straßenverkehr,” 2018. Accessed: Apr. 14, 2022. [Online]. Available: https://www.researchgate.net/publication/323365310
J. Imbsweiler, R. Palyafári, F. Puente León, and B. Deml, “Investigation of decision-making behavior in cooperative traffic situations using the example of a narrow passage,” AT-Automatisierungstechnik, vol. 65, no. 7, pp. 477–488, 2017, doi: https://doi.org/10.1515/auto-2016-0127.
M. Rettenmaier, D. Albers, and K. Bengler, “After you?! – Use of external human-machine interfaces in road bottleneck scenarios,” Transp. Res. Part F Traffic Psychol. Behav., vol. 70, pp. 175–190, Apr. 2020, doi: https://doi.org/10.1016/j.trf.2020.03.004.
B. L. Hills, “Vision, visibility, and perception in driving,” Perception, vol. 9, no. 2, pp. 183–216, Apr. 1980, doi: https://doi.org/10.1068/p090183.
L. Miller, J. Leitner, J. Kraus, and M. Baumann, “Implicit intention communication as a design opportunity for automated vehicles: Understanding drivers’ interpretation of vehicle trajectory at narrow passages,” Accid. Anal. Prev., vol. 173, Aug. 2022, doi: https://doi.org/10.1016/J.AAP.2022.106691.
L. Miller et al., “Time to Arrival as Predictor for Uncertainty and Cooperative Driving Decisions in Highly Automated Driving,” in 2022 IEEE Intelligent Vehicles Symposium (IV), Jun. 2022, pp. 1048–1053. doi: https://doi.org/10.1109/IV51971.2022.9827416.
R. J. Kiefer, C. A. Flannagan, and C. J. Jerome, “Time-to-collision judgments under realistic driving conditions,” Hum. Factors, vol. 48, no. 2, pp. 334–345, Jun. 2006, doi: https://doi.org/10.1518/001872006777724499.
P. Youssef, B. Waterson, and K. L. Plant, “‘That’s a bit of a tight squeeze!’: A Thematic Analysis of Narrow Passage Driving Interactions using the Perceptual Cycle Model”. Unpublished.
A. Deppermann, “Intersubjectivity and other grounds for action-coordination in an environment of restricted interaction: Coordinating with oncoming traffic when passing an obstacle,” Lang. Commun., vol. 65, pp. 22–40, Mar. 2019, doi: https://doi.org/10.1016/j.langcom.2018.04.005.
R. Wenzel, M. Probst, T. Puphal, T. H. Weisswange, and J. Eggert, “Asymmetry-based Behavior Planning for Cooperation at Shared Traffic Spaces,” Jul. 2021.
M. Naumann, M. Lauer, and C. Stiller, “Generating Comfortable, Safe and Comprehensible Trajectories for Automated Vehicles in Mixed Traffic,” in IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, May 2018, vol. 2018-November, pp. 575–582. doi: https://doi.org/10.1109/ITSC.2018.8569658.
C. Gomes, C. Thule, D. Broman, P. G. Larsen, and H. Vangheluwe, “Co-Simulation: A Survey,” ACM Comput. Surv., vol. 51, no. 3, May 2018, doi: https://doi.org/10.1145/3179993.
C. Antonya, C. Irimia, M. Grovu, C. Husar, and M. Ruba, “Co-Simulation Environment for the Analysis of the Driving Simulator’s Actuation,” in 2019 IEEE 7th International Conference on Control, Mechatronics and Automation, Nov. 2019, pp. 315–321. doi: https://doi.org/10.1109/ICCMA46720.2019.8988628.
M. Barthauer and A. Hafner, “Coupling traffic and driving simulation: Taking advantage of SUMO and SILAB together,” in SUMO 2018-Simulating Autonomous and Intermodal Transport Systems, 2018, vol. 2, pp. 56–66.
N. Fouladinejad, N. Fouladinejad, M. K. A. Jalil, and J. M. Taib, “Modeling virtual driving environment for a driving simulator,” in 2011 IEEE International Conference on Control System, Computing and Engineering, 2011, pp. 27–32. doi: https://doi.org/10.1109/ICCSCE.2011.6190490.
J. Eising et al., “PARCOURS: A SUMO-Integrated 3D Driving Simulator for Behavioral Studies,” in SUMO 2016 – Traffic, Mobility, and Logistics, 2016, pp. 135–146.
C. Olaverri-Monreal, J. Errea-Moreno, A. Díaz-álvarez, C. Biurrun-Quel, L. Serrano-Arriezu, and M. Kuba, “Connection of the SUMO Microscopic Traffic Simulator and the Unity 3D Game Engine to Evaluate V2X Communication-Based Systems,” Sensors, vol. 18, no. 12, Dec. 2018, doi: https://doi.org/10.3390/S18124399.
T. Tettamanti, M. Szalai, S. Vass, and V. Tihanyi, “Vehicle-In-the-Loop Test Environment for Autonomous Driving with Microscopic Traffic Simulation,” Oct. 2018. doi: https://doi.org/10.1109/ICVES.2018.8519486.
S. Chen, Y. Chen, S. Zhang, and N. Zheng, “A Novel Integrated Simulation and Testing Platform for Self-Driving Cars with Hardware in the Loop,” IEEE Trans. Intell. Veh., vol. 4, no. 3, pp. 425–436, Sep. 2019, doi: https://doi.org/10.1109/TIV.2019.2919470.
M. Szalai, B. Varga, T. Tettamanti, and V. Tihanyi, “Mixed reality test environment for autonomous cars using Unity 3D and SUMO,” in EEE 18th World Symposium on Applied Machine Intelligence and Informatics, Jan. 2020, pp. 73–78. doi: https://doi.org/10.1109/SAMI48414.2020.9108745.
X. Liao et al., “Game Theory-Based Ramp Merging for Mixed Traffic With Unity-SUMO Co-Simulation,” IEEE Trans. Syst. Man, Cybern. Syst., pp. 1–12, Dec. 2021, doi: https://doi.org/10.1109/TSMC.2021.3131431.
P. A. Lopez et al., “Microscopic Traffic Simulation using SUMO,” in IEEE Conference on Intelligent Transportation Systems, Dec. 2018, vol. 2018-November, pp. 2575–2582. doi: https://doi.org/10.1109/ITSC.2018.8569938.
Unreal Engine, “nDisplay Overview.” https://docs.unrealengine.com/4.27/en-US/WorkingWithMedia/IntegratingMedia/nDisplay/Overview/ (accessed Feb. 02, 2024).
A. Wegener, M. Piórkowski, M. Raya, H. Hellbrück, S. Fischer, and J. P. Hubaux, “TraCI: An interface for coupling road traffic and network simulators,” Proc. 11th Commun. Netw. Simul. Symp. CNS’08, pp. 155–163, 2008, doi: https://doi.org/10.1145/1400713.1400740.
DLR, “TraCI - SUMO Documentation,” DLR, Feb. 14, 2022. https://sumo.dlr.de/docs/TraCI.html (accessed Apr. 28, 2022).
I. Paranjape, J. Whitehead, J. Defaj, and J. Aniguid, “Sumo2Unreal: Convert Sumo .net.xml road network files into road geometry inside Unreal,” GitHub Repository, 2019. https://github.com/AugmentedDesignLab/Sumo2Unreal (accessed Apr. 28, 2022).
D. Salles, S. Kaufmann, and H.-C. Reuss, “Extending the Intelligent Driver Model in SUMO and Verifying the Drive Off Trajectories with Aerial Measurements,” 2020.
M. Treiber, A. Hennecke, and D. Helbing, “Congested Traffic States in Empirical Observations and Microscopic Simulations,” Phys. Rev. E - Stat. Physics, Plasmas, Fluids, Relat. Interdiscip. Top., vol. 62, no. 2, pp. 1805–1824, Feb. 2000, doi: https://doi.org/10.1103/PhysRevE.62.1805.
J. Erdmann, “Lane-Changing Model in SUMO,” in Proceedings of the SUMO2014 Modeling Mobility with Open Data, May 2014, pp. 77–88. Accessed: Apr. 26, 2022. [Online]. Available: https://elib.dlr.de/89233/
M. Semrau, J. Erdmann, B. Friedrich, and R. Waldmann, “Simulation framework for testing ADAS in Chinese traffic situations,” in SUMO 2016 – Traffic, Mobility, and Logistics, 2016, pp. 103–114.
F. Sagberg, Selpi, G. F. Bianchi Piccinini, and J. Engström, “A review of research on driving styles and road safety,” Hum. Factors, vol. 57, no. 7, pp. 1248–1275, 2015, doi: https://doi.org/10.1177/0018720815591313.
H. Hooft van Huysduynen, J. Terken, and B. Eggen, “The relation between self-reported driving style and driving behaviour. A simulator study,” Transp. Res. Part F Traffic Psychol. Behav., vol. 56, pp. 245–255, Jul. 2018, doi: https://doi.org/10.1016/j.trf.2018.04.017.
C. F. Choudhury, “Modeling Driving Decisions with Latent Plans,” Massachusetts Institute of Technology , Cambridge, 2007. Accessed: Jan. 11, 2021. [Online]. Available: https://its.mit.edu/sites/default/files/documents/CFC_PhDThesis_submitted_ITS.pdf
E. Hollnagel, Human Reliability Analysis: Context and Control. London: Academic Press, 1993. Accessed: Dec. 07, 2020. [Online]. Available: https://books.google.co.uk/books/about/Human_Reliability_Analysis.html?id=jGtRAAAAMAAJ&redir_esc=y
M. Rettenmaier and K. Bengler, “Modeling the Interaction with Automated Vehicles in Road Bottleneck Scenarios,” 2020. doi: https://doi.org/10.1177/1071181320641391.
L. Miller, I. M. Koniakowsky, J. Kraus, and M. Baumann, “The Impact of Expectations about Automated and Manual Vehicles on Drivers’ Behavior: Insights from a Mixed Traffic Driving Simulator Study,” in Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Sep. 2022, pp. 150–161. doi: https://doi.org/10.1145/3543174.3546837.
Published
How to Cite
Conference Proceedings Volume
Section
License
Copyright (c) 2024 Peter Youssef, Katherine Plant, Ben Waterson
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
Accepted 2024-04-03
Published 2024-07-17
Funding data
-
Engineering and Physical Sciences Research Council
Grant numbers EP/T517859/1
