Comparative Review of Drone Simulators
DOI:
https://doi.org/10.20535/2786-8729.4.2024.300614Keywords:
drone, UAV, swarm, simulator, sensor, environmental dynamicsAbstract
The rapid development of Unmanned Aerial Vehicles (UAVs), particularly drones, has revolutionized various sectors, including agriculture, mapping, search and rescue operations and more. There is an urgent need for simulation environments to develop algorithms for complex trajectory evolutions in tasks like package delivery and environmental monitoring, to avoid the significant risks associated with real-world testing. One of the primary challenges in UAV research is the diversity and fragmentation of available simulation tools, complicating the selection of appropriate simulators for specific practical tasks. Researchers must balance trade-offs such as simulation speed, the accuracy of physical law emulation, sensor integration, and user interface quality. The absence of a universal simulator that includes high-fidelity physics, comprehensive sensor modeling, and scalability for drone swarm simulations is a significant issue. Known UAV simulators have certain advantages and disadvantages, but none provide a comprehensive solution to meet all the requirements for modern research and development. Integrating various sensors, such as cameras, LiDAR, GPS, and IMUs, into simulation systems remains a technical challenge, limiting the applicability of existing simulators. Additionally, the availability and support infrastructure for effective simulators can vary significantly, impacting their adoption and sustainability. Therefore, the main problem is the lack of a universal simulator that meets the diverse and specific needs of UAV research and development. A standardized approach to UAV simulation could improve the comparability of research results, simplify selection efforts, and create a unified basis for evaluating simulator performance. Advances in aerodynamic modeling, especially for quadcopters and fixed-wing UAVs, could enhance simulation accuracy and realism, better supporting the development of advanced technologies. Future research aims to develop more comprehensive, high-fidelity, and scalable simulation environments. This involves integrating innovative sensor modeling approaches, improving swarm dynamics modeling, and enhancing user accessibility and support. Key areas for improvement include sensor integration to model a wide range of sensors, improving swarm dynamics simulation to effectively model complex behaviors and interactions among multiple drones, simplifying user interfaces, providing comprehensive documentation, ensuring robust community support, developing standardized criteria for comparing and evaluating different simulators, and incorporating detailed aerodynamic principles to enhance simulation accuracy. Addressing these issues in the development of UAV simulators is crucial for advancing aerial robotics. Developing simulation environments with integrated advanced sensor capabilities, improved swarm dynamics modeling, and user-friendly interfaces can enhance the effectiveness and efficiency of UAV development. Standardized evaluation criteria and detailed aerodynamic modeling will support the evolution of UAV technologies, ensuring safer, more reliable, and innovative applications across various sectors. These enhancements will foster innovation, technological progress, and operational efficiency in real-world conditions.
References
A. Ollero, M. Tognon, A. Suarez, D. Lee, and A. Franchi, "Past, present, and future of aerial robotic manipulators," IEEE Transactions on Robotics, vol. 38, no. 1, pp. 626–645, 2022, https://doi.org/10.1109/TRO.2021.3084395.
"Autonomous Firefighting Drone For High-Rise Fires in China," Intelligent Living. Available: https://www.intelligentliving.co/autonomous-fire-fighting-drone/. [Accessed: 21-Mar-2024].
S. A. H. Mohsan, et al., "Unmanned aerial vehicles (UAVs): practical aspects, applications, open challenges, security issues, and future trends," Intelligent Service Robotics, vol. 16, pp. 109–137, 2023, https://doi.org/https://doi.org/10.1007/s11370-022-00452-4.
A. Kolling, P. Walker, N. Chakraborty, K. Sycara, and M. Lewis, "Human Interaction With Robot Swarms: A Survey," IEEE Transactions on Human-Machine Systems, vol. 46, no. 1, pp. 9–26, 2016, https://doi.org/10.1109/THMS.2015.2480801.
Y. Wang, T.-J. Zhang, Z. Cai, J. Zhao, and K. Wu, "Multi-UAV coordination control by chaotic grey wolf optimization based distributed MPC with event-triggered strategy," Chinese Journal of Aeronautics, vol. 33, pp. 2877-2897, 2020, https://doi.org/10.1016/j.cja.2020.04.028.
C. K. Liu and D. Negrut, "The Role of Physics-Based Simulators in Robotics," Annual Review of Control, Robotics, and Autonomous Systems, vol. 4, no. 1, pp. 35–58, 2021, https://doi.org/10.1146/annurev-control-072220-093055.
J. Collins, S. Chand, A. Vanderkop, and D. Howard, "A Review of Physics Simulators for Robotic Applications," IEEE Access, vol. 9, pp. 51416–51431, 2021, doi: 10.1109/ACCESS.2021.3068769.
J. Saunders, S. Saeedi, and W. Li, "Autonomous aerial robotics for package delivery: A technical review," Journal of Field Robotics, vol. 40, no. 1, pp. 3–49, 2023, https://doi.org/10.1002/rob.22231.
A. Mairaj, A. I. Baba, and A. Y. Javaid, "Application specific drone simulators: Recent advances and challenges," Simulation Modelling Practice and Theory, vol. 94, pp. 100–117, 2019, https://doi.org/10.1016/j.simpat.2019.01.004.
S. Shah, D. Dey, C. Lovett, and A. Kapoor, "AirSim: High-fidelity visual and physical simulation for autonomous vehicles," in Field and Service Robotics, Springer, 2018, pp. 621–635, doi: 10.1007/978-3-319-67361-5_40.
Y. Song, S. Naji, E. Kaufmann, A. Loquercio, and D. Scaramuzza, "Flightmare: A flexible quadrotor simulator," in Proc. Conference on Robot Learning (CoRL), PMLR, 2021, pp. 1147–1157, https://doi.org/10.48550/arXiv.2009.00563.
N. Koenig and A. Howard, "Design and use paradigms for gazebo, an open-source multi-robot simulator," in Proc. 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), vol. 3, pp. 2149–2154, Sep. 2004, https://doi.org/10.1109/IROS.2004.1389727.
O. Michel, "Cyberbotics Ltd. Webots: Professional mobile robot simulation," International Journal of Advanced Robotic Systems, vol. 1, no. 1, p. 5, 2004, doi: 10.5772/5618.
F. Furrer, M. Burri, M. Achtelik, and R. Siegwart, "RotorS — a modular gazebo MAV simulator framework," in Robot Operating System (ROS): The Complete Reference (Volume 1), Springer, 2016, pp. 595–625, https://doi.org/10.1007/978-3-319-26054-9_23.
W. Guerra, E. Tal, V. Murali, G. Ryou, and S. Karaman, "FlightGoggles: Photorealistic sensor simulation for perception-driven robotics using photogrammetry and virtual reality," in Proc. 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Nov. 2019, pp. 6941–6948, https://doi.org/10.1109/IROS40897.2019.8968116.
J. Panerati, H. Zheng, S. Zhou, J. Xu, A. Prorok, and A. P. Schoellig, "Learning to fly—a gym environment with PyBullet physics for reinforcement learning of multi-agent quadcopter control," in Proc. 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Sep. 2021, pp. 7512–7519, https://doi.org/10.1109/IROS51168.2021.9635857.
J. Saunders, S. Saeedi, and W. Li, "Parallel Reinforcement Learning Simulation for Visual Quadrotor Navigation," in Proc. 2023 IEEE International Conference on Robotics and Automation (ICRA), May 2023, pp. 1357–1363, https://doi.org/10.1109/ICRA48891.2023.10160675.
A. Suarez, G. Heredia, and A. Ollero, "Compliant Bimanual Aerial Manipulation: Standard and Long Reach Configurations," IEEE Access, vol. 8, pp. 88844–88865, 2020, https://doi.org/10.1109/ACCESS.2020.2993101.
C. A. Dimmig, et al., "A Small Form Factor Aerial Research Vehicle for Pick-and-Place Tasks with Onboard Real-Time Object Detection and Visual Odometry," in Proc. 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Oct. 2023, pp. 6289–6296, https://doi.org/10.1109/IROS55552.2023.10342295.
G. Silano, E. Aucone, and L. Iannelli, "CrazyS: A Software-In-The-Loop Platform for the Crazyflie 2.0 Nano-Quadcopter," in Proc. 2018 26th Mediterranean Conference on Control and Automation (MED), Zadar, Croatia, 2018, pp. 1-6, https://doi.org/10.1109/MED.2018.8442759.
"Gazebo Classic Simulation | PX4 User Guide (main). Redirecting to latest version of document (master)," PX4 User Guide. Available: https://docs.px4.io/main/en/sim_gazebo_classic/. [Accessed: 24-Mar-2024].
"Gazebo," Gazebo. Available: https://gazebosim.org/. [Accessed: 24-Mar-2024].
"Isaac Sim," NVIDIA Developer. Available: https://developer.nvidia.com/isaac-sim. [Accessed: 24-Mar-2024].
M. Jacinto, J. Patrikar, J. Pinto, J. Keller, R. Cunha, and S. Scherer, "Pegasus Simulator: An Isaac Sim Framework for Multiple Aerial Vehicles Simulation," arXiv preprint, arXiv:2307.05263, 2023.
V. Makoviychuk, et al., "Isaac Gym: High performance GPU-based physics simulation for robot learning," arXiv preprint, arXiv:2108.10470, 2021.
M. Kulkarni, T. J. L. Forgaard, and K. Alexis, "Aerial Gym–Isaac Gym Simulator for Aerial Robots," arXiv preprint, arXiv:2305.16510, 2023.
T. Erez, Y. Tassa, and E. Todorov, "Simulation tools for model-based robotics: Comparison of Bullet, Havok, MuJoCo, ODE and PhysX," in Proc. 2015 IEEE International Conference on Robotics and Automation (ICRA), May 2015, pp. 4397–4404, https://doi.org/10.1109/ICRA.2015.7139807.
X. Gu, N. Shi, C. Liu, and Y. Lin, "Design and Dynamics Simulation of a Triphibious Robot in Webots Environment," in Proc. 2021 IEEE International Conference on Mechatronics and Automation (ICMA), Aug. 2021, pp. 1268–1273, https://doi.org/10.1109/ICMA52036.2021.9512574.
E. Rohmer, S. P. N. Singh, and M. Freese, "V-REP: A versatile and scalable robot simulation framework," in Proc. 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Nov. 2013, pp. 1321–1326, https://doi.org/10.1109/IROS.2013.6696520.
P. Udvardy, B. Beszedes, B. Toth, A. Foldi, and A. Botos, "Simulation of obstacle avoidance of an UAV," in Proc. 2020 New Trends in Aviation Development (NTAD), Sep. 2020, pp. 245–249, https://doi.org/10.1109/NTAD51447.2020.9379113.
GitHub - PegasusSimulator/PegasusSimulator: A framework built on top of NVIDIA Isaac Sim for simulating drones with PX4 support and much more, GitHub. Available: https://github.com/PegasusSimulator/PegasusSimulator. [Accessed: 21-Mar-2024].
E. Todorov, T. Erez, and Y. Tassa, "MuJoCo: A physics engine for model-based control," in Proc. 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Oct. 2012, pp. 5026–5033, https://doi.org/10.1109/IROS.2012.6386109.
Y. Song, A. Romero, M. Müller, V. Koltun, and D. Scaramuzza, "Flightmare: A Flexible Quadrotor Simulator," in Proc. 2021 Conference on Robot Learning (CoRL), PMLR, 2021, pp. 1147–1157, https://doi.org/10.5167/uzh-193792.
Y. Song, A. Romero, M. Müller, V. Koltun, and D. Scaramuzza, "Reaching the limit in autonomous racing: Optimal control versus reinforcement learning," Science Robotics, vol. 8, no. 82, 2023, https://doi.org/10.1126/scirobotics.adg1462.
W. Guerra, E. Tal, V. Murali, G. Ryou, and S. Karaman, "FlightGoggles: A Modular Framework for Photorealistic Camera, Exteroceptive Sensor, and Dynamics Simulation," in Proc. 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Nov. 2019, https://doi.org/10.1109/IROS40897.2019.8968116.
GitHub - microsoft/AirSim: Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research, GitHub. Available: https://github.com/Microsoft/AirSim. [Accessed: 21-Mar-2024].
E. Coumans, et al.,, "PyBullet, a python module for physics simulation for games, robotics and machine learning," 2016. Available: https://pybullet.org/.
T. Mark, et al., "Gymnasium," Zenodo. Available: https://zenodo.org/record/8127025. [Accessed: 24-Mar-2024].
A. Raffin, A. Hill, M. G. Kanervisto, and N. Ernestus, "Stable-Baselines3: Reliable Reinforcement Learning Implementations," Journal of Machine Learning Research, vol. 22, no. 1, 2021. Available: https://www.jmlr.org/papers/v22/20-1364.html.
G. Li, X. Liu and G. Loianno, "RotorTM: A Flexible Simulator for Aerial Transportation and Manipulation," in IEEE Transactions on Robotics, vol. 40, pp. 831-850, 2024, https://doi.org/10.1109/TRO.2023.3336320.
"UAV Toolbox," MathWorks - Makers of MATLAB and Simulink - MATLAB & Simulink. Available: https://www.mathworks.com/products/uav.html. [Accessed: 24-Mar-2024].
N. Horri and M. Pietraszko, "A Tutorial and Review on Flight Control Co-Simulation Using Matlab/Simulink and Flight Simulators," Automation, vol. 3, no. 3, pp. 486-510, 2022. https://doi.org/10.3390/automation3030025.
Z. Yuan et al., "Safe-Control-Gym: A Unified Benchmark Suite for Safe Learning-Based Control and Reinforcement Learning in Robotics," in IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 11142-11149, Oct. 2022, https://doi.org/10.1109/LRA.2022.3196132.
F. Kong, X. Liu, B. Tang, J. Lin, Y. Ren, Y. Cai, F. Zhu, N. Chen, and F. Zhang, "MARSIM: A Light-Weight Point-Realistic Simulator for LiDAR-Based UAVs," IEEE Robotics and Automation Letters, vol. 8, no. 5, pp. 2954-2961, 2023. https://doi.org/10.1109/LRA.2023.3264163.
Z. Huang, et al., "QuadSwarm: A Modular Multi-Quadrotor Simulator for Deep Reinforcement Learning with Direct Thrust Control," arXiv, 2023. https://doi.org/10.48550/arXiv.2306.09537.
E. Bøhn, E. M. Coates, S. Moe and T. A. Johansen, "Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs Using Proximal Policy optimization," 2019 International Conference on Unmanned Aircraft Systems (ICUAS), Atlanta, GA, USA, 2019, pp. 523-533, https://doi.org/10.1109/ICUAS.2019.8798254.
A. Keipour, et al., "UAS Simulator for Modeling, Analysis and Control in Free Flight and Physical Interaction," in AIAA Science and Technology Forum, 2023, p. 1279. https://doi.org/10.2514/6.2023-1279.
E. Cuniato, J. Cacace, M. Selvaggio, F. Ruggiero and V. Lippiello, "A hardware-in-the-loop simulator for physical human-aerial manipulator cooperation," 2021 20th International Conference on Advanced Robotics (ICAR), Ljubljana, Slovenia, 2021, pp. 830-835, https://doi.org/10.1109/ICAR53236.2021.9659398.
S. Folk, et al., "RotorPy: A Python-based Multirotor Simulator with Aerodynamics for Education and Research," arXiv, 2023. https://doi.org/10.48550/arXiv.2306.04485.
J. Li, et al., "Potato: A Data-Oriented Programming 3D Simulator for Large-Scale Heterogeneous Swarm Robotics," arXiv preprint arXiv:2308.12698, 2023. https://doi.org/10.48550/arXiv.2308.12698.
P. Foehn, E. Kaufmann, A. Romero, R. Penicka, S. Sun, L. Bauersfeld, T. Laengle, G. Cioffi, Y. Song, A. Loquercio, and D. Scaramuzza, "Agilicious: Open-source and open-hardware agile quadrotor for vision-based flight," Science Robotics, vol. 7, no. 67, 2022. https://doi.org/10.1126/scirobotics.abl6259.
T. Baca, et al., "The MRS UAV System: Pushing the Frontiers of Reproducible Research, Real-world Deployment, and Education with Autonomous Unmanned Aerial Vehicles," Journal of Intelligent & Robotic Systems, vol. 102, no. 1, p. 26, 2021. https://doi.org/10.1007/s10846-021-01383-5.
L. Pichierri, A. Testa and G. Notarstefano, "CrazyChoir: Flying Swarms of Crazyflie Quadrotors in ROS 2," in IEEE Robotics and Automation Letters, vol. 8, no. 8, pp. 4713-4720, Aug. 2023, https://doi.org/10.1109/LRA.2023.3286814.
J. A. Preiss, W. Honig, G. S. Sukhatme and N. Ayanian, "Crazyswarm: A large nano-quadcopter swarm," 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore, 2017, pp. 3299-3304, https://doi.org/10.1109/ICRA.2017.7989376.
M. Fernandez-Cortizas, et al., "Aerostack2: A Software Framework for Developing Multi-robot Aerial Systems," arXiv, 2023. DOI: 10.48550/arXiv.2303.18237.
"Flight Simulator | X-Plane 12: Flight Simulation Done Right," X-Plane. [Online]. Available: https://www.x-plane.com/. [Accessed: 24-Mar-2024].
I. Navarro, J. Patrikar, J. P. A. Dantas, R. Baijal, I. Higgins, S. Scherer, and J. Oh, "SoRTS: Learned Tree Search for Long Horizon Social Robot Navigation," arXiv, 2023. https://doi.org/10.48550/arXiv.2309.13144.
D. J. Richter and R. A. Calix, "QPlane: An Open-Source Reinforcement Learning Toolkit for Fixed Wing Aircraft Simulation," in Proc. 12th ACM Multimedia Systems Conf. (MMSys '21), Istanbul, Turkey, Sept. 28-Oct. 1, 2021, pp. 261-266. https://doi.org/10.1145/3458305.3478446.
A. R. Perry, "The FlightGear Flight Simulator," in Proc. Annu. Tech. Conf. (ATEC '04), 2004, p. 31.
Y. A. Prabowo, B. R. Trilaksono and F. R. Triputra, "Hardware in-the-loop simulation for visual servoing of fixed wing UAV," 2015 International Conference on Electrical Engineering and Informatics (ICEEI), Denpasar, Indonesia, 2015, pp. 247-252, https://doi.org/10.1109/ICEEI.2015.7352505.
"RealFlight RC Flight Simulator Software and Accessories," RealFlight. [Online]. Available: https://www.realflight.com/. [Accessed: 24-Mar-2024].
S. J. Carlson and C. Papachristos, "The MiniHawk-VTOL: Design, Modeling, and Experiments of a Rapidly-prototyped Tiltrotor UAV," 2021 International Conference on Unmanned Aircraft Systems (ICUAS), Athens, Greece, 2021, pp. 777-786, https://doi.org/10.1109/ICUAS51884.2021.9476731.
