RobSenCom: A Middleware to Improve the Connectivity between Heterogeneous Robots and IoT
RobSenCom
Internet-of-Things (IoT) networks span an increasingly diverse set of stationary and robotic devices (e.g., aerial drones, autonomous ground vehicles). Achieving communication synchrony, reliability, and fault tolerance among these devices is a key challenge due to the complex dynamics of mobile, heterogeneous devices deployed in real-world environments. This project will begin to address that challenge in the context of IoT networks operating across multiple mobile agents. The project will take a “ground up” approach, beginning with addressing fundamental differences in simulation mechanics between multi-agent robotics simulators and network simulators. Three main objectives will be pursued: (1) The project will explore integration challenges associated with combining physics-based simulators and discrete event-based simulators. A new network coordinator will be developed to synchronize the simulation timelines between these systems. (2) Using this integrated framework, the project will study the propagation of errors arising from within the constituent platforms under a range of scenarios (e.g., varying agent speeds, varying networking protocols). (3) Finally, the project will integrate the simulation framework with physical devices to enable hybrid experimentation, reducing the "simulation-to-reality" gap.
As IoT networks increasingly expand across multi-agent robotic environments, their utility in realizing mission-critical services will grow. Potential applications already being explored include search and rescue services, wildfire monitoring, and flood impact assessment. This project will begin to provide the computer and network systems foundations necessary to construct these systems in a manner that ensures communication synchrony, reliability, and fault tolerance. More generally, this project will catalyze innovation in the design and validation of large-scale IoT networks built upon stationary devices and mobile robots. The impact on future mission-critical IoT systems and the resulting economic and societal benefits could be significant. The project will also contribute to workforce development through the involvement of undergraduate researchers, high school students, and a postdoctoral researcher. The PI is committed to broadening participation and will actively recruit students from groups underrepresented in computing.
Project Goals
Develop and test a middleware for simulating and evaluating network performance of a multi robot system in a virtual environment.
Develop a performance test package that can evaluate network performance of both ROS1 (Master) and ROS2 (Masterless) architectures.
Compare the performance of using both UDP and TCP as well as Line of Sight (LOS) and Non-Line of Sight (NLOS) situations in real and virtual environments.
Set up a multi robot system that can be deployed in an indoor and outdoor environment, an image of the proposed experimentation flow is shown below.
Simulation Results
The simulation experimentation consisted of analyzing the system in Line-of-Sight (LOS) and Non-Line-of-Sight (NLOS) scenarios, the experiments contained two Unmanned Ground Vehicles (UGV) and an Unmanned Air Vehicle (UAV) in different communication scenarios. The first experiment evaluated the performance between two UGV's, the second consisted of communication between UGV to UAV, and finally an analysis of UDP vs TCP in a UGV to UGV setting.
SIMULATION RESULTS FOR OUR MASTERLESS SYNCHRONIZING MIDDLEWARE ON BOTH LOS, AND NLOS COMMUNICATION SCHEME USING AVERAGE DELAY (PDa)(S) AND PACKET LOSS PROBABILITY(Lp)(%) MATRICES CONSIDERING A UGV TO UGV COMMUNICATION SCENARIO
SIMULATION RESULTS FOR OUR MASTERLESS SYNCHRONIZING MIDDLEWARE ON BOTH LOS, AND NLOS COMMUNICATION SCHEME USING AVERAGE DELAY (PDa)(S) AND PACKET LOSS PROBABILITY(Lp)(%) MATRICES CONSIDERING A UGV TO UAV COMMUNICATION SCENARIO
SIMULATION RESULTS FOR OUR MASTERLESS SYNCHRONIZING MIDDLEWARE ON BOTH LOS, AND NLOS COMMUNICATION SCHEME USING AVERAGE DELAY (PDa)(S) AND PACKET LOSS PROBABILITY(Lp)(%) MATRICES CONSIDERING A UGV TO UGV COMMUNICATION SCENARIO
Gazebo Terrain Design
We generated simulated scenarios for both LOS and NLOS channels to demonstrate that our technique is capable of executing its intended function. The environments are rendered on Gazebo (Baylands environment), which in our case, hosts the physics simulator. The designed environmental setting has dimensions of one hundred by one hundred meters.
System Implementation
Communication scheme that will be used for demonstration of functionality and performance evaluation of a heterogenous multi-robot system.
Two turtlebots communicating through the duckiedrone in a Line of Sight scenario. Duckiedrone is controlled remotely while turtlebots communicate.
Similar to Line of Sight however Duckiedrone is not in flight and has several obstacles blocking communication to simulate Non-Line of Sight
Preliminary Results
The figure above represents the results of a rudimentary experiment involving the use of two turtlebot3 burgers communicating through a duckiedrone to simulate it acting as a Master Node, using both UDP and TCP communication. UDP shows an initial packet loss of 35%, which steadily increases as the robots are moved further away. When the sending Turtlebot is placed behind a wall, this shifts the packet loss by 5%. At first glance of the TCP plot, it seems that NLOS is more efficient than LOS. However, the scale of the plots shows overall packet loss is less than 0.25% meaning it is almost negligible. Similar simulations were run using only two turtlebot3 burgers to simulate a masterless communication scheme, however no change in packet loss could be observed creating promising potential for a superior communication architecture.
Research Challenges
Device Heterogeneity- the original research plan was to use a turtlebot3 burger, an XGO-MINI robot dog and a duckiedrone to simulate the master and master-less based architecture however several problems arose during experimentation.
Turtlebot3 Burger robots are widely used in the field there is a lot of documentation so many of the problems and solutions can be found in the github repo, however as some ROS versions had compatibility issues the two versions used are ROS1 Noetic (Master) and ROS2 Foxy (Masterless).
XGO-MINI at first seemed like a very attractive robot agent since it's an inexpensive quadruped with 12 degrees of freedom and it's equipped with several sensors to allow for intelligent AI applications such as follow the color or face recognition. However the robot does not have a WIFI module so it's difficult to integrate into a wireless multi-robot system. However there is a possible soluation of connecting a raspberry pi to the on board AI board, allowing for the robot to be controlled remotely using ROS, so this robot may be explored more in the future.
Duckiedrone proved to be problematic mainly because the only supported ROS version is ROS1 Kinetic which is outdated and does not support many of the ROS packages used during experimentation. A solution would be run Kinetic alongside another ROS version at once however this would increase the amount of processes causing the already low battery life to become even lower. Given that the duckiedrone already had several problems with calibration, running ROS packages, small amount of documentation and low battery life the addition of not being able to use it outdoors convinced the team that it's no longer worth spending time and resources on using it as a robotic agent.
Synchronization between Event based network simulator and Continuous physics simulator
ROS1 (TCP/UDP communication) vs ROS2 (DDS communication and python based)
Demonstration in an Outdoor environment (not having a stable WIFI connection)
Team
Principle Investigator
Nirmalya Roy
Research Assistant Professor
Anuradha Ravi
Ph.D Students
Emon Dey
Mohammad Saeid Anwar
Undergraduate Research Assistant
Mikolaj Walczak
Links
Github Repo:https://github.com/Emon-dey/RobSenCom
Publications
E. Dey, J. Hossain, N. Roy, and C. Busart, Synchrosim: An integrated co-simulation middleware for heterogeneous multi-robot system, in 2022 18th International Conference on Distributed Computing in Sensor Systems (DCOSS), pp. 334–341, IEEE, 2022
Emon Dey, Mikolaj Walczak, Mohammad Saeid Anwar, Nirmalya Roy, Jade Freeman, Timothy Gregory, Niranjan Suri and Carl Busart. A Novel ROS2 QoS Policy-enabled Synchronizing Middleware for Co-simulation of Heterogeneous Multi-Robot Systems, in Proceedings of the 32nd IEEE International Conference on Computer Communications and Networks (ICCCN), Honolulu, HI, USA, July 2023 [pdf]
Acknowledgements
This material is based upon the work supported by the National Science Foundation under Grant Numbers: CNS 2233879, REU Site 2050999 and U.S. Army Grant Number: W911NF2120076.