Cloud robotics explained

Cloud robotics is a field of robotics that attempts to invoke cloud technologies such as cloud computing, cloud storage, and other Internet technologies centered on the benefits of converged infrastructure and shared services for robotics. When connected to the cloud, robots can benefit from the powerful computation, storage, and communication resources of modern data center in the cloud, which can process and share information from various robots or agent (other machines, smart objects, humans, etc.). Humans can also delegate tasks to robots remotely through networks. Cloud computing technologies enable robot systems to be endowed with powerful capability whilst reducing costs through cloud technologies. Thus, it is possible to build lightweight, low-cost, smarter robots with an intelligent "brain" in the cloud. The "brain" consists of data center, knowledge base, task planners, deep learning, information processing, environment models, communication support, etc.[1] [2] [3] [4]

Components

A cloud for robots potentially has at least six significant components:[5]

Applications

Autonomous mobile robots: Google's self-driving cars are cloud robots. The cars use the network to access Google's enormous database of maps and satellite and environment model (like Streetview) and combines it with streaming data from GPS, cameras, and 3D sensors to monitor its own position within centimetres, and with past and current traffic patterns to avoid collisions. Each car can learn something about environments, roads, or driving, or conditions, and it sends the information to the Google cloud, where it can be used to improve the performance of other cars.
  • Cloud medical robots: a medical cloud (also called a healthcare cluster) consists of various services such as a disease archive, electronic medical records, a patient health management system, practice services, analytics services, clinic solutions, expert systems, etc. A robot can connect to the cloud to provide clinical service to patients, as well as deliver assistance to doctors (e.g. a co-surgery robot). Moreover, it also provides a collaboration service by sharing information between doctors and care givers about clinical treatment.[6]
  • Assistive robots: A domestic robot can be employed for healthcare and life monitoring for elderly people. The system collects the health status of users and exchange information with cloud expert system or doctors to facilitate elderly peoples life, especially for those with chronic diseases. For example, the robots are able to provide support to prevent the elderly from falling down, emergency healthy support such as heart disease, blooding disease. Care givers of elderly people can also get notification when in emergency from the robot through network.[7]
  • Industrial robots: As highlighted by the German government's Industry 4.0 Plan, "Industry is on the threshold of the fourth industrial revolution. Driven by the Internet, the real and virtual worlds are growing closer and closer together to form the Internet of Things. Industrial production of the future will be characterised by the strong individualisation of products under the conditions of highly flexible (large series) production, the extensive integration of customers and business partners in business and value-added processes, and the linking of production and high-quality services leading to so-called hybrid products."[8] In manufacturing, such cloud based robot systems could learn to handle tasks such as threading wires or cables, or aligning gaskets from a professional knowledge base. A group of robots can share information for some collaborative tasks. Even more, a consumer is able to place customised product orders to manufacturing robots directly with online ordering systems.[9] Another potential paradigm is shopping-delivery robot systems. Once an order is placed, a warehouse robot dispatches the item to an autonomous car or autonomous drone to deliver it to its recipient.
  • Learn a Cloud Brain for Robots

    Approach: Lifelong Learning.[10] Leveraging lifelong learning to build a cloud brain for robots was proposed by CAS. The author was motivated by the problem of how to make robots fuse and transfer their experience so that they can effectively use prior knowledge and quickly adapt to new environments. To address the problem, they present a learning architecture for navigation in cloud robotic systems: Lifelong Federated Reinforcement Learning (LFRL). In the work, they propose a knowledge fusion algorithm for upgrading a shared model deployed on the cloud. Then, effective transfer learning methods in LFRL are introduced. LFRL is consistent with human cognitive science and fits well in cloud robotic systems. Experiments show that LFRL greatly improves the efficiency of reinforcement learning for robot navigation. The cloud robotic system deployment also shows that LFRL is capable of fusing prior knowledge.

    Approach: Federated Learning.[11] Leveraging lifelong learning to build a cloud brain for robots was proposed in 2020. Humans are capable of learning a new behavior by observing others to perform the skill. Similarly, robots can also implement this by imitation learning. Furthermore, if with external guidance, humans can master the new behavior more efficiently. So, how can robots achieve this? To address the issue, The authors present a novel framework named FIL. It provides a heterogeneous knowledge fusion mechanism for cloud robotic systems. Then, a knowledge fusion algorithm in FIL is proposed. It enables the cloud to fuse heterogeneous knowledge from local robots and generate guide models for robots with service requests. After that, we introduce a knowledge transfer scheme to facilitate local robots acquiring knowledge from the cloud. With FIL, a robot is capable of utilizing knowledge from other robots to increase its imitation learning in accuracy and efficiency. Compared with transfer learning and meta-learning, FIL is more suitable to be deployed in cloud robotic systems. They conduct experiments of a self-driving task for robots (cars). The experimental results demonstrate that the shared model generated by FIL increases imitation learning efficiency of local robots in cloud robotic systems.

    Approach: Peer-assisted Learning.[12] Leveraging peer-assisted learning to build a cloud brain for robots was proposed by UM. A technological revolution is occurring in the field of robotics with the data-driven deep learning technology. However, building datasets for each local robot is laborious. Meanwhile, data islands between local robots make data unable to be utilized collaboratively. To address this issue, the work presents Peer-Assisted Robotic Learning (PARL) in robotics, which is inspired by the peer-assisted learning in cognitive psychology and pedagogy. PARL implements data collaboration with the framework of cloud robotic systems. Both data and models are shared by robots to the cloud after semantic computing and training locally. The cloud converges the data and performs augmentation, integration, and transferring. Finally, fine tune this larger shared dataset in the cloud to local robots. Furthermore, we propose the DAT Network (Data Augmentation and Transferring Network) to implement the data processing in PARL. DAT Network can realize the augmentation of data from multi-local robots. The authors conduct experiments on a simplified self-driving task for robots (cars). DAT Network has a significant improvement in the augmentation in self-driving scenarios. Along with this, the self-driving experimental results also demonstrate that PARL is capable of improving learning effects with data collaboration of local robots.

    Research

    [13] was funded by the European Union's Seventh Framework Programme for research, technological development projects, specifically to explore the field of cloud robotics. The goal of RoboEarth is to allow robotic systems to benefit from the experience of other robots, paving the way for rapid advances in machine cognition and behaviour, and ultimately, for more subtle and sophisticated human-machine interaction. RoboEarth offers a Cloud Robotics infrastructure. RoboEarth's World-Wide-Web style database stores knowledge generated by humans – and robots – in a machine-readable format. Data stored in the RoboEarth knowledge base include software components, maps for navigation (e.g., object locations, world models), task knowledge (e.g., action recipes, manipulation strategies), and object recognition models (e.g., images, object models). The RoboEarth Cloud Engine includes support for mobile robots, autonomous vehicles, and drones, which require much computation for navigation.[14]

    Rapyuta [15] is an open source cloud robotics framework based on RoboEarth Engine developed by the robotics researcher at ETHZ. Within the framework, each robot connected to Rapyuta can have a secured computing environment (rectangular boxes) giving them the ability to move their heavy computation into the cloud. In addition, the computing environments are tightly interconnected with each other and have a high bandwidth connection to the RoboEarth knowledge repository.[16]

    KnowRob [17] is an extensional project of RoboEarth. It is a knowledge processing system that combines knowledge representation and reasoning methods with techniques for acquiring knowledge and for grounding the knowledge in a physical system and can serve as a common semantic framework for integrating information from different sources.

    [18] is a large-scale computational system that learns from publicly available Internet resources, computer simulations, and real-life robot trials. It accumulates everything robotics into a comprehensive and interconnected knowledge base. Applications include prototyping for robotics research, household robots, and self-driving cars. The goal is as direct as the project's name—to create a centralised, always-online brain for robots to tap into. The project is dominated by Stanford University and Cornell University. And the project is supported by the National Science Foundation, the Office of Naval Research, the Army Research Office, Google, Microsoft, Qualcomm, the Alfred P. Sloan Foundation and the National Robotics Initiative, whose goal is to advance robotics to help make the United States more competitive in the world economy.[19]

    MyRobots is a service for connecting robots and intelligent devices to the Internet.[20] It can be regarded as a social network for robots and smart objects (i.e. Facebook for robots). With socialising, collaborating and sharing, robots can benefit from those interactions too by sharing their sensor information giving insight on their perspective of their current state.

    [21] is funded by the INTERREG IVA France (Channel) – England European cross-border co-operation programme. The project aims to develop new technologies for disabled people through social and technological innovation and through the users' social and psychological integrity. Objectives is to produce a cognitive ambient assistive living system with Healthcare cluster in cloud with domestic service robots like humanoid, intelligent wheelchair which connect with the cloud.[7]

    ROS (Robot Operating System) provides an eco-system to support cloud robotics. ROS is a flexible and distributed framework for robot software development. It is a collection of tools, libraries, and conventions that aim to simplify the task of creating complex and robust robot behaviour across a wide variety of robotic platforms. A library for ROS that is a pure Java implementation, called rosjava, allows Android applications to be developed for robots. Since Android has a booming market and billion users, it would be significant in the field of Cloud Robotics.[22]

    DAVinci Project is a proposed software framework that seeks to explore the possibilities of parallelizing some of the robotics algorithms as Map/Reduce tasks in Hadoop.[23] The project aims to build a cloud computing environment capable of providing a compute cluster built with commodity hardware exposing a suite of robotic algorithms as a SaaS and share data co-operatively across the robotic ecosystem. This initiative is not available publicly.[24]

    C2RO (C2RO Cloud Robotics) is a platform that processes real-time applications such as collision avoidance and object recognition in the cloud. Previously, high latency times prevented these applications from being processed in the cloud thus requiring on-system computational hardware (e.g. Graphics Processing Unit or GPU). C2RO published a peer-reviewed paper at IEEE PIMRC17 showing its platform could make autonomous navigation and other AI services available on robots- even those with limited computational hardware (e.g. a Raspberry Pi)- from the cloud.[25] C2RO eventually claimed to be the first platform to demonstrate cloud-based SLAM (simultaneous localization and mapping) at RoboBusiness in September 2017.

    Noos is a cloud robotics service, providing centralised intelligence to robots that are connected to it. The service went live in December 2017. By using the Noos-API, developers could access services for computer vision, deep learning, and SLAM. Noos was developed and maintained by Ortelio Ltd.

    Rocos is a centralized cloud robotics platform that provides the developer tooling and infrastructure to build, test, deploy, operate and automate robot fleets at scale. Founded in October 2017, the platform went live in January 2019.

    Limitations of cloud robotics

    Though robots can benefit from various advantages of cloud computing, cloud is not the solution to all of robotics.[26]

    Challenges

    The research and development of cloud robotics has following potential issues and challenges:[26]

    Data, collected and/or disseminated over large, accessible networks can enable decisions for classification problems or reveal patterns.

    Risks

    History

    The term "Cloud Robotics" first appeared in the public lexicon as part of a talk given by James Kuffner in 2010 at the IEEE/RAS International Conference on Humanoid Robotics entitled "Cloud-enabled Robots".[28] Since then, "Cloud Robotics" has become a general term encompassing the concepts of information sharing, distributed intelligence, and fleet learning that is possible via networked robots and modern cloud computing. Kuffner was part of Google when he delivered his presentation and the technology company has teased its various cloud robotics initiatives until 2019 when it launched the Google Cloud Robotics Platform for developers.[29]

    From the early days of robot development, it was common to have computation done on a computer that was separated from the actual robot mechanism, but connected by wires for power and control. As wireless communication technology developed, new forms of experimental "remote brain" robots were developed controlled by small, onboard compute resources for robot control and safety, that were wirelessly connected to a more powerful remote computer for heavy processing.[30]

    The term "cloud computing" was popularized with the launch of Amazon EC2 in 2006. It marked the availability of high-capacity networks, low-cost computers and storage devices as well as the widespread adoption of hardware virtualization and service-oriented architecture.[31] In a correspondence with Popular Science in July 2006, Kuffner wrote that after a robot was programmed or successfully learned to perform a task it could share its model and relevant data with all other cloud-connected robots:[32]

    Some publications and events related to Cloud Robotics (in chronological order):

    See also

    External links

    Notes and References

    1. Web site: Cloud Robotics and Automation A special issue of the IEEE Transactions on Automation Science and Engineering.. IEEE. 7 December 2014. https://web.archive.org/web/20170914181920/http://www.ieee-ras.org/publications/t-ase/special-issues/special-issue-on-cloud-robotics-and-automation. 14 September 2017. dead.
    2. Web site: RoboEarth. 2014-12-07. https://web.archive.org/web/20141201164951/http://roboearth.org/cloud_robotics/. 2014-12-01. dead.
    3. Web site: Goldberg. Ken. Cloud Robotics and Automation.
    4. Web site: Li. R. Cloud Robotics-Enable cloud computing for robots. 7 December 2014.
    5. Kehoe. Ben. Patil. Sachin. Abbeel. Pieter. Goldberg. Ken. A Survey of Research on Cloud Robotics and Automation. IEEE Transactions on Automation Science and Engineering. 13 September 2014. Pieter Abbeel.
    6. Web site: Impact of Cloud Computing on Healthcare. 11 July 2023 .
    7. Book: Li. Ruijiao. Hu. Huosheng. 2013 IEEE International Conference on Systems, Man, and Cybernetics . Towards ROS Based Multi-robot Architecture for Ambient Assisted Living . 16 October 2013. 3458–3463. 10.1109/SMC.2013.590. 978-1-4799-0652-9. 10.1.1.648.3228. 10169400 .
    8. Web site: Project of the Future: Industry 4.0. 9 December 2014. 2 December 2014. https://web.archive.org/web/20141202232440/http://www.bmbf.de/en/19955.php. dead.
    9. Web site: LaSelle. Rush. Automation in the Cloud. Robotic Industries Association. 9 December 2014.
    10. Liu . Boyi . Wang . Lujia . Liu . Ming . October 2019 . Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems . IEEE Robotics and Automation Letters . 4 . 4 . 4555–4562 . 10.1109/LRA.2019.2931179 . 1901.06455 . 58981458 . 2377-3766.
    11. Liu . Boyi . Wang . Lujia . Liu . Ming . Xu . Cheng-Zhong . April 2020 . Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems With Heterogeneous Sensor Data . IEEE Robotics and Automation Letters . 5 . 2 . 3509–3516 . 10.1109/LRA.2020.2976321 . 1912.12204 . 209500667 . 2377-3766.
    12. Book: Liu . Boyi . Wang . Lujia . Chen . Xinquan . Huang . Lexiong . Han . Dong . Xu . Cheng-Zhong . 2021 IEEE International Conference on Robotics and Automation (ICRA) . Peer-Assisted Robotic Learning: A Data-Driven Collaborative Learning Approach for Cloud Robotic Systems . May 2021 . https://ieeexplore.ieee.org/document/9562018 . 4062–4070 . 10.1109/ICRA48506.2021.9562018. 2010.08303 . 978-1-7281-9077-8 . 223953372 .
    13. Web site: roboearth. 7 December 2014.
    14. Waibel. M. Tenorth. M. D'Andrea. R. RoboEarth. IEEE Robotics & Automation Magazine. 18. 2. 69–82. 10.1109/MRA.2011.941632. June 2011.
    15. Web site: Rapyuta. 7 December 2014.
    16. Book: Hunziker. D. D'Andrea. R. Gajamohan. M. Waibel. M. 2013 IEEE International Conference on Robotics and Automation. Rapyuta: The RoboEarth Cloud Engine. May 2013. 438–444. 10.1109/ICRA.2013.6630612. 978-1-4673-5643-5. 10.1.1.800.2033. 7644907.
    17. Web site: KnowRob. 8 December 2014.
    18. Web site: RoboBrain Project. 7 December 2014.
    19. Web site: Robo Brain' mines the Internet to teach robots.
    20. Web site: MyRobots. 9 December 2014. https://web.archive.org/web/20141211131415/http://www.myrobots.com/wiki/About. 11 December 2014. dead.
    21. Web site: Hu. Huosheng. McDonald-Maier. Klaus D. Gu. Dongbing. Li. Ruijiao. COLAS. 7 December 2014. https://web.archive.org/web/20141209230713/http://coalas-project.eu/indexen.php?p=team. 9 December 2014. dead.
    22. Web site: ROSjava-Cloud Robotics. 9 December 2014. https://web.archive.org/web/20141227072836/http://docs.rosjava.googlecode.com/hg/rosjava_core/html/index.html. 27 December 2014. dead.
    23. Book: Arumugam. R.. Enti. V. R.. Bingbing. L.. Xiaojun. W.. Baskaran. K.. Kong. F. F.. Kumar. A. S.. Meng. K. D.. Kit. G. W.. 2010 IEEE International Conference on Robotics and Automation . DAvinCi: A cloud computing framework for service robots . 2010. 3084–3089. 10.1109/ROBOT.2010.5509469. 978-1-4244-5038-1. 2669707 .
    24. Web site: RoboEarth What is Cloud Robotics?. en-US. 2019-03-08. https://web.archive.org/web/20130711124054/http://index.html/. 2013-07-11. dead.
    25. C2RO Cloud Robotics. 2017-10-18. Real-Time Cloud Robotics in Practical Smart City Applications.
    26. Web site: Robotics-vo. A Roadmap for U.S. Robotics From Internet to Robotics 2013 Edition. 8 December 2014. https://web.archive.org/web/20140905232650/https://robotics-vo.us/sites/default/files/2013%20Robotics%20Roadmap-rs.pdf. 5 September 2014. dead.
    27. Web site: Linking of cloud robotics to server. 2018-06-18. https://web.archive.org/web/20180618160814/https://artificial-future.com/cloud-robotics/. 2018-06-18. dead.
    28. Web site: Kuffner. James. Cloud-Enabled Robots. IEEE-RAS International Conference on Humanoid Robotics . 2010.
    29. Web site: Google Cloud Robotics Platform coming to developers in 2019. Crowe. Steve. 2018-10-24. The Robot Report. en-US. 2019-03-08.
    30. Inaba . Masayuki . Remote-brained robots . Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence-Volume 2 . 1593–1606 . 1997 . Morgan Kaufmann Publishers Inc. .
    31. News: Cloud Computing: Clash of the clouds . 2009-10-15 . The Economist . 2009-11-03.
    32. September 2006 . 55–71 . The Future of Robots . Popular Science .
    33. Web site: Networked Robots Committee. 8 December 2014.
    34. Web site: Google I/O 2011: Cloud Robotics, ROS for Java and Android. 9 December 2014.
    35. Web site: Big NSF grant funds research into training robots to work with humans. 17 December 2012.
    36. Web site: cloud-robotics.cs.umn.edu/. 7 December 2014.
    37. Book: Goldberg. Ken. 2013 IEEE International Conference on Robotics and Automation . Cloud-based robot grasping with the google object recognition engine. 4263–4270. 10.1109/ICRA.2013.6631180. 2013. 978-1-4673-5643-5. 10.1.1.299.3857. 2744967 .
    38. Web site: 2013 IEEE IROS Workshop on Cloud Robotics. Tokyo. November 2013. 2014-12-07. https://web.archive.org/web/20160905100035/http://roboearth.org/iros2013/. 2016-09-05. dead.
    39. Web site: RobotApp. 7 December 2014.
    40. Web site: DARPA-Cloud-Robotics. 7 December 2014.
    41. Web site: When Robotics Meets the Cloud, Customers Win. 18 April 2017.
    42. Web site: Robot Control From the Cloud. 17 April 2017.
    43. Dawarka, V. and Bekaroo, G., 2018, December. Cloud robotic architectures: directions for future research from a comparative analysis. In 2018 International Conference on Intelligent and Innovative Computing Applications (ICONIC) (pp. 1-7). IEEE.