Ballbot Explained

A ball balancing robot also known as a ballbot is a dynamically-stable mobile robot designed to balance on a single spherical wheel (i.e., a ball). Through its single contact point with the ground, a ballbot is omnidirectional and thus exceptionally agile, maneuverable and organic in motion compared to other ground vehicles. Its dynamic stability enables improved navigability in narrow, crowded and dynamic environments. The ballbot works on the same principle as that of an inverted pendulum.

History

The first successful ballbot was developed in 2005[1] [2] [3] by Prof. Ralph Hollis of the Robotics Institute at Carnegie Mellon University (CMU), Pittsburgh, USA and it was patented in 2010.[4] The CMU Ballbot[5] [6] [7] is built to be of human size, both in height and footprint. Prof. Hollis and his group at CMU demonstrated that the ballbot can be robust to disturbances including kicks and shoves, and can also handle collisions with furniture and walls.[8] [9] [10] They showed that a variety of interesting human-robot physical interaction behaviors can be developed with the ballbot,[11] [12] and presented planning and control algorithms to achieve fast, dynamic and graceful motions using the ballbot.[13] [14] [15] They also demonstrated the ballbot's capability to autonomously navigate human environments to achieve point-point and surveillance tasks.[16] [17] [18] A pair of two degrees of freedom (DOF) arms was added to the CMU Ballbot in 2011, making it the first and currently, the only ballbot in the world with arms.[19] [20] [21]

In 2005, around the same time when CMU Ballbot was introduced, a group of researchers at University of Tokyo independently presented the design for a human-ridable ballbot wheelchair that balances on a basketball named "B. B. Rider".[22] However, they reported only the design and never presented any experimental results. Around the same time, László Havasi from Hungary independently introduced another ballbot called ERROSphere.[23] The robot did not reliably balance and no further work was presented.

Since the introduction of CMU Ballbot in 2005, several other groups around the world have developed ballbots. Prof. Masaaki Kumagai developed BallIP in 2008[24] at Tohoku Gakuin University, Japan. Prof. Kumagai and his group demonstrated the capability of ballbots to carry loads and be used for cooperative transportation.[25] They developed a number of small ballbots and demonstrated cooperative transportation using them.[26] A group of mechanical engineering students at ETH Zurich, Switzerland developed Rezero in 2010.[27] Rezero re-emphasized the fast and graceful motions that can be achieved using ballbots.[28]

Tomás Arribas (Spain) developed the first ballbot using LEGO Mindstorms NXT in 2008 as the Master Project at University of Alcala.[29] [30] He developed a simulation project with Microsoft Excel to easily simulate the system.[31] As part of the research carried out inside the Space Research Group of the University of Alcalá (SRG-UAH), Spain, the work team, specialised in optimal control and planning applied to non-linear dynamic systems, published in 2012 the article called "A Monoball Robot Based on LEGO Mindstorms"[32] This article describes the math model and trajectory control as a baseline to unstable and non-linear control systems.

Yorihisa Yamamoto (Japan) inspired by Tomás Arribas's project, developed a ballbot using LEGO Mindstorms NXT in 2009.[33] [34] He created a detailed demo to build, model and create controllers using MATLAB.A group of mechanical engineering students at University of Adelaide (Australia) developed both a LEGO ballbot and a full-scale ballbot in 2009.[35] A group of students from ITMO University (Russia) introduced an algorithm and constructed a ballbot based on LegoNXT robotics kit which performed stability with only two actuators used.[36] Videos on YouTube present ballbots developed around the world. Some of them have been developed using LEGO Mindstorms NXT.[37] [38] [39] [40] [41] Other custom designs use omni-wheels to actuate the ball.[42] [43] [44] [45]

Thomas Kølbæk Jespersen (Denmark) developed the Kugle ballbot as his final master thesis in 2019.[46] The Kugle ballbot is a human-sized ballbot developed as part of an ongoing Human Robot Interaction research project at Aalborg University. Equipped with three motors and omniwheels, an onboard Intel NUC, two SICK LiDARs, an ARM microprocessor and a tablet on the top, the robot is capable of maneuvering autonomously in indoor environments and guide people around. The master thesis takes a different approach to the system modelling by deriving a non-linear quaternion-based dynamic model which is used to derive a non-linear sliding mode controller to stabilize the balance and a path-following model predictive controller to plan and execute smooth trajectories. The complete master thesis and all material including MATLAB source code and C++ controller implementations are publicly available on GitHub.[47]

Ballbots have also appeared in the science fiction world. Pixar's 2008 movie Wall-E featured "M-O" (Microbe Obliterator), a ballbot cleaning robot. Syfy's 2010 TV series Caprica featured "Serge", a ballbot butler robot.[48]

Motivation and characteristics

Historically, mobile robots have been designed to be statically stable, which results in the robot not needing to expend energy while standing still. This is typically achieved through the use of three or more wheels on a base. In order to avoid tipping, these statically-stable mobile robots have a wide base for a large polygon of support, and a lot of dead weight in the base to lower the center of gravity. They also tend to have low acceleration or deceleration to avoid tipping. The wide base makes it difficult for statically-stable mobile robots to navigate cluttered human environments. Moreover, these robots have several other limitations that make them poorly suited to a constantly changing human environment. They can neither roll in any direction, nor can they turn in place.

The desire to build tall and narrow mobile robots that do not tip over led to development of balancing mobile robots like the ballbot. A ballbot generally has a body that balances on top of a single spherical wheel (ball). It forms an underactuated system, i.e., there are more degrees of freedom (DOF) than there are independent control inputs. The ball is directly controlled using actuators, whereas the body has no direct control. The body is kept upright about its unstable equilibrium point by controlling the ball, much like the control of an inverted pendulum. This leads to limited but perpetual position displacements of the ballbot. The counter-intuitive aspect of the ballbot motion is that in order to move forward, the body has to lean forward and in order to lean forward, the ball must roll backwards. All these characteristics make planning to achieve desired motions for the ballbot a challenging task. In order to achieve a forward straight line motion, the ballbot has to lean forward to accelerate and lean backward to decelerate.[27] Further, the ballbot has to lean into curves in order to compensate for centripetal forces, which results in elegant and graceful motions.[27]

Unlike two-wheeled balancing mobile robots like Segway that balance in one direction but cannot move in the lateral direction, the ballbot is omni-directional and hence, can roll in any direction. It has no minimal turning radius and does not have to yaw in order to change direction.

System description

Major design parameters

The most fundamental design parameters of a ballbot are its height, mass, its center of gravity and the maximum torque its actuators can provide. The choice of those parameters determine the robot's moment of inertia, the maximum pitch angle and thus its dynamic and acceleration performance and agility. The maximum velocity is a function of actuator power and its characteristics. Besides the maximum torque, the pitch angle is additionally upper bounded by the maximum force which can be transmitted from the actuators to the ground. Therefore, friction coefficients of all parts involved in force transmission also play a major role in system design. Also, close attention has to be paid to the ratio of the moment of inertia of the robot body and its ball in order to prevent undesired ball spin, especially while yawing.

Ball and actuation

The ball is the core element of a ballbot, it has to transmit and bear all arising forces and withstand mechanical wear caused by rough contact surfaces. A high friction coefficient of its surface and a low inertia are essential. The CMU Ballbot, Rezero and Kugle used a hollow metal sphere with poly-urethane coating. B.B. Rider used a basketball, while BallIP and Adelaide Ballbot used bowling balls coated with a thin layer of rubber.

In order to solve the rather complex problem of actuating a sphere, a variety of different actuation mechanisms have been introduced. The CMU Ballbot used an inverse mouse-ball drive mechanism. Unlike the traditional mouse ball that drives the mouse rollers to provide computer input, the inverse mouse-ball drive uses rollers to drive the ball producing motion. The inverse mouse-ball drive uses four rollers to drive the ball and each roller is actuated by an independent electric motor. In order to achieve yaw motion, the CMU Ballbot uses a bearing, slip-ring assembly and a separate motor to spin the body on top of the ball. The LEGO Ballbot also used an inverse mouse-ball drive, but used normal wheels to drive the ball instead of rollers.

Unlike CMU Ballbot both BallIP, Rezero and Kugle use omni-wheels to drive the ball. This drive mechanism does not require a separate yaw drive mechanism and allows direct control of the yaw rotation of the ball. Unlike CMU Ballbot that uses four motors for driving the ball and one motor for yaw rotation, BallIP, Rezero and Kugle use only three motors for both the operations. Moreover, they only have three force transmission points compared to four points on CMU Ballbot. Since the contact between an omni-wheel and the ball should be reduced to a single point, most available omni-wheels are not properly suitable for this task because of the gaps between the individual smaller wheels that result in an unsteady rolling motion. Therefore, the BallIP project introduced a more complex omni-wheel with a continuous circumferential contact line. The Rezero team equipped this omni-wheel design with roller bearings and a high-friction coating. They also additionally fitted a mechanical ball arrester that presses the ball against the actuators in order to further increase friction forces and a suspension to dampen vibrations. The Kugle robot is equipped with a skirt which holds the ball in place to avoid that the ball gets pushed out during large inclinations. The Adelaide Ballbot uses wheels for its LEGO version and traditional omni-wheels for its full-scale version.

Prof. Masaaki Kumagai, who developed BallIP introduced another ball drive mechanism that uses partially sliding rollers.[49] [50] The objective of this design was to develop 3-DOF actuation on the ball using a low cost mechanism.

Sensors

In order to actively control the position and body orientation of a ballbot by a sensor-computer-actuator framework, beside a suitable microprocessor or some sort of other computing unit to run the necessary control loops, a ballbot fundamentally requires a series of sensors which allow to measure the orientation of the ball and the ballbot body as a function of time. To keep track of the motions of the ball, rotary encoders (CMU Ballbot, BallIP, Rezero, Kugle) are usually used. Measuring the body orientation is more complicated and is often done by the use of gyroscopes (NXT Ballbots) or, more generally, an Inertial Measurement Unit (CMU Ballbot, BallIP, Rezero, Kugle) which includes an accelerometer, gyroscope and possibly magnetometer whose measurements are fused into the body orientation through AHRS algorithms.

The CMU Ballbot uses a Hokuyo URG-04LX Laser Range Finder to localize itself in a 2D map of the environment. It also uses the laser range finder for detecting obstacles and avoiding them. Conversely the Kugle robot uses two SICK TiM571 2D LiDAR to localize itself, perform obstacle avoidance and detect people for guidance.

Arms

The CMU Ballbot is the first and currently, the only ballbot to have arms. It has a pair of 2-DOF arms that are driven by series-elastic actuators. The arms are hollow aluminium tubes with a provision to add dummy weights at their ends. In their present state, the arms cannot be used for any significant manipulation, but are used to study their effects on the dynamics of ballbot.

System modeling, planning and control

The mathematical MIMO-model which is needed in order to simulate a ballbot and to design a sufficient controller which stabilizes the system, is very similar to an inverted pendulum on a cart. The LEGO NXT Ballbot, Adelaide Ballbot, Rezero and Kugle include actuator models in their robot models, whereas CMU Ballbot neglects the actuator models and models the Ballbot as a body on top of a ball. Initially, CMU Ballbot used two 2D planar models in perpendicular planes to model the ballbot and at present, uses 3D models without yaw motion for both the ballbot without arms and the ballbot with arms. BallIP uses a model that describes the dependence of the ball position on the wheel velocities and the body motion.Rezero uses a full 3D model that includes yaw motion too. Kugle uses a fully coupled quaternion-based 3D model which couples the motion of all axes.

The ballbots (CMU Ballbot, BallIP, NXT Ballbot, Adelaide Ballbot, Rezero) use linear feedback control approaches to maintain balance and achieve motion. The CMU Ballbot uses an inner balancing control loop that maintains the body at desired body angles and an outer loop controller that achieves desired ball motions by commanding body angles to the balancing controller. The Kugle robot is tested with both linear feedback controllers (LQR) and non-linear sliding mode controllers to show the benefit of its coupled dynamic quaternion model.

A ballbot is a shape-accelerated underactuated system. The inclination angles of a ballbot is thus dynamically linked to the resulting accelerations of the ball and robot leading to an underactuated system. The CMU Ballbot plans motions in the space of body lean angles in order to achieve fast, dynamic and graceful ball motions. With the introduction of arms, CMU Ballbot uses its planning procedure to plan in the space of both body lean angles and arm angles to achieve desired ball motions. Moreover, it can also account for cases where the arms are constrained to certain specific motions and only body angles have to be used to achieve desired ball motions. The CMU Ballbot uses an integrated planning and control framework to autonomously navigate human environments. Its motion planner plans in the space of controllers to produce graceful navigation, and achieves point-point and surveillance tasks. It uses the laser range finder to actively detect and avoid both static and dynamic obstacles in its environment.

For Kugle a path-planning model predictive controller (MPC) is designed to control the inclination angles of the ballbot to follow a given path. A path-following strategy is chosen over common trajectory or reference tracking controllers to accommodate for the temporally lacking behaviour of ballbots due to the underactuated nature. The path is parameterized as a polynomial and included into the cost-function of the MPC. A set of soft-constraints ensures that obstacles are avoided and that progress is made with a desired speed.

Safety features

The biggest concern with a ballbot is its safety in case of a system failure. There have been several attempts in addressing this concern. The CMU Ballbot introduced three retractable landing legs that allow the robot to remain standing (statically-stable) after being powered down. It is also capable of automatically transitioning from this statically-stable state to the dynamically-stable, balancing state and vice versa. Rezero featured a roll-over safety mechanism in order to prevent serious damage in case of a system failure.

Possible applications

Due to its dynamic stability, a ballbot can be tall and narrow, and can also be physically interactive, making it an ideal candidate for a personal mobile robot. It can act as an effective service robot at homes and offices and offer guidance to people in e.g. malls and airports. The present day ballbots are restricted to smooth surfaces. The concept of the ballbot has attracted a lot of media attention,and several ballbot characters have appeared in Hollywood movies.[51] Hence, the ballbot has a variety of applications in the entertainment industry, including toys.

Notable Ballbot projects

Notes and References

  1. Web site: One is Enough! . Tom Lauwers . George Kantor. Ralph Hollis . October 2005 . 12th International Symposium on Robotics Research .
  2. Web site: A Dynamically Stable Single-Wheeled Mobile Robot with Inverse Mouse-Ball Drive . Tom Lauwers . George Kantor. Ralph Hollis . May 2006 . IEEE International Conference on Robotics and Automation . 2884–2889 .
  3. Web site: Ballbots . Ralph Hollis . October 2006 . Scientific American . 72–78 .
  4. Web site: Dynamic balancing mobile robot . Ralph Hollis . Dec 7, 2010 . US Patent #7847504 .
  5. Web site: CMU Ballbot on Discovery Channel's Daily Planet . . June 2007 . VIDEO.
  6. Web site: CMU Ballbot on ROBORAMA . https://ghostarchive.org/varchive/youtube/20211219/5le0tQBrGJU . 2021-12-19 . live. . August 2006 . VIDEO.
  7. Web site: CMU Ballbot on UK's Gadget Show . . January 2010 . VIDEO .
  8. Web site: State Transition, Balancing, Station Keeping and Yaw Control for a Dynamically Stable Single Spherical Wheel Mobile Robot . Umashankar Nagarajan . Anish Mampetta. George Kantor. Ralph Hollis . May 2009 . IEEE International Conference on Robotics and Automation . Kobe, Japan . 998–1003 .
  9. Web site: Trajectory Planning and Control of a Dynamically Stable Single Spherical Wheel Mobile Robot . Umashankar Nagarajan . George Kantor. Ralph Hollis . May 2009 . IEEE International Conference on Robotics and Automation . Kobe, Japan . 3743–3748 .
  10. Web site: CMU Ballbot: Overview . https://ghostarchive.org/varchive/youtube/20211219/39zeZwlVaN0 . 2021-12-19 . live. . December 2008 . VIDEO .
  11. Web site: Human-Robot Physical Interaction with Dynamically Stable Mobile Robots . Umashankar Nagarajan . George Kantor. Ralph Hollis . March 2009 . IEEE International Conference on Robotics and Automation . San Diego, USA . 3743–3748 .
  12. Web site: CMU Ballbot: Human-Robot Physical Interaction . https://ghostarchive.org/varchive/youtube/20211219/miZ_ebjoiFY . 2021-12-19 . live. . December 2008 . VIDEO .
  13. Web site: Dynamic Constraint-based Optimal Shape Trajectory Planner for Shape-Accelerated Underactuated Balancing Systems . Umashankar Nagarajan . June 2010 . Robotics: Science and Systems . Zaragoza, Spain .
  14. Web site: CMU Ballbot: Fast Motions . https://ghostarchive.org/varchive/youtube/20211219/Wd03f_6utA8 . 2021-12-19 . live. . June 2010 . VIDEO .
  15. Web site: CMU Ballbot: Fast, Graceful Maneuvers . https://ghostarchive.org/varchive/youtube/20211219/VWAF3jTZLgw . 2021-12-19 . live. . December 2010 . VIDEO .
  16. Web site: Hybrid Control for Navigation of Shape-Accelerated Underactuated Balancing Systems . Umashankar Nagarajan . George Kantor. Ralph Hollis . December 2010 . IEEE Conference on Decision and Control . Atlanta, USA . 3566–3571.
  17. Web site: Integrated Planning and Control for Graceful Navigation of Shape-Accelerated Underactuated Balancing Mobile Robots . Umashankar Nagarajan . George Kantor. Ralph Hollis . May 2012 . IEEE Conference on Decision and Control . St. Paul, USA.
  18. Web site: CMU Ballbot: Autonomous Graceful Navigation . https://ghostarchive.org/varchive/youtube/20211219/tzNKiGq5oaA . 2021-12-19 . live. . September 2011 .
  19. Web site: Planning in High-dimensional Shape Space for a Single-wheeled Balancing Mobile Robot with Arms . Umashankar Nagarajan . Byungjun Kim. Ralph Hollis . May 2012 . IEEE Conference on Decision and Control . St. Paul, USA.
  20. Web site: CMU Ballbot: Motion with Arms . https://ghostarchive.org/varchive/youtube/20211219/YX3DuIA9FLo . 2021-12-19 . live. . April 2011 . VIDEO .
  21. Web site: CMU Ballbot: Motions with Constraints on Arms . https://ghostarchive.org/varchive/youtube/20211219/BW78KmmB9IU . 2021-12-19 . live. . October 2011 . VIDEO .
  22. An Omnidirectional Vehicle on a Basketball . Tatsuro Endo . Yoshihiko Nakamura . 12th International Conference on Advanced Robotics . July 2005 . 573–578 . PDF.
  23. ERROSphere: an Equilibrator Robot . László Havasi . International Conference on Control and Automation . June 2005 . PDF . Budapest, Hungary . 971–976.
  24. Development of a Robot Balancing on a Ball . M Kumagai . T Ochiai . International Conference on Control . Automation and Systems . October 2008 . Seoul, Korea . 433–438.
  25. Development of a Robot Balanced on a Ball: Application of passive motion to transport . M Kumagai . T Ochiai . International Conference on Robotics and Automation . May 2009 . Kobe, Japan . 4106–4111.
  26. Web site: BallIP on IEEE Spectrum . April 2010 .
  27. Web site: Rezero, Focus Project Report . Simon Doessegger . Peter Fankhauser . Corsin Gwerder . Jonathan Huessy . Jerome Kaeser . Thomas Kammermann . Lukas Limacher . Michael Neunert . Autonomous Systems Lab, ETH Zurich Institute of Technology. June 2010 . PDF. dead. https://web.archive.org/web/20130730144120/http://www.rezero.ethz.ch/content/press/20101022-Maxon-Motor-AG-EN.pdf. 30 July 2013.
  28. Web site: Rezero on TED Talks . July 2011 . VIDEO .
  29. Tomás Arribas (August 2008). https://www.youtube.com/watch?v=FZ5K0tZ2ZOk
  30. Web site: NXT BallBot: Balancing Robot Omnidirectional Trajectory correction. https://ghostarchive.org/varchive/youtube/20211219/5Eau8y-yhPc . 2021-12-19 . live. Tomás Arribas. 30 December 2010. YouTube.
  31. Web site: NXTBallbot balancing robot Simulation with Microsoft Excel: NXT Ballbot Simulation with Microsoft Excel. Tomás. Arribas. 5 January 2011 .
  32. (S. Sánchez, T. Arribas, M. Gómez and O. Polo, “A Monoball Robot Based on LEGO Mindstorms,” IEEE Control Systems Magazine, vol. 32, no. 2, pp. 71–83, 2012.)
  33. Web site: NXT Ballbot Model-Based Design.pdf . Yorihisa Yamamoto . April 2009 . PDF . 47.
  34. Web site: LEGO NXT Ballbot . https://ghostarchive.org/varchive/youtube/20211219/f8jxGsg3p0Y . 2021-12-19 . live. . January 2009 . VIDEO .
  35. Web site: Ballbot at University of Adelaide . https://ghostarchive.org/varchive/youtube/20211219/H2e7f30ljH8 . 2021-12-19 . live. . October 2009 . VIDEO.
  36. Ballbot stabilization algorithm. Journal Scientific and Technical of Information Technologies, Mechanics and Optics . 28 September 2011 . 75 . 5 . 58 . S . Borgul Alexander . S . Gromov Vladislav . A . Zimenko Konstantin . Maklashevich . Sergey .
  37. Web site: Ballbot - A dynamically stable inverted pendulum balancing on a bowling ball. https://ghostarchive.org/varchive/youtube/20211219/gKMl8G44U4E . 2021-12-19 . live. Samuel Jackson. 13 August 2011. YouTube.
  38. Web site: 2-Dimension Inverted Pendulum. https://ghostarchive.org/varchive/youtube/20211219/F7k9p1sOfEE . 2021-12-19 . live. double051. 14 March 2011. YouTube.
  39. Web site: YouTube. .
  40. Web site: YouTube. .
  41. Web site: YouTube. .
  42. Web site: Ballbot - prima versione. https://ghostarchive.org/varchive/youtube/20211219/a94z9p3vU-c . 2021-12-19 . live. antonio88m. 11 February 2011. YouTube.
  43. Web site: AST Ballbot - G1. https://ghostarchive.org/varchive/youtube/20211219/7Ib3l9KYbBM . 2021-12-19 . live. StAstRobotics. 1 March 2011. YouTube.
  44. Web site: 玉乗りロボット1号. https://ghostarchive.org/varchive/youtube/20211219/uSKhixP-d-Y . 2021-12-19 . live. aoki2001. 14 November 2010. YouTube.
  45. Web site: Self-balancing Arduino Ballbot - SPSU senior design project. https://ghostarchive.org/varchive/youtube/20211219/J0PnIyyydPE . 2021-12-19 . live. Jeroen Waning. 2 December 2011. YouTube.
  46. Book: Jespersen, Thomas Kølbæk. Kugle - Modelling and Control of a Ball-balancing. Master Thesis, AAU. April 2019.
  47. Web site: Kugle ballbot repository. Jespersen. Thomas Kølbæk. GitHub.
  48. Web site: Serge - Battlestar Wiki. 2010-05-04. https://web.archive.org/web/20100402112945/http://en.battlestarwiki.org/wiki/Serge. 2010-04-02. dead.
  49. Book: Masaaki Kumagai . 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems . Development of a ball drive unit using partially sliding rollers - an alternative mechanism for semi-omnidirectional motion &#x2014 . October 2010 . Taipei,Taiwan. 3353–3357 . https://www.researchgate.net/publication/221063469 . subscription. 10.1109/IROS.2010.5651007. 978-1-4244-6674-0 . 15901355 .
  50. Web site: Ball Actuation using Partial Sliding Rollers . https://ghostarchive.org/varchive/youtube/20211219/HbKvtivAx8A . 2021-12-19 . live. . October 2010 .
  51. [WALL-E]
  52. https://healtheng.illinois.edu/news/hands-free-wheelchair-prototype-achieves-major-milestone Hands-free wheelchair prototype achieves major milestone
  53. https://spectrum.ieee.org/bossa-nova-introduces-mobi-research-ballbot Bossa Nova Robotics Launches Mobi Research Ballbot
  54. https://www.festo.com/us/en/e/about-festo/research-and-development/bionic-learning-network/highlights-from-2015-to-2017/bionicmobileassistant-id_326923/ BionicMobileAssistant: Mobile Robot System with Pneumatic Gripper Hand