0INTECH
open science | open minds
OPEN Vy ACCESS ARTICLE
International Journal of Advanced Robotic Systems
Biologically Inspired Self-Stabilizing Control for Bipedal Robots
Regular Paper
Woosung Yang1, Hyungjoo Kim1,* and Bum Jae You2
1 Central Advanced Research and Engineering Institute, Hyundai Motor Company, South Korea,
2 Center of Human-centered Interaction for Coexistence, Korea Institute of Science and Technology, South Korea * Corresponding author E-mail: kimhjoo@gmail.com
Received 30 May 2012; Accepted 10 Dec 2012 DOI: 10.5772/55463
© 2013 Yang et al.; licensee InTech. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract Despite recent major advances in computational power and control algorithms, the stable and robust control of a bipedal robot is still a challenging issue due to the complexity and high nonlinearity of robot dynamics. To address the issue an efficient and powerful alternative based on a biologically inspired control framework employing neural oscillators is proposed and tested. In a numerical test the virtual force controller combined with the neural oscillator of a humanoid robot generated rhythmic control signals and stable bipedal locomotion when coupled with proper impedance components. The entrainment nature inherent to neural oscillators also achieved stable and robust walking even in the presence of unexpected disturbances, in that the centre of mass (COM) was successfully kept in phase with the zero moment point (ZMP) input trajectory. The efficiency of the proposed control scheme is discussed alongside simulation results.
Keywords Biologically Inspired Control, Neural Oscillator, Bipedal Robot, Locomotion
1. Introduction
Keeping the stability and robustness of bipedal locomotion has recently gained a lot of attention in the
humanoid robot community since considerable efforts are required to deal with both the high nonlinearity of multibody robot dynamics and the unexpected disturbances from new environments. Modern robot control based on motion planning based approaches, i.e., the zero moment point criterion [1, 2], the three-dimensional linear inverted pendulum model [3] and virtual model-based control [4], have tried to achieve stability and robustness. For motion planning a fairly accurate robot model with a large number of degrees of freedom is required to generate dynamically admissible motion patterns. However, an efficient pattern generation of such a large dynamic system is still quite challenging withstanding recent advances in computational power. Thus, from a practical viewpoint, a biologically inspired control approach that does not need a reference motion may be a good alternative to enhancing pattern generation competence.
Human and animal locomotion inherently exhibit stable rhythmic movements, adapted to the natural frequency of their body dynamics, in spite of variety in their sensors and actuators. The neural circuits of oscillators on the spinal cord [5] known as Central Pattern Generators (CPGs) contribute to such efficient motor movement and
novel stability properties in biological models. Moreover, neural oscillators can entrain to sensory feedback, which plays a key role in adapting locomotion to unexpected forces from new environment. Hence, biologically inspired motion control based on the neural oscillator has drawn much attention as an attempt to realize natural motion in bipedal humanoid robots.
The neural oscillator for robotic applications was first formalized in mathematical form by Matsuoka [6,7]. In the paper the neurons were proven to generate rhythmic output and the necessary and sufficient conditions for self-oscillations were provided. Through Matsuoka's model, Taga et al. showed that the neural oscillators of a bipedal robot could entrain to the characteristics of various environments, so as to generate stable bipedal locomotion by the feedback of sensory signals from robot joints to the neural oscillators [8, 9]. In a 2D simulation robot control became robust against perturbation and the robot was able to climb an upward slope [10]. These methodologies were later applied to a 3D simulation (Miyakoshi et al. [11]), to dynamic quadrupedal walking (Fukuoka et al. [12]) and to rhythmic robotic arm movement (Williamson [13]).
The entrainment property of the neural oscillator was later tested on real systems [15-17] such as the robot walking on uneven terrains. Even though it enabled adaptive bipedal locomotion in a 3D environment, the neural oscillator achieved global stability mostly through its phase locking properties, which sometimes cause large deviations in motion from the reference one [18]. In addition, since previous research mostly focused on cyclic gait motion, such as bipedal walking, direct application of the neural oscillator based control schemes are not easy in robot practices, which need to control various robot behaviours that are non-cyclic. Therefore, it would be desirable for a user to be able to handle overall robot motion, i.e., ZMP trajectory, to fulfil a mission objective, while allowing autonomous adaptation of robots for stability purposes. On the other hand, a new intuitive stability control scheme based on virtual model control for legged locomotion was proposed by Pratt [14]. Even though this algorithm is extended for rough terrain walking, the approach is still limited to 2D.
For practical purposes new methods in this study are designed to maintain the stability autonomously without sophisticated stability controllers with a predetermined ZMP trajectory input so that humanoid robots could show arbitrary whole body motions as well as various bipedal motions with minimal interruption by a user. The new methods that couple the neural oscillator and the virtual components apply the interaction between neural oscillators and virtual mechanical components to humanoid locomotion control and produce periodic
swing motions, which allow the adaptivity of humanoid robots to unknown disturbances through entrainment of their frequency and phase.
In addition, the methodologies on how to generate human-like motions while properly maintaining stability of humanoid robots will be discussed. In the proposed self-stabilizing controller, the motion of the inverted pendulum is often regarded as a supporting leg in the stance phase of humanoid locomotion [19]. We therefore develop a new control method for sustaining and enlarging the stability of an inverted pendulum in the pitching and rolling direction. The proposed controller contributes to whole body motion generation and adaptive bipedal locomotion of humanoid robots even under unknown disturbances and uneven terrains. Based on this self-stabilizing controller, we focus on the implementation of the new bipedal walking strategy. This is verified through simulations and experiments designed to test whether the proposed approach yields a robust and efficient control of rhythmic locomotion
This paper is organized as follows: Section 2 briefly introduces the mathematical form and inherent properties of Matsuoka's neural oscillator. In Sections 3 to 5, we address basic concepts for controlling bipedal robots and how to implement these in humanoid robots with basic tests on dynamic stability through simulations. More details of the bipedal stability on the proposed control model under unknown disturbances are discussed in Section 5. Section 6 presents the proposed bipedal walking strategy with simulations and experiments. Conclusions are drawn in Section 7.
2. Rhythmic Movement Generation
A. Matsuoka's Neural Oscillator
Our work is motivated by studies on and aspects of biologically inspired locomotion control employing oscillators. Especially, the fact that the basic motor pattern generated by the Central Pattern Generator (CPG) of the inner body of a human or animal is usually modified by sensory signals from motor information to deal with environmental disturbances. Similarly to the sensory system of a human or animal, the neural oscillators are entrained with external stimuli at a sustained frequency. They show stability against perturbations through global entrainment between the neuro-musculo-skeletal systems and the ground [8]. Thus, neural oscillators have been applied to the CPG of humanoid robots with rhythmic motions [9, 10]. The oscillators provide robust performance in a wide variety of rhythmic tasks when they are implemented to a system such as a robotic arm. The reason is that the oscillators use sensory signals about the joint state to adapt the frequency and phase of the joint motion regardless of the references corresponding to changes in the environment.
Figure 1. Schematic diagram of the NEURAL OSCILLATOR
Matsuoka's neural oscillator consists of two simulated neurons arranged in mutual inhibition, as shown in Fig. 1 [5, 6]. If gains are properly tuned, the system exhibits limit cycle behaviours. The trajectory of a stable limit cycle can be derived analytically, describing the firing rate of a neuron with self-inhibition. The neural oscillator is represented by a set of nonlinear coupled differential equations given as
TrX ei + xe
■ WfiYfi - Z wijyj " bvei - Zkife]+ + si
T v ■ + v ■ = y
a ei ei J e
yei = [xei]+ = max(xei' 0)
TrXfi + Xfi =- Weiyei -Z Wi,y,- bvfi -Z ki[gi]-+ Si (1)
Tav fi + Vfi = yfi
yfi = [xfi]+ = max(xfi, 0),
(i = 1, 2, •••, n)
where xe(f)i is the inner state of the i-th neuron, which represents the firing rate, ve(f)i is a variable that represents the degree of the adaptation, modulated by the adaptation constant b , or self-inhibition effect of the i-th neuron. The output of each neuron ye(f)i is taken as the positive part of xi and the output of the whole oscillator as Y(out)i. wijyi represents the total input from the neurons inside a neural network; the input is arranged to excite one neuron and inhibit the other, by applying the positive part to one neuron and the negative part to the other. The inputs are scaled by gains ki. Tr and Ta are time constants of the inner state and the adaptation effect of the i-th neuron respectively, b is a coefficient of the adaptation effect, wij is a connecting weight from the j-th neuron to the i-th neuron and si is an external input with a constant rate. wij (0 for i+j and 1 for i=j) is the weight of the inhibitory synaptic connection from the j-th neuron to the
i-th and wei, wfi are also weights from the extensor neuron to the flexor neuron, respectively.
B. Coupling Neural Oscillator to Mechanical Systems
This subsection addresses a new control method that exploits the natural dynamics of the oscillator coupled with the dynamic system that closely interacts with the environment. This method enables the robot to adapt to changing conditions. For simplicity, we employed a general 2nd order mechanical system connected to the neural oscillator, as seen in the lower system in Fig. 3. The desired torque input at the i-th joint can be given by [13]
^i = ki(0* -3) - bi*i,
where ki is the stiffness of the joint, bi the damping coefficient, di the joint angle and dvi the desired joint position, which is the output of the neural oscillator. The output of the neural oscillator drives the mechanical system corresponding to the sensory signal input (feedback) from the actuator (displacement or torque). The oscillator entrains the input signal so that the mechanical system can exhibit adaptive behaviour even under unknown environmental conditions.
Figure 3. Mechanical system model coupled to the neural oscillator
Generally, it is known that Matsuoka's neural oscillator exhibits the following properties: the natural frequency of the output signal increases in proportion to 1/7V. The magnitude of the output signal also increases as the tonic input increases. Tr and Ta have an effect on the control of the delay time and the adaptation time of the entrained signal, respectively. Thus, as these parameters decrease, the input signal is well entrained. The minimum gain ki of the input signal enlarges the entrainment capability, because the minimum input signal needs to be entrained appropriately in the range of the natural frequency of an input signal. In this case, regardless of the generated natural frequency of the neural oscillator and the natural frequency of an input signal, the output signal of the neural oscillator locks onto an input signal well in a wide range.
If we appropriately tune the parameters of the neural oscillator, the oscillator exhibits stable limit cycle behaviours. In Fig. 1, the gain k of the sensory feedback was set at 0.53. If the gain k is properly set at 0.53, the neural oscillator produces the fully entrained signal, as illustrated in Fig.4. In Fig. 4, the dashed line shows the output of the sensory signal and the solid line is the output entrained in terms of the neural oscillator. With this, it can be observed that the neural oscillator is able to entrain the input signal well, even though a non-periodic sensory signal is the input into the neural oscillator.
6 8 Time[s]
Figure 4. Simulation result on entrainment property of the neural oscillator.
3. The Control Model for Bipedal Stability
In humanoid locomotion, the pitching motion should be performed under the stable single support phase of the rolling motion. Now we explain how to attain the stable single support phase corresponding to the periodic bipedal locomotion. For the stable rolling motion in the frontal plane, we consider an inverted pendulum model coupled with such a virtual mechanical component as a spring and damper and the neural oscillator, as seen in Fig. 5 (a) for generating an appropriate rolling motion. The coupled model enables the inverted pendulum to stably move in a frontal plane according to a desired ZMP (Zero Moment Point) trajectory sustaining the stability.
Assuming that 0, the angle between the vertical axis and the pendulum in Fig. 5 (a), is small enough and linearized near 0, the dynamic equation of the coupled inverted pendulum is given by
y = y(y " u) + Fy
where y is the displacement of the pendulum in the rolling direction, I is the length of the pendulum and u is the position of the massless cart of the pendulum. G is the gravitational constant and Fy indicates the force that should be applied to the COM of the pendulum in the rolling direction.
If the desired ZMP trajectory, u, is given in Eq. (3), a stable periodic motion of the COM of the pendulum is generated in terms of the coupled neural oscillator with state feedback [17]. If a mechanical system is coupled to the neural oscillator, the dynamic stability is improved [18], [19]. Hence, stable limit cycle behaviour is induced and the periodic COM motion is achieved by the impedance controller of the virtual components, as illustrated in the block diagram in Fig. 6. Accordingly, Fy in Eq. (3) is given by
Fy = mi|(2ks(h^v - kpy) - kvy) + (ip(yd - y) - (4)
where ks is the stiffness coefficient and h is the output gain of the neural oscillator. kp and kv are the gains of state feedback and ip and iv are the gains of the impedance controller. In the proposed controller, 0v and yd denote the output of the neural oscillator and a desired ZMP input, respectively. The current COM position and velocity of the humanoid robot are obtained again by Eq. (3). These gains illustrated in Table I are properly tuned with the analysis in Section 2 and the trial and error method. Remarkably, the stability of the coupled system is dependant of the stiffness gain with state feedback. Thus, the state feedback gains need tuning when ks is within the range of 40 to 60. Then the virtual impedance gains are optimized for controlling the stable COM motion according to the arbitrary ZMP input._For a stable rolling motion corresponding to the ZMP input, Fy in Eq. (4) is transformed into joint torque using the Jacobian, which needs to be applied to each joint in both legs to achieve the rolling motion in Fig. 5 (b).
Figure 5. (a) The proposed control model for stable inverted pendulum motion (b) Simulation result with respect to rolling motion of humanoid robot (c) The rolling COM motion of humanoid robot
As illustrated in Fig. 5 (b) and (c), the humanoid robot exhibits a stable rolling motion, therefore satisfying the desired ZMP. Assuming variation in environmental conditions, the robustness of the proposed control method is verified with the simulation result in Fig. (6). In the simulation results in (a) and (b) in Fig. 6, when the coupled model is implemented to the pendulum model (see the Fig. 6 (b)), the COM motion is sustained stably even with an allowable change of a ZMP input.
Neural Oscillator
Inhibitory weight (w) 2
Adaptation constant (b) 2.5
Tonic input (s) 1.0
Sensory gain (k) 1.3
Time constant (Tr) 0.2
(Ta) 0.24
Control Model
Mass (COM) 63kg
Length 0.87m
Control Gains
ks, kp, kv 50, 3.8, 5.2
ip, iv 28, 0.1
Table 1. Parameters of the neural oscillator and control model
Time [s]
Figure 6. Simulation result with respect to the COM motion of humanoid robot in terms of an arbitrary ZMP input without (a) and with the coupled model (b)
4. Implementation and Basic Tests of The Coupled Model A. Implementation
This subsection describes how to embody the bipedal locomotion of the humanoid robot using the proposed control scheme to guarantee stability on the single and
double support phases. The humanoid robot in Fig. 7, developed by KIST, is used to test and evaluate the proposed controller. It has 35 degrees of freedom (DOF): 6 in each arm, 6 in each leg, 4 in each hand, 2 in its neck and 1 in its waist. It's 150cm high and weighs about 67kg. The robot is equipped with a stereo camera, a microphone, four force/torque sensors and a pose sensor.
Figure 7. KIST Humanoid robot
We propose a control method that uses several virtual mechanical components such as springs and dampers and couples them with neural oscillators, as seen in Fig. 8.
Figure 8. The coupled model with virtual springs and dampers
A virtual spring-damper is defined from the hip to the ankle for each leg and could generate the virtual vertical forces Fz,r and Fz,i at each hip joint of the right leg and left leg, respectively. It is used to control the vertical stable position of the hip corresponding to the reaction force of the foot. Fz is the summation of the virtual vertical forces (Fz,r and Fz,l). These forces bring about significant positive effects on the landing stability of swing legs. Also the virtual springs-dampers are attached to the hip along the
two horizontal directions to generate the virtual horizontal forces Fx and Fy at the hip. Here Fx and Fy include the virtual forces exerted by virtual mechanical components and a neural oscillator. Using those forces, the humanoid robot should perform the desired motion and maintain stability simultaneously under unknown environments or disturbances.
Considering the right and left legs as separate systems, the dynamic equations of each leg can be written in the following form
M(0)0 + V(0,0) + G(0) = t
where M is the 3*3 inertia matrix, V is the 3*3 Coriolis/centripetal vector and G 3*1 is the gravity vector. Also a rotational spring-damper is attached at the pelvis to generate a virtual rotational force Fe about the y-axis in Fig. 8. This is used to maintain the upright posture of the pelvis. The virtual forces and moment can be transformed into equivalent torques as follows.
( t \ ( T T L" J12 J22
T13 T23 T14 T 24
-1 -1 -1
Fx = kx(xd - x) + Cx(xd - X) + fo,x Fz,r = fr,r + kz(zd - z) + cz(zd - z) Fz,l = fr,l + kz(zd - z) + cz(zd - z)
Fg = kg(9d -0) + ce(0d -0)
where J is the Jacobian matrix, which relates the virtual velocity with regard to the Cartesian coordinate between frames of the ankle joint and the COM position to the joint velocities. ki and a are the spring stiffness and damping coefficient, respectively, for the virtual components in i (=x, y, z or e) coordinate. fr,r and fr,i indicate the reaction forces of the right and left leg, as seen in Fig. 8. Therefore, the right leg is controlled in terms of Fz,r and Fz,i is employed to drive the left leg. Note that fo,x is the driving force induced by the individual neural oscillators of the sagittal plane. In the frontal plane, since one-link dynamics are considered similar to the inverted pendulum, Fy can be described by Eq. (4), including fo,y. x, y, z and e denote the current position of the pelvis and xd, yd, zd and ed are the desired position, respectively. Finally, substituting the equations for the virtual forces for Eq. (6), the pelvis, Tw, knee, tk and ankle joint torques, ta, can be obtained in order to drive each leg joint of the humanoid robot.
B. Basic Control Tests of the Coupled Model
To test the performance of the proposed control methods, a dynamic humanoid motion was simulated using a
dynamic robot engine, SIMSTUDIO (SimLab, KOREA). Prior to a complete cycle of bipedal locomotion, tests on basic bipedal motions were simulated. From the simulation results the adaptive properties of the neural oscillator were investigated.
The rolling and pitching of humanoid are two basic bipedal motions when ZMP trajectory is given as a function over time. The key dynamic parameters and snapshots of a whole robot body are presented in Figs. 912.
ZMP input
Time[s]
Figure 9. Input ZMP profile (dashed line), the output of the COM position (solid line) and the output of the neural oscillator in the rolling motion (dotted line)
Figure 10. Snap shots on the stable rolling motion of a humanoid robot
Figure 11. Input ZMP profile (dashed line), the output of the COM position (solid line) and the output of the neural oscillator in the pitching motion (dash-dotted line)
The dashed lines in Figs. 9 and 11 indicate the input ZMP trajectory over time. It is shown that the COM trajectory presented in dashed lines properly oscillates in response to the arbitrarily defined ZMP input, so the humanoid can maintain stability. This implies that the proposed control method in Section 3 works properly. For example, let's investigate the outputs of the neural oscillators presented in dotted lines in Figs. 9 and 11. The COM motion of the humanoid robot is considered as the sensory signal of the neural oscillator. Then the outputs of neural oscillator entrain to that of the humanoid robot and drive the humanoid robot corresponding to the sensory input appropriately as a torque input. Consequently, we note that this leads the adaptive motion of humanoid robots to maintain bipedal stability even under an unknown disturbance. In addition, the ZMP planning in the proposed control method is possible in terms of properly adjusting the gains of the impedance model and the neural oscillator described in Eq. (4). In Figs. 9 and 11, the simulations were performed with the consideration that the real ZMP is larger than the movement of the COM within the range of the ZMP criterion.
Figure 12. Snap shots on the stable pitching motion of a humanoid robot
5. Adaptive Motion under unknown Disturbance
In this section, the inherent adaptive feature of neural oscillators is tested through the proposed balance controller. The proposed controller is based on a neural oscillator coupled with the virtual components under two states of the humanoid robot under unknown disturbances. Fig. 13 illustrates how to apply an external acceleration as a disturbance to the MAHRU robot. The size and direction of the red s indicates the magnitude and direction of the external acceleration as unknown disturbances,. The unknown external acceleration is induced in the COM position of the MAHRU robot periodically as time passes.
From the results shown in Figs. 14 and 15, it can be observed that the humanoid robot not coupled to the neural oscillator and virtual components tips over if there is an unknown disturbance. In the graphs in Figs. 15 and
17, the red thin, the blue dashed and the grey thick lines indicate the calculated ZMP, the input of an external acceleration as an unknown disturbance and the COM position, respectively. Also, note that the black dotted line is the output of the neural oscillator and the red dash-dotted line is the desired ZMP input. The COM and the ZMP plots of Fig. 15 represent that the humanoid robot became unstable. Here the positive and negative signs of the moving distance imply the left and right direction of the humanoid robot. In addition, it can be verified from Figs. 16 and 17 that the COM follows the external disturbance well regardless of the motion of the humanoid robot. This is caused by the neural oscillator coupled with the COM of the humanoid robot, since the neural oscillator entrains the sensory signal fed from the COM motion of the humanoid robot.
Figure 13. Schematic figure on an unknown harmonic disturbance applied to the humanoid robot
Figure 14. Snap shots on the motion of the MAHRU robot under an unknown sinusoidal disturbance of 1.9G without the neural oscillator; G is set with 9.8 m/s2
Unknown disturbance input
Measured ZMP
Figure 15. The outputs of the COM position and the ZMP of the humanoid robot; The input of the external acceleration
EE U fU- ss
SI BK u
Figure 16. Snap shots on the motion of the MAHRU robot under an unknown sinusoidal disturbance of 1.9G with the neural oscillator based controller. G is set with 9.8 m/s2
Figure 17. The outputs of the COM position and the ZMP of the humanoid robot; The input of the external acceleration; The output of the neural oscillator
The proposed control method was implemented on the real humanoid robot to verify the validity of the proposed motion adaptor with the self-stabilizing bipedal controller. The kinematic and dynamic properties of a robot such as the width of the feet, the area of each foot and the length and mass of each leg are different from those of a human. So, considering the calculated COM, we adjust the ZMP measured from the human motion so that the bipedal stability of the humanoid robot is maintained within the stable ZMP range. This is done by multiplication by a suitable scale factor. The modified ZMP is input into the self-stabilizing bipedal controller. Then the stable COM corresponding to the ZMP input is autonomously generated in terms of the self-stabilizing balance controller, as illustrated in Fig. 5 (c). Under the dancing motion of the humanoid robot, to employ the motion data obtained from the motion conversion method, unknown disturbances composed of two dumbbells weighing 10kg are applied directly to the humanoid robot on the frontal and sagittal sides, as seen in Fig. 18. It is observed from the experiment that the humanoid robot is able to maintain bipedal stability. Hence, even though the external disturbances of a sinusoidal form effect to the humanoid robot, the humanoid robot coupled to the neural oscillator and virtual components can stably exhibit a novel adaptive motion corresponding to an unknown disturbance.
Figure 18. Snap shots on the whole body motion and balancing test of humanoid robot under unknown disturbances, Dotted circles indicate the dumbbells that produce unknown disturbances
6. Bipedal Locomotion Strategy
The authors finally propose the appropriate bipedal walking strategy of humanoid robots for our control model. Our objective is to embody the simple and integrated algorithm for generating various bipedal motions of humanoid robots. We also aim to have robust and adaptive properties under an unknown disturbance even in an unpredictable terrain. The proposed algorithm is illustrated in Fig. 19. Comparing the bipedal walking strategy with the whole body motion generation, the only difference between them is that the input is not a reference ZMP but a rhythmic pattern generated by the neural oscillator. However, a desired ZMP pattern can be input into the self-stabilizing controller for bipedal walking as illustrated in Section 3. In experiments with respect to the bipedal walking of the humanoid robot, a simple sinusoidal ZMP pattern was used.
The output of the COM motion generated in the rolling direction dominates the entire bipedal walking motion, such as walking period, velocity, stride distance etc. The output of the rolling COM motion causes the COM motion in the pitching direction because the neural oscillator that produces the pitching motion is internally connected to the rolling oscillator. In this way, the rolling motion and pitching motion of the COM are harmonized periodically. Also the output of the COM motion in the lateral plane determines the trajectory of the swing motion. The sequence in the locomotion phases is shown in Fig. 23. If the COM is inhibited by an unknown disturbance, such as pushing or pulling forces, the neural oscillator generates the adapting motion properly by means of sensory feedback. In addition, if the swinging foot doesn't contact the ground thoroughly, the swing motion and the single support phase of individual legs are sustained. On the contrary, during the initial phase, if the swinging leg absorbs much of the impact energy in its landing on the ground, the module, in order to distinguish between distinct walking phases, selects a certain phase according to the ZMP and COM position. The initial phase begins when the swing leg hits the ground and lands on it and ends when the walking phase is changed into the double support phase. By this walking strategy, the swing and stance motions can be autonomously changed according to the altered COM motion. Ultimately the COM of a humanoid robot will be appropriately controlled, sustaining the bipedal stability according to an arbitrary ZMP input. Figs. 20 and 21 show the stable walking of MAHRU robot on flat terrain, controlled in terms of the proposed walking algorithm.
In order to verify the validity of the proposed walking algorithm under unknown environmental changes, the height of the ground was altered aperiodically, irrespective of walking phases during bipedal walking. As shown in Fig. 22, when a swinging leg lands on the ground, the environmental change with regard to the height of the ground is applied. At first, while the left leg supports the whole weight of the robot, the height of the left leg changes in landing on the ground in about 7s. Therefore, the condition is applied to each walking phase from 7s to 11s in sequence. In Fig. 22, the red arrows indicate the direction that the 1.5cm high plate is inserted between the foot of the robot and the ground. Even though an unknown environmental condition exists by changing the height of the ground during bipedal walking, it was verified from the experimental results of Fig. 21 that the proposed self-stabilizing controller and walking algorithm enabled a humanoid robot to exhibit efficient adaptable motions sustaining bipedal stability. However, most of the existing problems associated with unknown terrain as well as additional uncertainty in dynamic characteristics remain largely undetermined so far. This work will be extended to solve such a difficult problem in the future.
Figure 19. The proposed bipedal locomotion strategy
i it / fiw^. i tt^Z.
--v^. - iasTO - v»
Figure 20. Simulation Result on MAHRU flat terrain walking
Time[s]
Figure 21. ZMP profile on flat terrain walking; the red thin line and the black dotted line indicate the reference ZMP input and the ZMP output, respectively.
Figure 22. Snap shots on bipedal walking of the humanoid robot under unknown changes of the ground 1.5cm in height.
7. Conclusion 8. References
To attain a stable periodic locomotion in biped humanoid robots, we proposed a new control architecture consisting of neural oscillators and virtual components. This causes the COM position of the biped robot to be controlled to follow the time varying desired ZMP input, thereby sustaining the bipedal stability. As a consequence, a humanoid robot can maintain bipedal stability regardless of single or double phases. For this, we simply let the virtual components and the neural oscillator generate the Cartesian forces. We can determine the required joint torques incorporating the Jacobian of the three link inverted pendulum. It is also noted that the appropriate swing and stance motions were generated according to the rolling and pitching motion because the neural oscillators between the dynamic models of the rolling and pitching direction are connected internally in phase. Since the stable rolling motion of the COM was induced by the ZMP reference input, which properly generated the pitching motion of the COM in accordance with the rolling motion, stable walking could be achieved with this novel walking strategy. Extensive simulations and experiments were carried out to verify the effectiveness of the proposed method. More experiments are currently under way for further evaluation of the proposed control method.
[1] M. Vukobratovic and D. Juricic, "Contribution to the
Synthesis of Biped Gait," IEEE Transaction on Biomedical Engineering, Vol. BME-16, no.1, pp. 1-6, 1969.
[2] M. Vukobratovic, "How to Control Artificial
Anthropomorphic Systems," IEEE Transaction on Systems, Man, and Cybernetics, Vol. SMC-3, no.5, pp. 497-507, 1973.
[3] S. Kajita, O. Matsumoto, and M. Saigo, "Real-time 3D
Walking Pattern Generation for a Biped Robot with Telescopic Legs," Proc. IEEE Int. Conf. on Robotics and Automation, pp. 2299-2306, 2001.
[4] J. Pratt, P. Dilworth and G. Pratt, "Virtual Model
Control of a Bipedal Walking Robot," Proc. IEEE Int. Conf. on Robotics and Automation, pp. 193-198, 1997.
[5] Golubltsky, I. Stewart, P.-L. Buono and J. J. Collins,
"Symmetry in locomotor central pattern generators and animal gaits," Nature, Vol. 401, pp. 693-695, 1999.
[6] K. Matsuoka, "Sustained Oscillations Generated by
Mutually Inhibiting Neurons with Adaptation," Biological Cybernetics, Vol. 52, pp. 367-376, 1985.
[7] K. Matsuoka, "Mechanisms of Frequency and Pattern
Control in the Neural Rhythm Generators," Biological Cybernetics, Vol. 56, pp. 345-353, 1987.
[8] G. Taga, Y. Yamagushi, and H. Shimizu, "Self-
organized Control of Bipedal Locomotion by Neural Oscillators in Unpredictable Environment," Biological Cybernetics, Vol. 65, pp. 147-159, 1991.
[9] G. Taga, "A Model of the Neuro-Musculo-Skeletal
System for Human Locomotion. I. Emergence of basic gait," Biological Cybernetics, Vol. 73, pp. 97-111, 1995.
[10] G. Taga, "A model of the neuron-musculo-skeletal system for human locomotion. II. Real-time adaptability under various constraints," Biological Cybernetics, Vol. 73, pp. 113-121, 1995.
[11] S. Miyakoshi, G. Taga, Y. Kuniyoshi, and A. Nagakubo, "Three Dimensional Bipedal Stepping Motion Using Neural Oscillators - towards Humanoid Motion in the Real World," Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Vol. 1, pp. 84-89, 1998.
[12] Y. Fukuoka, H. Kimura, and A. H. Cohen, "Adaptive Dynamic Walking of a Quadruped Robot on Irregular Terrain Based on Biological Concepts," The International Journal of Robotics Research, Vol. 22, No. 3-4, pp. 187-202, 2003.
[13] M. M. Williamson, "Neural Control of Rhythmic Arm Movements," Neural Networks, Vol. 11, 13791394, 1998.
[14] J. Pratt, C.-M. Chew, A. Torres, P. Dilworth and G. Pratt, "Virtual Model Control: An Intuitive Approach for Bipedal Locomotion," The International Journal of Robotics Research, Vol. 20, No. 2, pp. 129-143, 2001.
[15] K. Tsuchiya, S. Aoi and K. Tsujita, "Locomotion Control of a biped Locomotion Robot using Nonlinear Oscillator," Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 1745-1750, 2003.
[16] G. Endo, J. Nakanishi, J. Morimoto and G. Cheng, "Experimental Studies of a Neural Oscillator for Biped Locomotion with QRIO," Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 598-604, 2005.
[17] W. Yang, N. Y. Chong, C. Kim and B. J. You, "Self-adapting Humanoid Locomotion Using a Neural Oscillator Network," Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 309-316, 2007.
[18] W. Yang, N. Y. Chong, C. Kim and B. J. You, "Optimizing Neural Oscillators for Rhythmic Movement Control," Proc. IEEE Int. Symp. on Robot and Human Interactive Communication, pp. 807-814, 2007.
[19] W. Yang, N. Y. Chong, SyungKwon Ra, ChangHwan Kim and Bum Jae You, "Self-stabilizing Bipedal Locomotion Employing Neural Oscillators," IEEE-RAS Int. Conf. on Humanoid Robots, pp. 8-15, 2008.
