0International Journal of Advanced Robotic Systems
OPEN V!) ACCESS ARTICLE
Stable Walking of Humanoid Robots Using Vertical Center of Mass and Foot Motions by an Evolutionary Optimized Central Pattern Generator
Regular Paper
Young-Dae Hong1 and Ki-Baek Lee2*
1 Ajou University, Suwon, Republic of Korea
2 Kwangwoon University, Seoul, Republic of Korea Corresponding author(s) E-mail: kblee@kw.ac.kr
Received 10 October 2014; Accepted 23 November 2015
DOI: 10.5772/62039
© 2016 Author(s). Licensee InTech. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
This paper proposes a method to produce the stable walking of humanoid robots by incorporating the vertical center of mass (COM) and foot motions, which are generated by the evolutionary optimized central pattern generator (CPG), into the modifiable walking pattern generator (MWPG). The MWPG extends the conventional 3-D linear inverted pendulum model (3-D LIPM) by allowing a zero moment point (ZMP) variation. The disturbance caused by the vertical COM motion is compensated in real time by the sensory feedback in the CPG. In this paper, the vertical foot trajectory of the swinging leg, as well as the vertical COM trajectory of the 3-D LIPM, are generated by the CPG for the effective compensation of the disturbance. Consequently, using the proposed method, the humanoid robot is able to walk with a vertical COM and the foot motions generated by the CPG, while modifying its walking patterns by using the MWPG in real time. The CPG with the sensory feedback is optimized to obtain the desired output signals. The optimization of the CPG is formulated as a constrained optimization problem with equality constraints and is solved by two-phase evolutionary programming (TPEP).
The validity of the proposed method is verified through walking experiments for the small-sized humanoid robot, HanSaRam-IX (HSR-IX).
Keywords Humanoid Robot, Vertical Center of Mass (COM) Motion, Central Pattern Generator (CPG), Constrained Optimization
1. Introduction
The walking motion of a humanoid robot is one of the representative research topics in the field of robotics, and various walking-pattern generation methods for stable walking have been developed [1-4]. The 3-D linear inverted pendulum model (3-D LIPM) is one of the most widely used methods of generating a walking pattern for human-oid robots [1]. In the 3-D LIPM, to decouple the sagittal and lateral centre of mass (COM) motion equations, the vertical COM motion is not considered. Various walking-pattern generation methods have been developed based on the 3D LIPM [5-9]. However, the constant COM height only
allows the humanoid robot to walk with a limited step length and makes the walking unnatural. Thus, it is necessary to provide the vertical COM motion for the walking-pattern generation method based on the 3-D LIPM, for the up-and-down motion of the upper body and a longer stride.
Among the previous studies into the generation of the vertical COM motion of the 3-D LIPM, there was an approach involving the generation of an up-and-down COM motion using indexes such as the knee-stretch index and the knee-torque index [10]. An attempt to generate a COM motion constrained on a parametric surface, which is the COM height from the position of the swinging leg, was studied [11]. Up-and-down COM motions using the vertical pivot motion of the 3-D LIPM [12] and an analytical solution produced by a dynamic 3-D symmetrization method [13] were also introduced. An up-and-down COM motion was generated using a virtual plane method [14, 15]. There was also an attempt to develop a hip-pattern generator using the sinusoidal function, and a foot-pattern generator for heel-strike and toe-off motions [16]. In addition, approaches to generate a vertical COM motion for minimizing energy consumption were studied [17, 18]. Meanwhile, there have also been studies of walking-pattern generation methods using a central pattern generator (CPG) for a humanoid robot [19-25]. The CPG is the representative biologically inspired method [26], which produces rhythmic signals using neural oscillators (NOs) [27]. The humanoid robot could maintain its balance by using sensory feedback in the CPG while walking. However, in these previous studies, the humanoid robot walked unnaturally and it was unable to modify its walking pattern in real time.
In order to solve these problems, a novel method for stable walking with a vertical COM motion, based on the 3-D LIPM, was proposed [28, 29]. The effectiveness of the proposed algorithm has been verified by computer simulations and experiments, along with a comparison of the vertical COM trajectories generated by the proposed evolutionary optimized CPG and the sinusoidal function utilized in [16].
This paper proposes a method to produce the stable walking of humanoid robots by incorporating the vertical COM and foot motions, which are generated by the evolutionary optimized CPG, into the modifiable walking pattern generator (MWPG) [6-9]. The MWPG extended the conventional 3-D LIPM by allowing a ZMP variation. The disturbance caused by the vertical COM motion is compensated in real time by the sensory feedback in the CPG. In this paper, the vertical foot trajectory of the swinging leg, as well as the vertical COM trajectory of the 3-D LIPM, are generated by the CPG for the effective compensation of the disturbance. Consequently, using the proposed method, the humanoid robot is able to walk with the vertical COM and the foot motions to be generated by the CPG, while modifying its walking patterns by the MWPG in real time. The CPG with the
sensory feedback is optimized to obtain the desired output signals. The optimization for the CPG is formulated as a constrained optimization problem with equality constraints, and is solved using two-phase evolutionary programming (TPEP) [30]. The equality constraints for the optimization of the CPG are more detailed than those of [29]. The validity of the proposed method is verified through walking experiments involving the small-sized humanoid robot, HanSaRam-IX (HSR-IX). A walking experiment using a constant COM height is first performed, and then the results are compared with those of the walking experiment using the vertical COM and foot motions generated by the CPG. To demonstrate the effectiveness of the sensory feedback in the CPG, the results of the walking experiments both with and without the sensory feedback are compared.
This paper is organized as follows. Section 2 presents the walking motion using the vertical COM and foot motions produced by the evolutionary optimized CPG. The generation of the walking pattern by the MWPG is described. Next, the CPG used for generating the vertical COM and foot motions is proposed. The CPG is reviewed and the trajectory generation using the CPG is explained along with the sensory feedback. The constrained optimization for the CPG is also proposed. Then, the overall procedure of the proposed method is explained. Section 3 presents the experimental results and the conclusion follows in Section 4.
2. Walking Using Vertical COM and Foot Motions Produced by an Evolutionary Optimized CPG
2.1 Walking Pattern Generation
The walking of the humanoid robot consists of single and double support phases. In the single-support phase, the primary dynamics of the humanoid robot is simplified as a 3-D LIPM under the assumptions that the robot's mass is concentrated to a single point and that the support leg is a weightless telescopic limb, as shown in Fig. 1 [1]. In the 3D LIPM, in order to decouple the sagittal and lateral COM motion equations, the COM height is set to a constant value. In other words, the vertical COM motion is not considered. The following equations present the COM motions of the 3-D LIPM in the MWPG.
Sagittal COM motion:
Slr : sagittal step length;
_ Xf ' Ct st ' X. 1 1
vT _ f c ] _ st ct _ vT i cc _ T c
Lateral COM motion:
I STp(t)dt
¡•T
J0 ctp№
_ yf " ~CT sT ' y 1
wT _ f c _ ST CT wT ic T c
I STq(t)dt
¡■T
J0 Cq (t)dt
L l/r : lateral step length;
6l /r : foot direction of swing leg.
For the CS, the WS of the 3-D LIPM is derived [6-9]. Then, the sagittal and lateral COM trajectories satisfying the WS are achieved from (1) and (2). In the MWPG, the vertical COM motion is not considered like the other conventional 3-D LIPM methods. However, in this paper, the vertical COM trajectory of the 3-D LIPM and the vertical foot trajectory of the swinging leg are generated by the CPG, in order for them to be incorporated into the MWPG.
where (xi,vi)/(xf ,Vf) and (yi ,w.)/( yf ,Wf) are the initial/final COM position and velocity in the sagittal and lateral planes, respectively, which together are defined as a walking state (WS). ST and CT are defined as sinh(T / Tc) and cosh(T / Tc), respectively, where T is the remaining singlesupport time, and Tc =^Zc / g, where Zc is the COM height. p(t) and q(t) are the ZMP functions for the sagittal and lateral COM motions, respectively, where p(t)= p(T -1) and q(t)=q(T -1).
The first and second terms on the right-hand side of (1) and (2) are the homogeneous solution component and the particular solution component of the dynamic equation of the 3-D LIPM, respectively. In the conventional 3-D LIPM, it is assumed that the ZMP is fixed at the contact point by utilizing only the homogeneous solution component. Consequently, in the single support phase, the COM motion of the 3-D LIPM is predetermined and unmodifia-ble. This means that the humanoid robot is unable to independently modify the elements of the walking pattern, i.e., the single and double support times, the sagittal and lateral step lengths and the foot direction of the swinging leg. However, in the MWPG, by utilizing the particular solution component for the ZMP variation, the COM position and velocity can be changed independently at any time during the single support phase [6-9]. Thus, the MWPG enables the humanoid robot to modify the elements of the walking pattern independently by means of the ZMP functions p(t) and q(t), without any additional footsteps required for adjusting the COM motion. In this paper, the MWPG is employed to generate the modifiable walking pattern for the humanoid robot. As the input of the MWPG, the command state (CS) is defined as follows [6-9]:
Definition 1 CS is defined as
CS ° T
l q Tss Tds s l e ù
l l r r r r r ]
Tfr : single support time; T^jS : double support time
2.2 CPG for Generating Vertical COM and Foot Motions 2.2.1 CPG Structure
The sequence of extension and flexion of the joints enables biologically rhythmic locomotion. When one side of the body part is extending, the other side is flexing, and extension and flexion occur alternately during the rhythmic motion. For the modelling of this biological system, Taga devised the CPG structure [26]. In the CPG, multidimensional rhythmic signals are generated endogenously without requiring a rhythmic sensory or central input, and these signals are adapted to environmental perturbations using sensory feedback. To generate the rhythmic signals, Matsuoka's NO is utilized, of which the neuron is as follows [27]:
tU - c - ui - ßvi - ^Wj \_uj ] + feedi t v. - \u]+ - v.
[u]+ = max (0,u)
where the subscripts i and j denote the indexes of the neurons, ut and vt are the inner state and self-inhibition state, respectively, and c is the external input signal that affects the output's amplitude. ft and w^ denote, respectively, the self-inhibition weight and the connecting weight that decides the difference of the phase between the i -th and j -th neurons. feedt is the sensory feedback signal. t and t denote the time constants that affect the shape and period of the output signal, and n is the number of neurons. Fig. 2 shows the neuron's structure.
In the CPG structure, the rhythmic signals are generated by Matsuoka's NOs in (3), each of which consists of an extensor neuron (EN) and a flexor neuron (FN). They are interconnected in the same NO and produce the flexion and extension signals as shown in Fig. 3. Through the effects of
n „ n
n -o R _
U Ui vt
J feed, ^
[Ui ]+
-• Inhibitory connection
o Excitatory connection
Figure 2. The neuron's structure. The subscripts i and j denote the indexes of the neurons, ui and vi are the inner state and self-inhibition state, respectively, and c is the external input signal. p and Wij denote, respectively, the weight of the self-inhibition and the connecting weight. feedi is the sensory feedback signal. t and t ' denote the time constants and n is the number of neurons.
this relationship, the rhythmic signals are obtained as follows [26]:
rue - c - u* -pv\ - wf [uf ]+
- X ( w; [u* ] + wi [uf ] ) + feed
j-1 ^ 0
rv - [ue ]+- ve
ruf - c - uf -fivf - wf [u ] (4)
N( j*i)f r— —1+ r -,+ N
- X ( wj [u ] + wj [uf ] ) + feedf r'vf - [uf ] - vf
o> - [u]+-[uf ]+
where the subscripts i and j denote the indexes of the NOs, and the superscripts e and f denote the EN and FN, respectively. wf is the connecting weight between the EN and FN in the i -th NO, ot is the output signal and N is the number of NOs.
N(j*') , it,
z (<[«;]+ + wf [uf ]+) j=1 f;;d;
wf [u; ]+
N (ifi) (wf [u; ]+ + wf [uf ]+)■ j=1 feedf
[u; ]+
w;f [uf [uif]+
Inhibitory connection Excitatory connection
Figure 3. NO structure for the CPG. The subscripts i and j denote the indexes of the NOs and the superscripts e and f denote the EN and FN, respectively. wI is the connecting weight between the EN and the FN in the i -th NO, oi is the output signal and N is the number of NOs.
2.2.2 Generation of Vertical COM and Foot Motions Using a CPG
In this paper, the CPG structure is composed of two NOs for the vertical COM motion of the 3-D LIPM and the
vertical foot motion of the swinging leg, as shown in Fig. 4. Using the NO, the vertical COM trajectory of the 3-D LIPM is generated as follows:
z - Z + A (o.
com c com *
(o1 -1)
where Zc is the initial COM height, Acom is the amplitude scaling factor and o1 is the output signal generated by the first NO (NO1) in the CPG for the vertical COM trajectory of the 3-D LIPM. The vertical foot trajectory of the swinging leg is generated as follows:
zfoot - Afoot [o2 ]
where Ajiot is the amplitude scaling factor and o2 is the output signal generated by the second NO (NO2) in the CPG for the vertical foot trajectory of the swinging leg. The generated vertical foot trajectory of the swinging leg is applied to the left and right legs alternately on every footstep. Note that the sagittal and lateral foot trajectories of the swinging leg are generated by a cubic spline interpolation, which is a common method for trajectory generation. In these NOs, when the magnitude of the output signals is negative, aT and aT are used instead of t and t , respectively, to adjust the period of the output signals, where a is the scaling factor.
Since the vertical COM motion of the 3-D LIPM violates the assumption that the COM height should be constant in the conventional 3-D LIPM, the vertical COM motion of the 3D LIPM causes disturbances while walking. To compensate for this disturbance, the sensory feedback of the NOs are utilized. If the robot stands motionless, the sum of the ground reaction forces (GRFs) acting on the feet is equal to the robot's weight. On the other hand, it oscillates around the weight of the robot while walking with a vertical COM motion, which causes the disturbance. Thus, the following sensory feedback parameters are designed to improve the robot's stability while walking with a vertical COM motion, by minimizing the oscillation of the GRFs on the feet:
feed1 - k F, + F- mg\
J 1 com | l r o |
feedf - - feed!
feed2 - kfoot\Fi + Fr -mg|
feedf - -feed2
where kcom and kfiot denote the feedback scaling factors, and Fl and Fr are the GRFs on the left and right feet, respectively.
2.3 Constrained Optimization for the CPG
For the minimization of the oscillation of the GRFs on the feet while walking using sensory feedback and the desired
Considering the constraints as well as the objective, the following constrained optimization problem was formulated to obtain the evolutionary optimized values of c, t, t and a in the NOs and of kcom and kjbot in the sensory feedback:
Minimize f = F, + Fr - mg\ + P (8)
subject to constraints
Figure 4. CPG structure for generating vertical COM and foot motions. Acom and Afoot are the amplitude scaling factors. o1 and o2 are the output signals generated by NO1 and NO2 in the CPG, respectively. Zc is the initial COM height.
output signals from the CPG, the optimization of the CPG is formulated as a constrained optimization problem. For optimization, the objective function is designed to minimize the oscillation of the GRFs on the feet while walking with the vertical COM motion, satisfying the following equality constraints. The time periods of the trajectories generated by the evolutionary optimized CPG should satisfy the equality constraints on the single and double support times while walking. Note that the output signals generated by the evolutionary optimized CPG oscillate around zero. When the magnitude of the output signals generated by the evolutionary optimized CPG is positive, the corresponding times T / and T 2p should be equal to the single support time of the walking, Tss. In contrast, when the magnitude is negative, the times Tn and T2n should be equal to the double support time Tds. This is because the vertical COM trajectory should move up during the single support phase and move down during the double support phase. These constraints make the magnitude of the output signals either positive or negative during single and double support phases, respectively. When the magnitude of the output signals reaches the maximum value, the corresponding times Tand T2,"ax should be equal to half of Tss. Conversely, when it reaches the minimum value, the times T 1"in and T2fn should be equal to half of TAs. The amplitude of the output signal obtained by the evolutionary optimized CPG in each period increases, decreases or maintains a consistent value with respect to time according to t and t . Since the walking movement of the humanoid robot repeats the same motion, the amplitudes of the output signals in every period should be equal to each other. If the amplitudes of the output signals in the initial and final periods A1 / A2' and Af / Af are equivalent, it means that the amplitudes of the output signal in every period are equal to each other. In addition, the amplitudes of the trajectories for the vertical COM motion of the 3-D LIPM and the vertical foot motion of the swinging leg should be equal to Acom and Afoot, respectively. Acom and Afoot are the predefined amplitude scaling factors and determine the amplitudes of the vertical COM and foot trajectories, respectively.
c.: 77 - T =0,
11 ss '
c2: TP - T =0
2 2 ss
Tds = 0, c4: T-<n T2 - Tds = 0
Tss _ ss 2 = 0, c6: '-nmaa T2 Tss _ ss 2 =0
- Tds 2 = 0, c8: T2 - Tds 2 =0
"A1 = 0, c10: : A2 - A2 =0
c: A - Af = 0, c: Afot - Af = 0.
11 com 1 ' 12 foot 2
In the objective function f, the first term in the right-hand side is the sum of the differences between the GRFs and the robot's weight while walking, and the second term P is a penalty value which is assigned when the robot falls down while walking because the constrained optimization problem is the minimization problem. To solve the constrained optimization problem above, TPEP is employed. TPEP is highly suitable for problems with diverse types of constraints and gives better results with respect to the solution's accuracy, convergence stability and computation time [31].
2.4 Overall Procedure of the Proposed Method
Fig. 5 shows the flowchart of the proposed method's overall procedure. Firstly, the CPG with the sensory feedback is optimized off-line by the TPEP considering the equality constraints. Then, at every sample time, the CS, which is predefined or generated by the footstep planner [33, 35], is entered into the proposed method. To satisfy the CS, the sagittal and lateral COM trajectories of the 3-D LIPM are generated using (1) and (2). The vertical COM trajectory of the 3-D LIPM and the vertical foot trajectory of the swinging leg are generated by the evolutionary optimized CPG using (5) and (6), which are modified in real time by the sensory feedback in the CPG in order to compensate for the disturbance caused by the vertical COM motion using (7). The sagittal and lateral foot trajectories of the swinging leg are generated by the cubic spline interpolation. In the double support phase, the COM motions travel with constant velocity. Then, the COM motion of the 3-D LIPM is updated and the leg joint trajectories of the robot are calculated using the inverse kinematics at every sample time. Until the walking stops, these steps are repeated.
Figure 5. Flowchart of the overall procedure of the proposed method
3. Experimental Results
The proposed method was verified with the small-sized humanoid robot HSR-IX, as shown in Fig. 6 [8]. Its height is 52.8 cm and mass is 5.5 kg. It has 12 DC motors with harmonic drives in the lower body and 16 RC servo motors in the upper body. The onboard Pentium-III (667 MHz) compatible PC, running RT-Linux, calculates the proposed algorithm at every sampling time in real time. Since most formulas used in the proposed method have a closed form, the calculation time took lsssthan 1 msec for the onboard Pentium-III como>atiblo PC. Thas, the eampling time was set as 5 msec. Fout fotso sensing resistors (FSRs) are installed on -he sole of oath foh t to meeeure both the GRFs on the feet ant- °he ZMP trajectory while walking. For stable dynamic walking, in the single-support phase, the ZMP trajectory shoulO Oe in ahe foot beundary of the support leg. In the double-support phase, if the ZMP trajectory is in the area bounded bd Otef two ieet, ihe robot is stable. In other words, the ZMP trajsctofy is e representative and direct stability criterion for bipedal walking. Therefore, the ZMP and GRF trajectories durine the w alking experiments were provided in order to verify the effectiveness of the proposed method. In the experiments, Zc was set to 23.95 cm. The single and double support times Tss and Tds were set to 0.8 s and 0.4 s, respectively.
3.1 Walking Experiment Using a Constant COM Height
The walking experiment using a constant COM height was performed for comparisons of the ZMP trajectory, GRFs and maximum step length, during the walking experiments using the vertical COM and foot motions determined by the evolutionary optimized CPG. In this walking experiment, the vertical foot trajectory of the swinging leg was generated by a cycloid function instead of the CPG. Fig. 7 shows the measured ZMP trajectory while walking. The ZMP trajectory in the x -axis and y -axis followed that of the foot trajectory with a small variation. One of the reasons for this small variation of the ZMP trajectory is the difference in dynamics between the real robot and the 3-D LIPM. Fig. 8 shows the measured left and right GRFs while walking. Note that the left and right GRFs are different because the mass distribution was asymmetrical in the real robot. It can be seen that the GRFs oscillated, which is another reason for the small variation of the ZMP trajectory. f in (8), which describes the oscillation of the GRFs while walking, was measured as 15341.43 N for walking seven steps and the maximum step length was 5.5 cm. In this paper, the maximum step lengths were decided during the walking experiments by increasing the step length until the workspace-boundary singularities occurred. The workspace-boundary singularities occur when the leg is fully stretched out such that the end-effector is at or very near to the boundary of the workspace. The walking experiments were carried out using the measured maximum step length for each case.
(a) (b) (c)
Figure 6. (a) HSR-IX. (b) Simulation model. (c) Configuration.
Figure 7. Measured ZMP trajectory while walking with a constant COM height
Figure 8. Measured left and right GRFs while walking with a constant COM height
Single-support time [s] T ss 0.8
Double-support time [s] Tds 0.4
Amplitude scaling factor i com 1.0
Amplitude scaling factor Apo0 1.0
Penalty value P
Table 2. Parameter setting for the ■ objective function
External input signal c 2.977
Time constants T 0.313
t 0.204
a 0.522
Feedback scaling factors k ""com -0.001959
kfoot -0.000165
Table 3. Optimized parameters generated by TPEP
3.2 An Evolutionary Optimized CPG
The simulation model of HSR-IX modelled by the 3-D robotics simulation software, Webots [36], was employed for the constrained optimization of the CPG as shown in Fig. 6(b). Tables 1 and 2 present the parameter settings for the CPG and the objective function, respectively, where the following notations are used:
Notation 1
Wf : connecting weight from EN of NO1 to EN of NO2;
w2e{ : connecting weight from EN of NO1 to FN of NO2;
wf : connecting weight from FN of NO1 to EN of NO2;
wf : connecting weight from FN of NO1 to FN of NO2.
Note that w^f, w2e{, w21 and w2f are defined in a similar manner to the case of the connecting weights from NO1 to NO2. The initial inner states and self-inhibition states were obtained from the computer simulation in order to make the initial values of zcom and z^oot equal Zc and zero, respectively. The connecting weights were set in a way that made the difference of the phase between [u-f]+/[u2e] + and ["/ ]+/ ["/] + equal n [27].
ui 0.768 u/ -0.028
vi 0.442 v/ 0.258
u2 0.767 u/ -0.026
0.442 v2f 0.258
wf 2.0 w2f 2.0
<2 0.0 0.5
Connecting weights 0.5 wi 0.0
w21 0.0 WÎ 0.5
w2f 0.5 w! 0.0
Self-inhibition weight ß 2.5
Table 1. Parameter setting for the CPG
The optimized parameters afforded by the TPEP are given in Table 3. Consequently, Tf / T 2p and T f / T 2n were obtained as 0.8 s and 0.4 s, which were equal to the single- and double-support times Tss and Tds, respectively. T1max / T2max and Tmin / T were obtained as 0.4 s and 0.2 s, which were equal to half of Tss and Tds, respectively. Af / A2l and A- / A/ had the same value of 1.0 cm, which is equal to Acom and Apot. Fig. 9 shows the vertical COM trajectory of the 3-D LIPM and the vertical foot trajectories of the left and right legs that are generated by the evolutionary optimized CPG, which was used for the following walking experiments.
0 2 4 6 8
Time [s]
1.5 I-i- -
Time [s]
Figure 9. Vertical COM trajectory of 3-D LIPM and vertical foot trajectories of left and right legs generated by the evolutionary optimized CPG. The thick and thin lines represent the COM trajectories in the single and double support phases, respectively.
3.3 Walking Experiment Using Vertical COM and Foot Motions by an Evolutionary Optimized CPG Without Sensory Feedback
Figs. 10 and 11 show the measured ZMP trajectory, and left and right GRFs while walking using the vertical COM and
foot motions that are generated by the evolutionary optimized CPG without sensory feedback. "Without feedback" means that the scaling factors of the sensory feedback, kcom and kjbot, are set as zero. The ZMP trajectory in the x -axis and y -axis followed the foot trajectory with a small variation. The variation of the ZMP trajectory was increased when compared to the results of the walking experiment using the constant COM height. The oscillation of the GRF trajectories also increased (f was 20199.36 N for seven walking steps). These factors were caused by the vertical COM motion while walking. The maximum step length was 6.5 cm, which was longer than the maximum step length of 5.5 cm when the robot walked with the constant COM height. This was because the robot was able to avoid the singularities by the lower COM height in the double support phase, which causes the wider workspace of the leg.
Figure 10. Measured ZMP trajectory while walking, using vertical COM and foot motions by an evolutionary optimized CPG without sensory feedback
3.4 Walking Experiment Using Vertical COM and Foot Motions by an Evolutionary Optimized CPG with Sensory Feedback
In this experiment, the same step length was used in the walking experiment without the sensory feedback. The walking experiment using the vertical COM and foot motions generated by the evolutionary optimized CPG with sensory feedback was performed. "With feedback" means that the scaling factors of the sensory feedback, kcom and kjbot, are set as the values obtained by the TPEP. Fig. 12 shows the measured ZMP trajectory while walking. The ZMP trajectory in the x -axis and y -axis followed the foot trajectory, and its variation decreased when compared to the results of the walking experiment without sensory
Figure 11. Measured left and right GRFs while walking, using vertical COM and foot motions by an evolutionary optimized CPG without sensory feedback
feedback. This was because the oscillation of the GRFs decreased (f =13513.12 N for walking seven steps), as shown in Fig. 13, by the evolutionary optimized sensory feedback signals in the CPG, as shown in Fig. 14. Consequently, the oscillation of the GRFs was minimized, and then the variation of the ZMP trajectory was minimized. Thus, it can be summarized that the sensory feedback in the CPG enhanced the robot's stability while walking with the vertical COM motion.
Figure 12. Measured ZMP trajectory while walking using vertical COM and foot motions determined by an evolutionary optimized CPG with sensory feedback
Figure 13. Measured left and right GRFs while walking using vertical COM and foot motions determined by an evolutionary optimized CPG with sensory feedback
Figure 14. Evolutionary optimized sensory feedback signals in CPG
4. Conclusion
This paper proposed a method for the stable walking of humanoid robots using the vertical COM and foot motions
that were generated by the evolutionary optimized CPG. The walking pattern for the humanoid robot was generated by the MWPG. The vertical COM trajectory of the 3-D LIPM and the vertical foot trajectory of the swinging leg were generated by the CPG. The sensory feedback in the CPG was designed to minimize the oscillation of the GRFs while walking with the vertical COM motion. The optimization of the CPG was formulated as a constrained optimization problem and the CPG with the sensory feedback was optimized by the TPEP. The effectiveness of the proposed method was verified via walking experiments using the small-sized humanoid robot, HSR-IX. Consequently, using the proposed method, HSR-IX could walk stably with the vertical COM and foot motions that are generated by the CPG, because the disturbance caused by the vertical COM motion was compensated in real time by the sensory feedback in the CPG. In addition, the maximum step length was longer than that during walking with a constant COM height.
5. Acknowledgements
This work was supported by the new faculty research fund of Ajou University.
This work was also supported in part by the Research Grant of Kwangwoon University in 2015.
6. References
[1] S. Kajita, F. Kanehiro, K. Kaneko, K. Fujiwara, K. Yokoi and H. Hirukawa, "A realtime pattern generator for biped walking," in Proc. IEEE Int. Conf. Robot. Autom., 2002, vol. 1, pp. 31-37.
[2] Q. Huang and Y. Nakamura, "Sensory reflex control for humanoid walking," IEEE Trans. Robot., vol. 21, no. 5, pp. 977-984, Oct. 2005.
[3] T. Aoyama, Y. Hasegawa, K. Sekiyama and T. Fukuda, "Stabilizing and direction control of efficient 3-D biped walking based on PDAC," IEEE/ ASME Trans. Mechatron., vol. 14, no. 6, pp. 712-718, Dec. 2009.
[4] K. Harada, S. Hattori, H. Hirukawa, M. Morisawa, S. Kajita and E. Yoshida, "Two-stage time-parametrized gait planning for humanoid robots," IEEE/ ASME Trans. Mechatron., vol. 15, no. 5, pp. 694-703, Oct. 2010.
[5] S. Kajita, F. Kanehiro, K. Kaneko, K. Fujiwara, K. Harada, K. Yokoi and H. Hirukawa, "Biped walking pattern generation by using preview control of zero-moment point," in Proc. IEEE Int. Conf. Robot. Autom, 2003, vol. 2, pp. 1620-1626.
[6] B.-J. Lee, D. Stonier, Y.-D. Kim, J.-K. Yoo and J.-H. Kim, "Modifiable walking pattern of a humanoid robot by using allowable ZMP variation," IEEE Trans. Robot., vol. 24, no. 4, pp. 917-925, Aug. 2008.
[7] Y.-D. Hong, B.-J. Lee and J.-H. Kim, "Command state-based modifiable walking pattern generation on an inclined plane in pitch and roll directions for humanoid robots," IEEE/ASME Trans. Mechatron., vol. 16, no. 4, pp. 783-789, Aug. 2011.
[8] Y.-D. Hong and J.-H. Kim, "3-D command state-based modifiable bipedal walking on an uneven terrain," IEEE/ASME Trans. Mechatron., 10.1109/ TMECH.2012.2182777, Dec. 2011.
[9] Y.-D. Hong and B.-J. Lee, "Experimental study on modifiable walking pattern generation for handling infeasible navigational commands," J. Elect. Eng. Technol, vol. 10, no. 6, pp. 2368-2375, Nov. 2015.
[10] R. Kurazume, S. Tanaka, M. Yamashita, T. Hasega-wa and K. Yoneda, "Straight legged walking of a biped robot," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst, 2005, pp. 337-343.
[11] M. Morisawa, S. Kajita, K. Kaneko, K. Harada, F. Kanehiro, K. Fujiwara and H. Hirukawa, "Pattern generation of biped walking constrained on parametric surface," in Proc. IEEE Int. Conf. Robot. Autom., 2005, pp. 2405-2410.
[12] A. Sekiguchi, K. Kameta, Y. Tsumaki and D. N. Nenchev, "Biped walk based on vertical pivot motion of linear inverted pendulum," in Proc. IEEE/ ASME Adv. Intell. Mechatron., 2007, pp. 1-6.
[13] K. Terada and Y. Kuniyoshi, "Online gait planning with dynamical 3D-symmetrization method," in Proc. IEEE-RAS Int. Conf. Humanoid Robots, 2007, pp. 222-227.
[14] S. Shimmyo, T. Sato and K. Ohnishi, "Biped walking pattern generation by using preview control with virtual plane method," in Proc. IEEE Int. Work. Adv. Motion Control, 2010, pp. 414-419.
[15] S. Shimmyo and K. Ohnishi, "Nested preview control by utilizing virtual plane for biped walking pattern generation including COG up-down motion," in Proc. Annu. Conf. IEEE Ind. Electron. Soc., 2010, pp. 1571-1576.
[16] Z. Li, B. Vanderborght, N. G. Tsagarakis and D. G. Caldwell, "Fast bipedal walk using large strides by modulating hip posture and toe-heel motion," in Proc. IEEE Int. Conf. Robot. Biomimetics, 2010, pp. 1318.
[17] A. C. Amran, B. Ugurlu and A. Kawamura, "Energy and torque efficient zmp-based bipedal walking with varying center of mass height," in Proc. IEEE Int. Work. Adv. Motion Control, 2010, pp. 408-413.
[18] P. Kormushev, B. Ugurlu, S. Calinon, N. G. Tsagar-akis and D. G. Caldwell, "Bipedal walking energy minimization by reinforcement learning with evolving policy parameterization," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 2011, pp. 318324.
[19] G. Endo, J. Nakanishi, J. Morimoto and G. Cheng, "Experimental studies of a neural oscillator for
biped locomotion with QRIO," in Proc. IEEE Int. Conf. Robot. Autom., 2005, pp. 596-602.
[20] L. Righetti and A. J. Ijspeert, "Programmable central pattern generators: an application to biped locomotion control," in Proc. IEEE Int. Conf. Robot. Autom., 2006, pp. 1585-1590.
[21] K. Watanabe, G. L. Liu, M. K. Habib and K. Izumi, "Neural oscillators with a sigmoidal function for the CPG of biped robot walking," in Proc. Annu. Conf. IEEE Ind. Electron. Soc., 2007, pp. 128-133.
[22] M. K. Habib, K. Watanabe and K. Izumi, "Biped locomotion using CPG with sensory interaction," in Proc. IEEE Int. Symp. Ind. Electron., 2009, pp. 14521457.
[23] C.-S. Park, Y.-D. Hong and J.-H. Kim, "Full-body joint trajectory generation using an evolutionary central pattern generator for stable bipedal walking," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 2010, pp. 160-165.
[24] C.-S. Park, Y.-D. Hong and J.-H. Kim, "Evolutionary optimized central pattern generator for stable modifiable bipedal walking," IEEE/ASME Trans. Mechatron., vol. 19, no. 4, pp. 1374-1383, Aug. 2014.
[25] Y.-D. Hong, "An evolutionary optimization approach for optimal hopping of humanoid robots," J. Elect. Eng. Technol., vol. 10, no. 6, pp. 2420-2426, Nov. 2015.
[26] G. Taga, "A model of the neuro-musculo-skeletal system for human locomotion," Biol. Cybern., vol. 73, pp. 97-111, 1995.
[27] K. Matsuoka, "Mechanisms of frequency and pattern control in the neural rhythm generators," Biol. Cybern., vol. 56, no. 5, pp. 345-353, Jul. 1987.
[28] Y.-D. Hong, C.-S. Park and J.-H. Kim, "Human-like stable bipedal walking with a large stride by the height variation of the center of mass using an evolutionary optimized central pattern generator," in Proc. Annu. Conf. IEEE Ind. Electron. Soc., 2011, pp. 136-141.
[29] Y.-D. Hong, C.-S. Park and J.-H. Kim, "Stable bipedal walking with a vertical center of mass motion by an evolutionary optimized central pattern generator," IEEE Trans. Ind. Electron., vol. 61, no. 5, pp. 2246-2355, May 2014.
[30] J.-H. Kim and H. Myung, "Evolutionary programming techniques for constrained optimization problems," IEEE Trans. Evol. Comput., vol. 1, no. 2, pp. 129-140, Jul. 1997.
[31] H. Myung and J.-H. Kim, "Hybrid evolutionary programming for heavily constrained problems," in BioSystems, vol. 38, no. 1, pp. 29-43, 1996.
[32] D. G. Luenberger, Introduction to Linear and Nonlinear Programming. MA: Addison-Wesley, 1973.
[33] Y.-D. Hong, Y.-H. Kim, J.-H. Han, J.-K. Yoo and J.-H. Kim, "Evolutionary multiobjective footstep
planning for humanoid robots," IEEE Trans. Syst. Man Cybern. C, Appl. Rev., vol. 41, no. 4, pp. 520-532, Jul. 2011.
[34] Y.-D. Hong and J.-H. Kim, "An evolutionary optimized footstep planner for the navigation of humanoid robots," Int. J. Humanoid Robot., vol. 9, no. 1, Mar. 2012.
[35] Y.-D. Hong, "Real-time footstep planning and following for navigation of humanoid robots," J. Elect. Eng. Technol., vol. 10, no. 5, pp. 2142-2148, Sep. 2015.
[36] O. Michel, "Cyberbotics Ltd. WebotsTM: Professional mobile robot simulation," Int. J. Adv. Robot. Syst., vol. 1, no. 1, pp. 39-42, 2004.
