0International Journal of Advanced Robotic Systems
OPEN V!) ACCESS ARTICLE
Walking Algorithm of Humanoid Robot on Uneven Terrain with Terrain Estimation
Regular Paper
Jiang Yi1, Qiuguo Zhu1, Rong Xiong1* and Jun Wu1
1 State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou, China Corresponding author(s) E-mail: rxiong@iipc.zju.edu.cn
Received 29 September 2015; Accepted 11 January 2016
DOI: 10.5772/62245
© 2016 Author(s). Licensee InTech. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
Humanoid robots are expected to achieve stable walking on uneven terrains. In this paper, a control algorithm for humanoid robots walking on previously unknown terrains with terrain estimation is proposed, which requires only minimum modification to the original walking gait. The swing foot trajectory is redesigned to ensure that the foot lands at the desired horizontal positions under various terrain height. A compliant terrain adaptation method is applied to the landing foot to achieve a firm contact with the ground. Then a terrain estimation method that takes into account the deformations of the linkages is applied, providing the target for the following correction and adjustment. The algorithm was validated through walking experiments on uneven terrains with the full-size humanoid robot Kong.
Keywords Humanoid Robot, Uneven Terrain, Walking Control, Terrain Estimation
1. Introduction
Achieving movements in human environments is one of the most important goals in humanoid robot research.
However, walking on uneven terrains, especially on previously unknown terrains, is highly challenging. Therefore related works are relatively less fruitful while abundant researches have been made on walking speed and other aspects for walking on even terrains. The DAPAR Robotics Challenge (DRC) for disaster response scenarios showed that the capability to traverse different types of terrains is crucial for robots to assist humans in harsh environments [1], and yet such capability is still quite limited. The capability of adapting to uneven terrains is then raised as a key factor in the development of practical robots. Although vision and laser sensors can be assists for robots to perceive the environments, the problems of inaccuracy, hardware and computational cost limit the effectiveness. Hence, it is still necessary to study biped walking on uneven terrains without complete and reliable information of the environment.
Previous works on biped walking on uneven terrain can be divided into two major categories according to their different control methods: the dynamics-based methods and the model-based methods [2]. The dynamics-based methods, includes the passive walking [3], the Central Pattern Generator (CPG) method [4], the Virtual Model Control (VMC) method [5], etc. These methods achieve walking on uneven terrains through the robustness of their
systems. And in some studies the model of the terrain was already given [6]. The stability analyses of these methods are complex, and usually rely on precise dynamics models of both the robots themselves and their impacts with the ground. Therefore, the implementation results of these methods can be considerably uncertain.
The majority of the model-based methods are variants of the Zero Momentum Point (ZMP) method. These methods achieve walking on uneven terrains by gait adjustments, or by using specially designed foot mechanisms [7, 8], which will not be discussed here in consideration of universality. The former can be further classified by whether modeling the uneven terrains with available sensor information or not. The methods without modeling the terrain focus on the negative effects caused by the non-ideality of the terrains. Hence they actually handle the uneven terrains along with all other non-ideality factors. Walking is stabilized by body acceleration [9, 10, 11], body rotation [12], or foot landing point adjustment in these methods [13, 14, 15]. On the contrary, the methods involving terrain modeling can make adjustments according to the conditions of the uneven terrains. Besides those methods obtaining terrain information from vision [16] or laser [10, 17, 18] as mentioned above, previous researches usually acquired terrain information from both the force-torque information during the foot landing period and the attitude information during the following single support phase [19, 20]. Accordingly, walking was stabilized by both instant adjustments in supporting foot posture and later adjustments in gait such as landing time. A "global terrain" was usually introduced in these works which assumed that there is a general trend in the variation of the terrain. This assumption actually reduced the difficulty of terrain modeling since previous terrain information can be used to reduce the uncertainty of terrain at current landing point. Impedance control is widely applied to achieve compliant foot landing in all these model-based methods.
The methods without terrain modeling lower the complexity of the control systems. However, as these methods are not specific to the conditions of the terrains, the potential to maintain the original gaits is actually lost. Meanwhile, variable walking parameters like step length and walking cycle period are modified, which might leave less margin for resisting other disturbances. On the contrary, the methods involving terrain modeling require less change to the trajectories of the Center of Mass (COM) and save the variable parameters for both faster walking and resisting disturbances. However, acquiring the terrain information is not easy yet, especially when demanded to be accomplished right after the landing of the foot. Some researchers thought it is difficult or even impossible to model the terrain accurately with only the information gathered during the short landing period [19].
We found that there are two major difficulties in building an online terrain model. First, rapid adaptation to the
uneven terrain without hard impact is a challenge. Second, the elastic deformations of the legs that reduce the reliability of the kinematics should be taken into consideration. Hence, a new adaptation method based on the classic impedance control is proposed, which eliminates the coupling between the roll/pitch rotation and the vertical displacement by the feedforward strategy. This method prevents the repeated impact between the landing foot and the terrain, and also shortens the adaptation period. Meanwhile, a new terrain estimation method is designed, which calculates the decline of the landing foot through the rotation about the Center of Pressure (COP) rather than the normal forward kinematics using just the joint angles. The terrain estimation is accurate enough that only the height of the COM needs to be adjusted, so the original offline gait generated by the previewed control method [21] is highly preserved. The swing foot trajectory is also redesigned to cope with the uncertainty of the terrain.
The remainder of the paper is organized as follows. Section 2 gives an overview of all the proposed methods and a framework of the control system. Section 3 describes a redesigned swing foot trajectory. Section 4 introduces the terrain adaptation method in detail. In section 5, the terrain estimation method is described, along with the corresponding correction and adjustment strategies. In section 6, the experimental results are given and discussed. Finally, section 7 concludes the paper.
2. Overview of Methods
In this section, the assumptions of the problem and the framework of the control system are given.
2.1 Assumptions
In this paper, the robot is desired to walk on uneven terrains in the same manner as it does on even floor. There are many kinds of uneven surface conditions for robots. The following assumptions are made to restrict and simplify the problem:
1. The trend of the terrain is stochastic.
2. The height range of the terrain within the projection of the landing foot, represented by [H0wer ,Hupper], should fall within a certain range around the height of the
supporting
represented by
H 0 - AHmin,H 0 + AHmJ, as sh°wn in Figure L AHmn
and AHmax are given parameters limited by the max velocity and acceleration of the swing foot, which are determined by the hardware performance.
3. The support region is big enough to provide enough ZMP margin after the landing foot made a firm contact with the ground.
4. The stiffness of the terrain is consistent and is hard enough to avoid visible deformations.
Landing foot
Supporting foot
Figure 1. Scheme of the uneven terrain
2.2 Framework of control system
A state machine for the control system is designed, as shown in Figure 2. Comparing to the traditional state machine for biped walking, there are two differences:
1. Touching phase is introduced for the adaptation process of the landing foot.
2. The states for the left and the right foot are separated without the double support phase connecting them, as it is possible that one foot enters the flight phase when the other hasn't finished the touching phase.
Figure 2. State machine of the control system
COM Trajectory Generator
Walking Parameters
Preview Horizontal
Control
Height
Adjustment Vertical
Foot Trajectory Generator
Flight Phase
Swing Foot Trajectory
Compliant Adaptation
IigT^^0—i-
LeftFoot Inverse Kinematics
Estimation —r* Correction
State Machine
Sensor Feedback
realize walking on an uneven terrain, the following methods should be applied at different stages:
1. Redesigned swing foot trajectory. Due to the height variation of the terrain, the landing moment can be earlier or later than expected [22]. To ensure the swing foot touches the ground at desired horizontal position before the scheduled landing time, the swing foot trajectory should be redesigned.
2. Compliant adaptation of the landing foot to the terrain. The landing foot should actively adapt to the uneven terrain using the force-torque sensor information after it touches the ground.
3. Correction andadjustmentbasedon terrain estimation. The pose of the landing foot calculated through the forward kinematics is not reliable because of the non-ideality factors such as the deformation of the linkages and the inclination of the body. And the height of the COM should change according to the variation of the terrain. Therefore corresponding corrections and adjustments are needed.
3. Redesigned swing foot trajectory
As mentioned above, the swing foot should have touched the ground at the desired horizontal position before the scheduled landing time, as long as the height of the terrain falls into the allowed range. Therefore the horizontal components of the trajectory should reach the target value before the vertical component does. And the end of the planned trajectory should reach the lower limit of the terrain to guarantee a contact. Additional requirements for the swing foot trajectory are given as follows:
1. The continuity of the velocity should be guaranteed.
2. The maximum vertical decline velocity should be limited to avoid hard impacts.
3. The swing foot should not stay near the ground for too long in order to avoid repeated impacts with the ground.
Components of the trajectory other than the vertical displacement are all set to be sinusoids that reach the target values before the scheduled landing time and then hold the target values, for example, the displacement in the front-rear direction x(t). Given the initial value x0 and the target value xv along with the start time of the step set to be zero for convenience
Figure 3. Diagram of the overall control framework
The framework of the control system is shown in Figure 3. In this control process, the preview control method is used to generate the offline COM trajectory with the gait parameters, like the step length and the scheduled landing time (which is the deadline for the actual landing). To
*>o(t) =
0.5+ 0.5 cos
t < aT. ocT. step
Right leg
where Tstep is the scheduled landing time of the step and a is a factor that is set to 0.75 in this research. Other components of the trajectory, including the displacement in the left-right direction and all the rotations, can be calculated by replacing x0 and x1 with corresponding values.
Tnear TsteP
Figure 4. Vertical displacement component of the swing foot trajectory
We set the vertical displacement component of the trajectory as a piecewise function composed of four parabolas, as shown in Figure 4. The target value z1 should be the minimum terrain height allowed
z =z -AH . ,
1 sup min'
where zsup is the height of the supporting foot.
Given the initial value Zq, the target value z1, the height of the trajectory htra., the maximum decline velocity Vlower and the residence time tnear within the distance hnear from the ground, we have
#1, a?, 03, t1 and t2 can be calculated using the smooth condition, which will not be detailed here.
4. Compliant Adaptation of Landing Foot
Theoretically, the compliance control should be applied to all the six Dimensions of Freedom (DOF) of the landing foot in order to avoid slipping between the sole and the ground. In practice, as the horizontal displacement and the yaw rotation can be ignored during the landing process, the compliance control is only used for the roll, the pitch rotations and the vertical displacement.
4.1 Compliance control of roll and pitch rotations
There are two major considerations in choosing the compliance control method for the landing foot. First, the landing foot is supposed to hold its pose when there is no difference between the measured and the reference torque, which implies that the controller should have zero steady state error. Second, the low-pass filter for force/torque sensor signal has a larger phase delay for high frequency components than that for low frequency components. Hence a controller with low-pass property will help to reinforce the closed-loop stability by suppressing high frequency oscillations. The integral property of the damping controller makes it conform to the two requirements above. Therefore the damping control method is used to achieve compliance in the roll and the pitch rotations in this paper.
Given that the reference torque is set to zero, the angular velocity is calculated as
z(t) =
2 a1t + Zq,
12 — a2(t - tt )2 + z ,
2 2 ^ turn' max '
—a3(t - tu )2 + z ,
2 3 V turn' max '
2 a^ - Tstp )2 + ^
t, < t < tu
1 turn
t > tu
z = max{zn,zA + h .,
max 1 0' 1' tray
q(t) = DMmea (t),
where D is the given damping coefficient, and Mmea is the measurement of the torque corresponding to the rotation. Subscripts indicating roll or pitch are omitted in this section for convenience.
There are two remaining issues to be discussed: 1) how to choose an appropriate damping coefficient D and 2) the terminate condition for the compliance control.
4.1.1 Choosing damping coefficient
0 5T 2( z — z )
t = satn ?ep (T--^-mad.)
turn 0.25T V t t /
step V
where the saturation function sat|j(x) is defined as
Ideally, the adaptation always performs better with a
smaller D, which makes the foot more compliant. However, when taking time delay into consideration, the system will become divergent when D is too small. Thus there is a lower limit for D.
satb (x) =
a, x < a x, a < x < b
b. x > b
Assume that the contact between the sole and the terrain is linear elastic with a spring constant K. And use the notation t for the overall time delay of the control loop. The closed-loop system can then be model as
D0(t) = -K0(t -t).
Discretize Eq. (9) with sampling time Ts and the assumption t = NT, N > 1. We have
D^^- ß(z^) = -Kz-N0(z-1).
The characteristic equation of Eq. (10) is
DzN - DzN-1 + KT =0.
Since the characteristic polynomial is continuous about D, and we know that the system can be stable with a big enough D or unstable with a small enough D, there exists a certain Dmin corresponding to the critical stable condition, which means the system is stable when and only when D Dmin. Dmin should be the maximum D for Eq. (11) to have roots on the unit cycle [23]
Dmm = max{D I $w e R, De'nw - De'(n-1)w + KT = 0}. (12)
to one side of the sole, it can be assumed that K <0.5Kevm. Therefore the compliance control should be applied in stages with different damping coefficients.
4.1.2 Stages and terminate conditions
Ideally, the adaptation completes when the measured torque Mmea crosses zero. However, for two reasons the compliance control should continue in the actual situation: 1) the foot has already overreached the equilibrium position because of the time delay, and 2) the actual pose of the foot will shift for a short interval because of the dynamic deformation of the linkages. Hence the compliance control of the roll/pitch rotation should be applied in two stages with corresponding switch/terminate condition:
1. The damping coefficient D is set to be =0.5D2, where D2 is the damping coefficient value applied in the second stage. The switch condition to the next stage is that the measured torque Mmea crosses zero.
2. D is set to a certain value D2>0.637KevenT. The terminate condition is that the measured vertical force F^"1 has exceeded a threshold value F for a time interval
The solution of Eq. (12) is
2N sin-
-= ^csc^, N e N+.
p 2 4N - 2 (13)
4N - 2
It can be easily proven that
4.2 Feedforward and feedback control of vertical motion
The vertical motion is related to the roll and the pitch rotations during the adaptation, as the contact point about which the foot rotates rarely falls at the center of the sole. A feedforward compensation is therefore designed to improve the performance. The overall control law is
z(t) = Zf (t) + z(t),
N0 sin—p— < limNsin—p— = P, "N0 e N+. (14) 0 4N0 - 2 N®¥ 4N - 2 4 0 K '
From Eq. (13)(14), we have
D . <-Kt, "N e N+
Hence we choose D conservatively with the criterion
D >-Kt » 0.637Kt. p
The value of t can be obtained from the mechanism model of the system. The value of K varies under different contact conditions. Obviously when the foot makes a full contact with an even floor, K reaches its maximum value Keven, which can be identified through shaking the foot on even floor with small amplitude. When the contact is confined
where Zf is the feedforward component and Zjb is the feedback component.
4.2.1 Feedforward controller
To simplify the discussion, relation between the vertical motion and the rotation along one single axis is studied first, as shown in Figure 5.
Ground
Figure 5. Relation between the vertical motion and the rotation of the landing foot
With the sole in continuous contact with the ground, and the derivative of LCoP (t) ignored, we have
V (t) = w(t)Lcop(t)cosq(t).
Then the descending distance since the moment ttouch when the contact began should be
Az(t) = J' w(t)LCoP (t)cos6>(t)dt.
^ touch
However, time delay should be taken into consideration or Eq. (19) will almost certainly overestimate the descending distance. The measured COP position Lap comes after a time delay Tmea, while the commanded angle 6sp is followed with a actuation delay Tact. Hence Eq. (19) becomes
Dz(t) = Jt wsp (t - tact LP (t + zmea )cosq (t - tact )dt. (20)
The right hand side of Eq. (20) contains information from the future. Approximations are needed to estimate the descending distance online. Since the overall time delay t = Tmea + Tact, and cos6 ~ 1 as 6 is usually quite small, we have the estimation
Dzest(t) = J' W(t - t)ECeoP(t)dt.
ttouch
Similarly, when considering both the roll and the pitch rotations,
Vf (t) = [0 01]-[-W(t -t) x pcop (t)] f
Wx (t -t) Px (t) = [0 0 -1]. w (t -t) x Py (t)
J. 0 J LPz(t)_
= Wy (t -t)Px (t) -Wx (t -t)Py (t),
where a is the commanded rotation vector and pCoP is the measured COP position vector. Superscripts indicating measurement or command are omitted for clarity. Therefore the feedforward component is
ze(t)=Jt v:st (t)dt
touch t
= Jt [Wy (t -t)Px (t) -W2 (t -t)Py (t)]dt.
It will be mentioned in the next section that Eq. (19) also constitutes part of the terrain estimator.
4.2.2 Feedback controller
The damping control method is employed in the feedback component of the vertical motion control, just like in the control of the roll and the pitch rotations. The difference is
the reference vertical force Fz!p(t )>0, in order to maintain the foot in contact with the ground. The control law is
zfb (t) = D[Fmea (t) - FS (t)],
F - Fmea (t, h)
FsP(t) = _tm—z v touch' (t - ttouch)
"^touch
+ Fz (ttouch), t ttouch'
where Ttouch is a given time interval. The choosing of Dz follows the similar rule in Eq. (16). And the identification of the vertical spring constant Kz will be discussed in the next section.
5. Correction and Adjustment
As mentioned above, the pose of the landing foot relative to the body calculated through the forward kinematics is not reliable due to the dynamic deformations in the linkages. Meanwhile the pose of the body in the world coordinates is not desired. Thus if holding the commanded pose of the landing foot at the time tjjrm when the adaptation has finished, the robot will deviate from its desired movement and fall down in the following steps. Therefore a more accurate estimation of the terrain is needed to provide the corrected target pose for the supporting foot. The corresponding correction process also needs to be specified.
The height of the COM should adjust to the variation of the terrain in order to maintain the vertical distance between the COM and the terrain. This is the only adjustment of the COM trajectory in this research.
5.1 Terrain estimation
The deviation between the calculated and the actual foot pose relative to the body obeys different rules in different phases:
1. During the supporting phase and the flight phase, including the moment ttouch when the flight phase ends, the deviation concentrates on the vertical displacement, and is proportional to the vertical pressure on the leg.
2. During the touching phase, the deviation can still be deemed to exist only in the vertical displacement. However it is no longer proportional to the pressure because the deformations of the linkages is dynamic for a period after the impact.
Therefore the height estimation is the key point in the terrain estimation. The basic idea is to use the pose at ttouch
calculated through the kinematics as an initial value, and the descending distance calculated from the contact force/ torque information as the increment value, with the body attitude taken into consideration.
Here, we assume the left foot to be the supporting foot and the right foot to be the landing foot. The deviation of the body from its desired pose at ttouch, as shown in Figure 6, is equivalent to rotating the robot about the left foot by the body attitude angle measured by the IMU [10], then lowering the body by the length that the left leg is compressed.
Figure 6. Deviation of the body from its desired pose
The actual position of the right foot in the world coordinates is
WpRi =WpLi +W RB tB-p„ct
at act
W r W r> iBant r Bact r v
= pLc, + RB.t (a pR.t - p^, \
where W pL was obtained in the previous step, and WRB is calculated from the IMU sensor data. The actual foot positions relative to the body remain to be acquired. With the analysis of the deviation above, we have
wRbc„ (-b'pPl.p ) =
WRBc„ (Bac'pRc ~B'ppR,p ) =
where B-rpL and B>rpR are calculated through the kinematics using joint angles. Then the actual position of the landing foot can be further written as
W r W r W T-, Bsp r
p^,, = pLp +( RB„t ppRp +
wRb ^pL +
= WpLp +W\, (B'ppRp -BppLp )
Kz (FzR - FL)
The actual position of the landing foot in the world coordinates at the moment ttouch is then obtainable with Eq. (28).
Method similar to Eq. (19) is used to obtain the descending distance of the landing foot, with additional consideration of the body rotations
WVf (t) = [001]. [-^ (t) xWpCoP (t)]
= [0 0 -1]. {[W W (t) +W Rb,, (t)s wRp (t)] (29)
*[ wRbcc, (t)B'pRR,p (t)RaC'pCoP (t)]}.
With approximations and the time delay, Eq. (29) can be further written as
'V? (t) »[0 0 -1]. {[W ^ (t -1) +Bp Wr ^ (t -1)] *R- p™(t)}.
Thus the position of the landing foot at the moment tfirm is
pRct (tfi rm
) =W pR
f Vf (t)dt
where WpR (ttouch) and WVZest(t) are calculated using Eq. (28) and Eq. (30).
Besides the position estimation, the attitude of the terrain also needs to be estimated. The rotation matrix of the landing foot in the world coordinates at moment tcan be calculated with
RR (tf ) =W RB (t. ) pRR (t. ).
R-.< ^ firm y B... V firm y R_„ V firm'
firm '
The terrain estimation is then achieved using Eq. (31)(32).
The vertical spring constant Kz is obtained through identification. Notice that the vertical elasticity comes from both the contact with the ground and the compression of the leg. Hence Kz is smaller than the elastic coefficient calculated from the Young's modulus of the contact materials. Let the robot walk on an even floor with the original open-loop gait. The actual height of the foot at ttouch must be
6/an. In order to complete the correction in a time interval Tset, we choose
m = —.
Substitute Eq. (37) into Eq. (36), we have 36
G(s) =
T\sl + 12T ts + 36
set set
5.3 Height adjustment
The desired COM height WzB should change according to the variation of the terrain height. It has been proven that when the COM of an inverted pendulum which is supported at the original point, moves within a constraint plane
z = k x + k y + z
x y J c
However, the height calculated through kinematics would be different because of the vertical elasticity. With Eq. (27) and Eq. (33), we have
rBc,:fPsP )
FL - FR
The mean value of the results from multiple trials is then used as K in both the choosing of the vertical damping efficient Dz and the terrain height estimation.
5.2 Correction
With the actual position W pR and the actual attitude wRr obtained, the commanded position WpR and the commanded attitude WRR should be corrected to the actual values, so that the body can be pushed back to its desired trajectory. Define the actual values of the landing foot pose as the reference values
\Pref = VRcc,
K =WR«c
To avoid discontinuities in velocities, a same second-order correction process G(s) is applied in each component of the landing foot pose
G(s) =
s2 + 2Zm s + m2
The damping coefficient Z is set to 1 as overshoot is undesired. The unit step response of a second-order system under critical damping exceeds 0.9 after the moment
the horizontal motion of this inverted pendulum is the same with that of a linear inverted pendulum. Hence a height adjustment strategy similar to the classic stair climbing algorithm is designed, as shown in Figure 7, with the difference that the terrain height is unknown before the landing of the foot. Once the landing foot has made a firm contact with the terrain and becomes the supporting foot, the robot begins to move its COM within the newly calculated constraint plane, until the COM passes the new supporting foot in the forward direction, after which the COM will move within the horizontal plane as the trend of the terrain in the next step is still unknown.
Figure 7. COM height adjustment according to the terrain
6. Experimental Results
Figure 8 shows the humanoid robot Kong and the uneven terrain used in our experiments. The full-size humanoid robot Kong is 161 cm in height and 53 kg in weight with a total DOF of 14 [24]. A six-dimensional force/torque sensor is mounted in each foot. And an IMU is mounted under the waist between two hips, where the COM is considered to be. The amplifiers communicate with the upper computer
through the CAN network. The uneven terrain was built by attaching a 16 mm thick hard plank to a common floor.
Figure 8. The humanoid robot Kong and the uneven terrain used in the experiments
We validated our method by walking experiments with Kong. The walking speed was 0.225 kmph, while the step length was 5 cm. The total step count in each experiment was 12. The first two steps in each experiment didn't use the method proposed in this paper, as to ensure a reliable startup.
Walking experiment on the uneven terrain with the proposed methods was implemented to verify the effectiveness of the methods, as shown in Figure 9. In addition, the walking experiments on an even floor with or without the proposed methods have been compared. The results of walking on the uneven floor without the proposed methods are not shown because the robot fell almost immediately after stepping on the obstacle. The body attitude angles in these experiments are shown in Figure 10 as an indicator of walking stability. The body attitude angles in
Figure 9. Snapshots of the walking experimenton the uneven terrain. Multiple localterraincases wereincluded.
Roll angle of the body
Pitch angle of the body
Figure 10. Body attitude angles of walking on even or uneven terrain with or without the methods proposed in this paper. The start time of the uneven terrain intervention is the moment when the swing foot first touched the uneven terrain. And the end time of the uneven terrain intervention is the moment when the supporting foot left the uneven terrain for the last time.
F on the left foot
......... On even floor without new methods
-On even floor with new methods
' 400 ft":
0 -3.5
Time [s]
Fz on the right foot
......... On even floor without new methods
-On even floor with new methods
Time [s]
Figure 11. Vertical force on each foot when walking on even floor with or without the proposed methods. Only part of the time axis is shown for the clarity of the figure.
Roll angle of the feet and the terrain
....... Left foot roll angle
Right foot roll angle O Referenced terrain roll angle at left foot landing point □ Referenced terrain roll angle at right foot landing point
mnO ........
Time [s]
Pitch angle of the feet and the terrain
....... Left foot pitch angle
Right foot pitch angle O Referenced terrain pitch angle at left foot landing point □ Referenced terrain pitch angle at right foot landing point
...............
567 Time [s]
Height of the feet and the terrain
Time [s]
Figure 12. Estimated and referenced values of the local terrain at each foot landing point. Only part of the time axis is shown for the clarity of the figure. The lines represent the poses of the feet. The markers represent the referenced values of the terrain, whose abscissas correspond the moments when the adjustment finished in each step. Therefore the estimation errors are represented by the vertical distance between the lines and the corresponding markers.
ZMP in X axis
Time [s]
ZMP in Y axis
...... Reference ZMP
-----Measured ZMP on even terrain
-Measured ZMP on uneven terrain
----Start time of uneven terrain intervention
----End time of uneven terrain intervention
¥» 0.1 -
-0.1 - \......
Time [s]
Figure 13. Reference and measured ZMP of walking on even or uneven terrain with the methods proposed in this paper. The start and end time of the uneven terrain intervention are defined in the same way as in Figure 10.
all these experiments fell within about ±2 . When walking on the uneven terrain, the magnitude of the angles increased only slightly comparing to that when walking on even floor. And when walking on the even floor, the results using or not using the proposed methods are similar, with the magnitude of the pitch angle being smaller when using the proposed methods. Thus, it can be claimed that our new methods make the robot capable of walking on uneven terrains stably, without degrading the performance on even floors.
To examine the effectiveness of the foot compliance, the vertical force Fz on each foot in the experiments with or without the proposed methods are compared, as shown in Figure 11. Only results of walking on the even floor are included in this comparison for the consistency of contact conditions. The contacts started earlier when using the proposed methods because the new swing foot trajectories aimed lower than the traditional trajectories. The vertical force control decreased the first peak in every step significantly, and steadied the vertical force during the adaptations, relieving the "pre-landing" phenomenon. As a result of this impact absorption, Fz during the supporting phase became steadier than that in the result without the new methods. Hence, the foot compliance enhanced the walking stability by reducing the impact, and guaranteed the terrain estimation to be effective by maintaining the landing foot in continuous contact with the ground.
We shall then verify the accuracy of the terrain estimation. As shown in Figure 12, the terrain attitude angle estimation
error usually fell within ± 1 with very few exceptions, while the terrain height estimation error usually fell within ±2 mm. The terrain estimation is accurate enough to guarantee the walking stability while maintaining the original horizontal COM trajectory.
Reference and measured ZMP of walking on even or uneven terrain with the proposed methods are shown in Figure 13. The ZMP following errors are noticeable, as only the offline COM trajectory generated by the basic preview control method was applied, while the robot faced the problems like the modelling error and the oscillation caused by the elasticity of the linkages. Stable walking under such condition shows that the proposed methods are not picky about the high-level controller or the hardware platform. It can also be noted that the measured ZMP of walking on the even and on the uneven terrain differed little except for the time shifting caused by the different landing conditions. Therefore the ZMP trajectory can be expected to be maintained under different terrain conditions.
7. Conclusions and Future Work
In this paper, we propose a control algorithm that enables humanoid robots to walk on uneven terrains. The major difference between our algorithm and previous works is that our algorithm is based on an online terrain estimation, which brings the benefit that only minimum modification to the walking gait is required. The instant terrain estimation is achieved by using information from different sensors at different stages, considering that the forward
kinematics is not always reliable because of the deformations in the linkages. In addition, a new swing foot trajectory and a compliant terrain adaptation method for the landing foot are designed to cope with various terrain conditions. We validated our algorithm by walking experiments on the full-size humanoid robot Kong. The results show that the performance of the robot when walking on the uneven terrain is as good as that when walking on the even floor. The effectiveness of the compliant terrain adaptation and the accuracy of the terrain estimation were also verified.
The allowed terrain height variation range [H0 - AHmin,H0 + AHma^\ is currently limited by the hardware performance, which stops the swing foot from accomplishing more adaptable trajectories. We believe our method can handle more challenging terrains on our new hardware platform in the future. And there are still some to improve within the framework of our methods. Slipping between the sole and the terrain is inevitable while walking, which can change the contact conditions especially when causing the toe or the heel to fall from the edge of an obstacle. Methods that recognize such terrain changes and re-adapt the foot to the terrain are therefore required for a better performance. Furthermore, strategies to re-balance the robot should be added to the framework to improve the robustness of the control system.
8. Acknowledgements
This research is supported by the National Foundation of China (Grant No. 51405430, Grant No. 61473258 and Grant U1509210).
9. References
[1] DARPA. DARPA Robotics Challenge Finals 2015 [Internet]. Available from: http://www.therobotic-schallenge.org/.
[2] M. Ogino, H. Toyama and M. Asada (2007) Stabilizing biped walking on rough terrain based on the compliance control. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems: 4047-4052. San Diego, USA.
[3] F. Iida and R. Tedrake (2009) Minimalistic control of a compass gait robot in rough terrain. Proceedings of IEEE International Conference on Robotics and Automation: 1985-1990. Kobe, Japan.
[4] G. Taga (1995) A model of the neuro-musculo-skeletal system for human locomotion. Biological Cybernetics: 73(2), 97-111.
[5] J. Pratt, P. Dilworth and G. Pratt (1997) Virtual model control of a bipedal walking robot. Proceedings of IEEE International Conference on Robotics and Automation: 1, 193-198. Albuquerque, USA.
[6] I. R. Manchester, U. Mettin, F. Iida and R. Tedrake (2011) Stable dynamic walking over uneven terrain.
The International Journal of Robotics Research: 00(000), 1-15.
[7] K. Hashimoto, Y. Sugahara, A. Ohta, H. Sunazuka, C. Tanaka, M. Kawase, H. O. Lim and A. Takanishi (2006) Realization of stable biped walking on public road with new biped foot system adaptable to uneven terrain. Proceedings of IEEE/RAS-EMBS International Conference Biomedical Robotics and Biomechatronics: 226-231. Pisa, Italy.
[8] H. Wei, M. Shuai and Z. Wang (2012) Dynamically adapt to uneven terrain walking control for humanoid robot. Chinese Journal of Mechanical Engineering: 25(2), 214-222.
[9] P. B. Wieber (2006) Trajectory free linear model predictive control for stable walking in the presence of strong perturbations. Proceedings of IEEE-RAS International Conference Humanoid Robots: 137-142. Genova, Italy.
[10] K. Nishiwaki, J. Chestnutt and S. Kagami (2012) Autonomous navigation of a humanoid robot over unknown rough terrain using a laser range sensor. The International Journal of Robotics Research: 31(11), 1251-1262.
[11] M. Rakovic, B. Borovac, M. Nikolic and S. Savic (2014) Biped Walking on Irregular Terrain Using Motion Primitives. Advances on Theory and Practice of Robots and Manipulators: 22, 265.
[12] T. Takenaka, T. Matsumoto, T. Yoshiike, et al. (2009) Real time motion generation and control for biped robot-4 th report: Integrated balance control. Proceedings of IEEE/RSJ International Conference Intelligent Robots and Systems: 1601-1608. St. Louis, USA.
[13] J. H. Park and E. S. Kim (2009) Foot and body control of biped robots to walk on irregularly protruded uneven surfaces Systems. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics: 39(1), 289-297.
[14] A. Herdt, H. Diedam, P. B. Wieber, et al. (2010) Online walking motion generation with automatic footstep placement. Advanced Robotics: 24(5-6), 719-737.
[15] M. Morisawa, S. Kajita, F. Kanehiro, et al. (2012) Balance control based on capture point error compensation for biped walking on uneven terrain. Proceedings of IEEE-RAS International Conference Humanoid Robots: 734-740. Osaka, Japan.
[16] O. E. Ramos, M. Garcia, N. Mansard, et al. (2014) Toward Reactive Vision-Guided Walking on Rough Terrain: An Inverse-Dynamics Based Approach. International Journal of Humanoid Robotics: 11(02), 793-806.
[17] M. Morisawa, N. Kita, S. I. Nakaoka, et al. (2014) Biped locomotion control for uneven terrain with narrow support region. IEEE/SICE International
Symposium on System Integration: 34-39. Tokyo, Japan.
[18] A. Stumpf, S. Kohlbrecher, D. C. Conner and O. von Stryk (2014) Supervised footstep planning for humanoid robots in rough terrain tasks using a black box walking controller. Proceedings of IEEE-RAS International Conference Humanoid Robots: 287-294. Madrid, Spain.
[19] J. Y. Kim, I. W. Park and J. H. Oh (2007) Walking control algorithm of biped humanoid robot on uneven and inclined floor. Journal of Intelligent and Robotic Systems: 48(4), 457-484.
[20] S. J. Yi, B. T. Zhang and D. D. Lee (2010) Online Learning of Uneven Terrain for Humanoid Bipedal Walking. Proceedings of the Twenty-Fourth AAAI Conference Artificial Intelligence: 1639-1644. Atlanta, USA.
[21] S. Kajita, F. Kanehiro, K. Kaneko, et al. (2003) Biped walking pattern generation by using preview
control of zero-moment point. Proceedings of IEEE International Conference Robotics and Automation: 2, 1620-1626. Taipei, China.
[22] M. Morisawa, F. Kanehiro, K. Kaneko, et al. (2011) Reactive biped walking control for a collision of a swinging foot on uneven terrain. Proceedings of International Conference Humanoid Robots: 768-773. Bled, Slovenia.
[23] K. Gu, J. Chen and V. L. Kharitonov (2003) Stability of time-delay systems, Springer Science & Business Media.
[24] Y. Wang, R. Xiong, Q. Zhu, and J. Chu (2014) Compliance control for standing maintenance of humanoid robots under unknown external disturbances. Proceedings of IEEE International Conference Robotics and Automation: 2297-2304. Hong Kong, China.
