
II. PRELIMINARIES
A hybrid dynamical system is composed of a continuous
flow generated by a vector field, and a discrete reset map
which is activated whenever the flow intersects the guard.
The specific definition used throughout is given below.
Definition 1: A hybrid dynamical system is a 4-tuple,
H= (M, S, X, ∆) where
1) Mis a (finite-dimensional) manifold,
2) S ⊂ Mis an embedded co-dimension 1 submanifold,
3) X:M→T M is a vector-field, and
4) ∆ : S → Mis a map.
Throughout this work all of the data will be assumed to be
sufficiently smooth. The manifold Mwill be referred to as
the state-space,Sas the guard, and ∆as the reset.
The equations of motion for the hybrid system are char-
acterized by their constituent discrete and continuous parts.
Off the guard S, the hybrid flow will evolve according to the
vector field. Whereas on S, the hybrid flow instantaneously
jumps according to the reset map ∆.
(˙x(t) = X(x(t)), x(t)6∈ S,
x(t+) = ∆(x(t−)), x(t−)∈ S.(4)
The major qualitative feature that is unique to hybrid systems
is that of Zeno.
Definition 2: Let φH
tbe the flow of (4). Then a point
x∈Mhas a Zeno trajectory if there exists an increasing
sequence of times {ti}∞
i=1 such that φH
ti(x)∈ S for all iand
the limit limi→∞ ti=t∞exists and is finite.
In order to provide a theoretical framework for performing
optimal control in the context of hybrid systems, we extend
the notion of a hybrid dynamical system (Definition 1) to
include a control variable, denoted by u, to the continuous
component of the dynamics. No control over either the reset
or guard will be assumed.
Definition 3: A hybrid control system is a 5-tuple, HC =
(M, U,S, X, ∆) where
1) Mis a (finite-dimensional) manifold,
2) S ⊂ Mis an embedded co-dimension 1 submanifold,
3) U ⊂ Rmis a closed subset of admissible controls,
4) X:M×V→T M is where U ⊂ Vis an open
neighborhood, and
5) ∆ : S → Mis a map.
Again, it will be implicitly assumed that all the data are
sufficiently smooth.
The optimal control problem of interest will be the fol-
lowing.
Problem 1: For a given a hybrid control system
(M, U,S, X, ∆), minimize the cost functional:
J:M× U[0,Tf]×[0, Tf]→R,
J(x0, u(·), s) = ZTf
s
(x(t), u(t)) dt,
subject to the boundary conditions x(s) = x0and x(Tf) =
xf, along with the controlled dynamics
(˙x(t) = X(x(t), u(t)), x(t)6∈ S,
x(t+) = ∆(x(t−)), x(t−)∈ S.
III. HYBRID MAXIMUM PRINCIPLE
As Problem 1 obeys the principle of optimality, it is
amendable to the usual ideas of optimal control theory; there
exists both a hybrid Hamilton-Jacobi-Bellman equation [14]
and a hybrid maximum principle [10], [11], [12]. Although
it will only provide necessary conditions, we will use the hy-
brid maximum principle to study Problem 1. The continuous
part of the optimal trajectory follows the flow of the optimal
Hamiltonian, just as in the classical, non-hybrid, case. For
hybrid control system HC = (M, U,S, X, ∆) with cost
functional Jand running cost , the optimal Hamiltonian,
ˆ
H:T∗M→R, is given by:
ˆ
H(x, p) = min
u∈U
˜
H(x, p, u)
= min
u∈U(x, u) + hp, X(x, u)i,
where hp, Xidenotes the natural pairing between a co-vector
and a vector. At impacts, the optimal flow is discontinuous.
As the state variables jump according to the reset map, ∆,
the co-states jump according to the extended reset map,˜
∆,
which satisfies:
Id ט
∆∗
ϑˆ
H=ι∗ϑˆ
H,(5)
such that the following diagram is commutative
R× S∗R×T∗M
R× S R×M
Idט
∆
Id×πMId×πM
Id×∆
where ϑˆ
H=pi·dxi−ˆ
H·dt is the action form, πM:T∗M→
Mis the cotangent projection, and ι:S∗→T∗Mis the
inclusion map of the extended guard,
S∗=(x, p)∈T∗M|S:dhx∂H
∂p >0.
The hybrid maximum principle states that a necessary
condition for a trajectory, x(t), to be a solution to Problem
1, it must have the form x(t) = πM(γ(t)) where γ(t)is an
integral curve of
˙x=∂ˆ
H
∂p ,˙p=−∂ˆ
H
∂x , x 6∈ S,
(x+, p+) = ˜
∆(x−, p−), x ∈ S,
such the boundary conditions are satisfied: πM(γ(0)) = x0
and πM(γ(Tf)) = xf.
Under the assumption that there exists a unique extended
reset map that satisfies the conditions above (one does not
generally expect this to be true; see [13] for a more detailed
analysis on issue), along with some regularity assumptions,
it can be proved that the set of integral curves obeying
the hybrid maximum principle that are Zeno have measure
zero. However, this does not imply that the actual optimal
trajectory will not be Zeno in any specific example. Indeed,
in the next section we show that the Zeno phenomena is
present even in the simple case of a bouncing ball.