We return to the derivative algebras to highlight how the matrix derivative operation on a group is closely related to its Lie algebra . For an exponential function defined as , its derivative with respect to the variable is
(1.2.92)
and we would like to show that this holds for the derivatives of our groups , which has the differential representation
(1.2.93)
for and . So, the variable is now equal to the scalar value, which forms a product with the variables to represent the matrix entries for any Lie algebra set To maximize the intuition underlying matrix-by-scalar derivatives of the group , we use the diagonalization decomposition technique. Taking the Lie algebra, as an example, a generalized representation of the eigenvector/eigenvalue decomposition is the expression
(1.2.94)
for which the exponential mapping of its diagonal matrix of eigenvalues is
(1.2.95)
and its derivative, , evaluates to
(1.2.96)
Calculating the matrix logarithm of is straightforward in this diagonalized form
(1.2.97)
with which the derivative algebra can now be determined by the product
(1.2.98)
which simplifies to
(1.2.99)
Like our other derivative algebras, is defined by its anti-derivative Lie algebra in addition to the derivative-induced phase-shifts. The exponential mapping of this derivative algebra yields the following matrix group
(1.2.100)
which, after factoring out the terms, becomes
(1.2.101)
and it is important to keep in mind the equivalences: . We proceed by solving the left-hand side of the following matrix-product equation
(1.2.102)
finding that
(1.2.103)
and since is a complex-valued scalar term, the left-hand side is equal to
(1.2.104)
Next, we multiply both sides of the expression by the group
(1.2.105)
and by 1.2.98, we have that
(1.2.106)
which shows the generalized group differential expression
(1.2.107)
holds for the -type algebras. It is straightforward to show that this holds for all -type algebras, seen by utilizing the definition of the matrix-by-scalar derivative for
(1.2.108)
and for
(1.2.109)
Given that , the higher-order derivatives for the -type algebras will then have the form
(1.2.110)
where the in the superscript of represents the derivative's order. It turns out that derivatives of the -type algebras will all behave similarly. Using the example of a -type algebra, the generalized group has the matrix representation
(1.2.111)
where the cyclic trigonometric functions in their expanded forms are
(1.2.112)
(1.2.113)
(1.2.114)
Calculating the matrix group derivative first requires evaluating the individual derivatives of the cyclic trigonometric functions. Starting with the function, the derivative is found to be
(1.2.115)
which is equal to the product of with the left modulo function, seen in the group representation from Eq. 1.2.108. As expected, the derivatives for the other two functions are similar
(1.2.116)
(1.2.117)
After factoring out the uniform scalar multiplier , can be represented as
(1.2.118)
which represents a scaled by cyclic rightward shift of the group's elements. This cyclic shift is simply due to the algebra's action on , seen by the product
(1.2.119)
and we have shown that the following relationship holds for the -type algebras
(1.2.120)
The group differs from the by variable choice and by the swapping of the and functions in its matrix representation
(1.2.121)
The derivative of has the form
(1.2.122)
which represents a matrix scaled by , with a cyclic leftward shift of the initial elements. This oriented shift is the result of the -algebra's action on , which together with the scalar represents the product
(1.2.123)
showing that
(1.2.124)
also holds for derivatives of . Derivatives of the group are trivial, given that the algebra is the identity, where these reduce to
(1.2.125)
which is equivalent to . Given that , the higher-order derivatives for the -type algebras also adhere to the form
(1.2.126)
where the in the superscript of represents the derivative-order. It needs to be clarified that the product turns out to be a commutative one, meaning which can be represented as the left and right-sided products of with , a cyclic-structured matrix
(1.2.127)
(1.2.128)
and the commutativity in this example is due to the cyclic nature of both matrices. We should not assume commutativity holds between and non-cyclic matrix representations, seen by left and right-sided products of with the algebra
(1.2.129)
(1.2.130)
Upon ending this section, we call attention to a significant result that is present in the derivative algebras, which is that for , phase-shifts will be present for , and for in the non-axis diagonal entries of the derivative algebras, except when is purely unitary-imaginary valued. Using the example
(1.2.131)
when , we find that the non-axis diagonal elements evaluate to
(1.2.132)
Evaluating the general case for , this will simplify by first converting into polar coordinates
(1.2.133)
which, depending on the values of , the function evaluates per the following
(1.2.134)
So, when and is non-zero, becomes
(1.2.135)
and evaluating the logarithm term
(1.2.136)
indicates the entry is zero-valued only when is unitary in magnitude. When is non-unitary in magnitude and is non-zero, the logarithm term becomes the following
(1.2.137)
and using the two polar form possibilities, and , there are two possible results for
(1.2.138)
The logarithm term will then evaluate to one of the two following possibilities
(1.2.139)
(1.2.140)
both of which will be solely imaginary-valued, except when the radial modulus in the term is non-unitary. This result shows that derivatives of matrix groups have derivative Lie algebras that exist in complex space, and with our knowledge about the derivative operations on the matrix groups, we are now prepared to consider tangent spaces. The reader should consider the Lie algebra to be the kernel of the group it becomes through the exponential mapping. The term kernel is appropriate because it contains the group's properties and given the role it plays in the group derivative, it guides the said group's dynamics.