Matrix Spaces
A Matrix space is a Vector Space where elements are matrices
E.g. Space $M$ - $3 \times 3$ matrices
- any $3 \times 3$ matrix an element of this space $M$ ("vector" in $M$)
- we can multiply by a scalar and add two matrices - which is why we can call it "vector space"
Subspaces of the matrix space should form a space on their own.
- What are subspaces of the matrix space?
- All upper-triangular matrices
- all symmetric matrices
- diagonal matrices (upper-triangular $\cup$ symmetric)
What about bases for such spaces?
E.g. $M$: $3 \times 3$ matrices:
1 & 0 & 0 \\
0 & 0 & 0 \\
0 & 0 & 0 \\
\end{bmatrix},
\begin{bmatrix}
0 & 1 & 0 \\
0 & 0 & 0 \\
0 & 0 & 0 \\
\end{bmatrix},
\begin{bmatrix}
0 & 0 & 1 \\
0 & 0 & 0 \\
0 & 0 & 0 \\
\end{bmatrix}, ... ,
\begin{bmatrix}
0 & 0 & 0 \\
0 & 0 & 0 \\
0 & 0 & 1 \\
\end{bmatrix}$
- $\text{dim}\big( M \big) = 9$
$S$ - subspace of $M$, symmetric $3 \times 3$ matrices
- $\text{dim}\big( S \big) = 6$ - because only 6 elements change in this subspace
$U$ - subspace of $M$ with upper-diagonal matrices
- $\text{dim}\big( U\big) = 6$ as well - same reason (but have zeros for the upper corner)
$S \cup U$ - symmetric and upper-diagonal $\Rightarrow$ diagonal matrices
- $\text{dim}\big( S \cup U\big) = 3$
$S \cap U$
- not a subspace:
- $S$ is 6-dim, $U$ is 3-dim
$S + U$
- any matrix from $S$ plus any matrix from $U$
- this way we can get possible matrix
- so it's also a subspace
- $\text{dim}\big( S + U\big) = 9$
rule:
- $\text{dim}\big( S \big) + \text{dim}\big( U \big) = \text{dim}\big( S \cap U \big) + \text{dim}\big( S + U \big)$
How do we define the inner product?
- Element-wise: $\langle A, B \rangle = \sum_{ij} a_{ij} b_{ij}$
- then the norm based on this product is $\| A \|_F = \langle A, A \rangle$, it's called the Frobenius Norm.
Sources