Linear Combination and Linear Independence

Linear Combination and Linear Independence

Definition

  1. The expression $c_1\mathbf{v}_1+c_2\mathbf{v}_2+\cdots+c_k\mathbf{v}_k$ is called a linear combination of vectors $\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_k\in \R^n$, where $c_1, c_2, \dots, c_k$ are scalars in $\R$.
  2. A set of vectors $\{\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_k\}$ is said to be linearly independent if the only scalrs $c_1, c_2, \dots, c_k$ satisfying $c_1\mathbf{v}_1+c_2\mathbf{v}_2+\cdots+c_k\mathbf{v}_k=\mathbf{0}$ are $c_1=c_2=\cdots=c_k=0$. We also say that the vectors $\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_k$ are linearly independent.
  3. If vectors are not linearly independent, they are linearly dependent.
Summary

  1. The set of $n$-dimensional vectors $\{\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_k\}$ are linearly dependent if $k > n$. (If there are more vectors than the dimension, then the vectors are linearly dependent.)

=solution

Problems

  1. Express the vector $\mathbf{b}=\begin{bmatrix}
    2 \\
    13 \\
    6
    \end{bmatrix}$ as a linear combination of the vectors
    \[\mathbf{v}_1=\begin{bmatrix}
    1 \\
    5 \\
    -1
    \end{bmatrix},
    \mathbf{v}_2=
    \begin{bmatrix}
    1 \\
    2 \\
    1
    \end{bmatrix},
    \mathbf{v}_3=
    \begin{bmatrix}
    1 \\
    4 \\
    3
    \end{bmatrix}.\] (The Ohio State University, Linear Algebra Exam)

  2. For what value(s) of $a$ is the following set $S$ linearly dependent?
    \[ S=\left \{\,\begin{bmatrix}
    1 \\
    2 \\
    3 \\
    a
    \end{bmatrix}, \begin{bmatrix}
    a \\
    0 \\
    -1 \\
    2
    \end{bmatrix}, \begin{bmatrix}
    0 \\
    0 \\
    a^2 \\
    7
    \end{bmatrix}, \begin{bmatrix}
    1 \\
    a \\
    1 \\
    1
    \end{bmatrix}, \begin{bmatrix}
    2 \\
    -2 \\
    3 \\
    a^3
    \end{bmatrix} \, \right\}.\]
  3. Let $\{\mathbf{v}_1, \mathbf{v}_2, \mathbf{v}_3\}$ be a set of nonzero vectors in $\R^m$ such that the dot product $athbf{v}_i\cdot \mathbf{v}_j=0$ when $i\neq j$. Prove that the set is linearly independent.

  4. Determine whether the following set of vectors is linearly independent or linearly dependent. If the set is linearly dependent, express one vector in the set as a linear combination of the others.
    \[\left\{\, \begin{bmatrix}
    1 \\
    0 \\
    -1 \\
    0
    \end{bmatrix}, \begin{bmatrix}
    1 \\
    2 \\
    3 \\
    4
    \end{bmatrix}, \begin{bmatrix}
    -1 \\
    -2 \\
    0 \\
    1
    \end{bmatrix},
    \begin{bmatrix}
    -2 \\
    -2 \\
    7 \\
    11
    \end{bmatrix}\, \right\}.\]
  5. Find the value(s) of $h$ for which the following set of vectors
    \[\left \{ \mathbf{v}_1=\begin{bmatrix}
    1 \\
    0 \\
    0
    \end{bmatrix}, \mathbf{v}_2=\begin{bmatrix}
    h \\
    1 \\
    -h
    \end{bmatrix}, \mathbf{v}_3=\begin{bmatrix}
    1 \\
    2h \\
    3h+1
    \end{bmatrix}\right\}\] is linearly independent.
    (Boston College)

  6. Let
    \[\mathbf{v}_1=\begin{bmatrix}
    1 \\
    2 \\
    0
    \end{bmatrix}, \mathbf{v}_2=\begin{bmatrix}
    1 \\
    a \\
    5
    \end{bmatrix}, \mathbf{v}_3=\begin{bmatrix}
    0 \\
    4 \\
    b
    \end{bmatrix}\] be vectors in $\R^3$. Determine a condition on the scalars $a, b$ so that the set of vectors $\{\mathbf{v}_1, \mathbf{v}_2, \mathbf{v}_3\}$ is linearly dependent.

  7. Determine conditions on the scalars $a, b$ so that the following set $S$ of vectors is linearly dependent.
    \begin{align*}
    S=\{\mathbf{v}_1, \mathbf{v}_2, \mathbf{v}_3\},
    \end{align*}
    where
    \[\mathbf{v}_1=\begin{bmatrix}
    1 \\
    3 \\
    1
    \end{bmatrix}, \mathbf{v}_2=\begin{bmatrix}
    1 \\
    a \\
    4
    \end{bmatrix}, \mathbf{v}_3=\begin{bmatrix}
    0 \\
    2 \\
    b
    \end{bmatrix}.\]

  8. (a) Prove that the column vectors of every $3\times 5$ matrix $A$ are linearly dependent.
    (b) Prove that the row vectors of every $5\times 3$ matrix $B$ are linearly dependent.