<html>
<p><img src="https://image.slidesharecdn.com/vectorspaces-basissem2icb12015-150717172138-lva1-app6892/95/vector-spaces-19-638.jpg?cb=1437153823" width="638" height="479"/></p>
<p> Hello it's me again! Today we will continue with<strong> Linear Algebra </strong>getting into <strong>Vector Spaces </strong>and <strong>Subspaces</strong>. We will talk about a lot of <strong>basics </strong>today. In the next post we will get into more interesting stuff. :) So, without further do let's get started!</p>
<h1>Linear Vector Space:</h1>
<p> Vector spaces are the <strong>generalization</strong> of the classic 2d and 3d vectors that most off you may already know from math in school. So, the 2d and 3d vectors are also vector spaces. We are talking about a <strong>definition field of R^n</strong>, cause each "dimension" is in the<strong> real number set R</strong> and so if we have n numbers we have a R set for each.</p>
<p>We define a <strong>vector space</strong> like that:</p>
<p><em>R^n = { (x1, x2, ..., xn): xi is in R and i = 1, 2, ..., n }</em></p>
<p>where n is the number of dimensions, xi is the variable/value for each dimension and i is representing each dimension.</p>
<p> To make it more clear for you in <strong>3-dimensional vector spaces</strong> we commonly use the names x, y and z for the variables and so this vector space looks like this:</p>
<p><em>R^3 = { (x, y, z): x, y, z are in R}</em></p>
<p>So, we can have for example (π, 1.52, 7) be a <strong>vector </strong>inside of this space.</p>
<p>After 3-dimensions we use xi simply instead of using more letters.</p>
<h2>Basic Vector Operations:</h2>
<p>For all the vector spaces we specify an <strong>addition </strong>and an <strong>scalar multiplication</strong>. </p>
<p><strong>Addition:</strong></p>
<p> If we have 2 vectors v1 = (x1, x2, ..., xn) and v2 = (y1, y2, ... , yn) inside of the same R^n vector space the addition looks like this:</p>
<p><em>v1 + v2 = (x1, x2, ..., xn) + (y1, y2, ..., yn) = (x1 + y1, x2 + y2, ..., xn + yn)</em></p>
<p>So, we simply add the corresponding dimension values.</p>
<p><strong>Scalar Multiplication:</strong></p>
<p> If we have a vector v = (x1, x2, ..., xn) and an constant k inside of R then scalar multiplication looks like this:</p>
<p><em>k*v = k * (x1, x2, ..., xn) = (k*x1, k*x2, ..., k*xn)</em></p>
<p>So, we simply multiply each dimension value with the constant.</p>
<p><strong>Properties</strong>: </p>
<ul>
<li>v + w = w + v (<strong>commutative property</strong>)</li>
<li>(u + v) + w = u + (v + w) (<strong>associative property of addition</strong>)</li>
<li>0 + v = v = v + 0 (we have a <strong>0-vector</strong> that is the <strong>neutral element of addition</strong>)</li>
<li>v + (-v) = 0 (we have a <strong>opposite -v</strong> for each vector)</li>
<li>1*v = v (<strong>1</strong> is the <strong>neutral element of multiplication</strong>)</li>
<li>k (v + w) = kv + kw (<strong>distributive vector property</strong>)</li>
<li>(k + l) v = kv + lv (<strong>distributive scalar property</strong>)</li>
<li>(k l) v = k(lv) (<strong>associative property of multiplication</strong>)</li>
</ul>
<p>where<strong> v, w, u are vectors</strong> and <strong>k, l are constants</strong>.</p>
<p><br></p>
<p> Adding those 2 operations we actually created a relation or function between 2 vector spaces, also called linear function, but I will get into that stuff some posts later on.</p>
<h2>Matrix Space:</h2>
<p> All those operations and properties apply to the matrix space as well. And so matrixes have also an addition and a scalar multiplication operation.</p>
<p>So, having A(aij) and B(bij) be m*n matrixes we have:</p>
<ul>
<li>A + B = (aij) + (bij) = (aij + bij)</li>
<li>kA = k(aij) = (k*aij)</li>
</ul>
<p> Those 2 are actually the addition and scalar multiplication we already talked about posts before, but I wanted to point it out here so that you get a better understanding of what an vector space is. You can see that a matrix is also a vector space!</p>
<h2>Other vector spaces:</h2>
<p> Vector spaces are also <strong>Sets</strong>, <strong>Polynomials </strong>and even <strong>Sequences</strong>. But, you might now wonder, well if everything is an vector space then what's the point of having them? Let me first point out that not everything<em> </em>is an vector space. A space is a vector space only if it follows the properties I told you before. So, we might have <strong>a space</strong> (mostly subspace that we will get in a sec) <strong>that</strong> may look like it <strong>follows the properties and operations</strong>, but the <strong>result of addition or multiplication doesn't belong to it's space or definition field</strong>.</p>
<p> What I mean by that is that we will always have to <strong>prove </strong>that the addition and scalar multiplication give us a result that is what we expected it to be by following the main definitions we talked about today.</p>
<p>These properties are used to define if a space is a vector space:</p>
<ul>
<li><em>(k - l)v = kv - lv</em> (k, l in R and v vector of vector space V)</li>
<li><em>0*v = 0</em> (v vector of vector space V, this is very important property that will help us later on, cause if a given subspace doesn't contain the 0-vector we know that it's actually not a subspace)</li>
<li><em>k*0 = 0</em> (where k is a constant and so a 0-vector multiplied with any constant gives itself)</li>
<li><em>-1*v = -v </em>(where v is a vector of vector space V and -1 is the opposite)</li>
</ul>
<p><br></p>
<h1>Linear Subspace:</h1>
<p> A <strong>subspace contains a part of a vector space</strong>, as you might already thought of. So, when having a <strong>vector space V and W</strong> (both not empty) and <strong>W is a subspace of </strong>V then:</p>
<ul>
<li>zero-vector 0 is part of W (cause i'ts also part of V)</li>
<li>the sum u + v of 2 vectors u, v of W is also a vector of W</li>
<li>the scalar multiplication of a vector u of W with a constant k of R is also a vector of W</li>
</ul>
<p> So, we will always first check if a subspace contains the 0-vector and then try out the addition and scalar multiplication operations to see if they give us an vector that is also a part of this subspace.</p>
<p><br></p>
<p>Let's get into 2 examples so that you understand what we have to do.</p>
<p><strong>Example 1:</strong></p>
<p> Suppose we have the R^4 vector space and a space/set W = { (s, 0, t, 2s - 3t): s, t in R}. We will proof that this space is not a set, but an subspace.</p>
<p>First of all, when s = t = 0 we have (s, 0, t, 2s - 3t) = (0, 0, 0, 0) and so the 0-vector is part of W.</p>
<p>Now into addition. Let's use (s, 0, t, 2s - 3t) and (s', 0, t', 2s' - 3t') as vectors of W.</p>
<p>(s, 0, t, 2s - 3t) + (s', 0, t', 2s' - 3t') = (s + s', 0, t + t', 2(s + s') - 3(t + t')) that is a vector of W.</p>
<p>For multiplication let's use a constant k of R and vector (s, 0, t, 2s - 3t).</p>
<p>k*(s, 0, t, 2s - 3t) = (k*s, 0, k*t, 2ks - 3kt) that is also a vector of W.</p>
<p>So, we proofed that W is a subset of R^4.</p>
<p><br></p>
<p><strong>Example 2:</strong></p>
<p> Suppose we have the R^3 vector space and a space/set P = { (x, y, z): x + 2y - 3z = -1}. We will proof that this set is not a subspace of R^3.</p>
<p> We actually just have to say that the line x + 2y - 3z = -1 doesn't go through the center point (0, 0, 0) and so this set doesn't contain the 0-vector and so can't be a subspace of R^3.</p>
<p><em> So, whenever we see a line of kx + ly + mz = c != 0 then we know that this is not a subspace. In the same way if it's equal to 0 it is a subspace!</em></p>
<p><br></p>
<h2>Nullspace and Range:</h2>
<p>Let's get back to the matrix space.</p>
<p>Suppose A that is a mxn matrix that is a vector space of R^n then we have</p>
<p><em>N(A) = {X in R^n: AX = 0}</em></p>
<p>where <strong>N(A) is an subspace of R^n</strong>.</p>
<p> We call this set the <strong>nullspace of A</strong> and <strong>this space contains the solutions of the linear system A represents if this system was homogeneous</strong>.</p>
<p>Another important set is the so called<strong> range of A</strong>.</p>
<p><em>R(A) = {b in R^m: AX = b for some X in R^n}</em></p>
<p><strong> R(A) is a subspace of R^m</strong> and <strong>contains the constant column of the linear system that matrix A represents</strong>.</p>
<p><br></p>
<p><strong>Example:</strong></p>
<p> Let's get the set W = { (s, 0, t, 2s - 3t):s, t in R } again. This set is a subspace of R^4 as we already proofed before. Let's also suppose a matrix A where R(A) = W. So, W is the range of A.</p>
<p>Let's try to find out A.</p>
<p>R(A) = {b in R^4: AX = b for X = [s t]^T (transpose) in R^2}</p>
<p> If we think about matrix multiplication and having X be 2x1 (because of s, t) and knowing that b is 4x1 we know that A must be 4x2, cause 4x2 * 2x1 = 4x1. (that 2's get "eliminated")</p>
<p>That way we now have that:</p>
<p>A * [s t]^T = [s 0 t 2s-3t] ^T</p>
<p>S0, the rows of A (suppose they have a, b values) are:</p>
<p>1 0, cause a*s + b*t = s and so a = 1 and b = 0</p>
<p>0 0, cause a*s + b*t = 0</p>
<p>0 1, cause a*s + b*t = t and so a = 0 and b = 1</p>
<p>2 -3, cause a*s + b*t = 2s - 3t and so a = 2 and b = -3</p>
<p>That way we now know that A is the following matrix:</p>
<p><img src="https://s1.postimg.org/5i4ebq9sdr/A_matrix.jpg" width="73" height="128"/></p>
<p>Purrfect artwork :P</p>
<p><br></p>
<p>I hope that I got you into the vector space world in a way that helped you understand it.</p>
<p>This is actually it for today and I hope you enjoyed it!</p>
<p>Bye!</p>
</html>