Rather than describe how to do so myself, though, I will try something different. Vectors are important in much of physics, and so lots of people have already written much about them. Thus, for the bulk of the work in describing vectors, I will defer to these other writings. A very physics-oriented approach can be found over at Dot Physics, starting with a trig-based introduction to vectors, followed by a discussion of how to represent vectors. An alternate physics-motivated discussion of vectors can be found at HyperPhysics.
For the more mathematically motivated amongst us, Wikipedia has a good page describing a very special family of vector spaces called ℝn that is used to describe points in Euclidean space. MathWorld has a few good articles on vectors, including a technical definition and listing of properties and a more concise listing of the vectorspace axioms. Finally, the Unapologetic Mathematician derives vectorspaces from a more general construction called a module (warning: not for the feint of math).
To understand why we care about vectors in quantum information and computation, however, takes one more observation. A quantum state can be written as a linear combination of some set of basis states. For example, an arbitrary qubit state can be written as