Andrew's answer is very good. However, I'm going to describe abstraction slightly differently.
When we're doing mathematics, we often notice similarities in different subfields. Abstraction can be thought of ignoring the differences. We define a new concept in terms of the similarities only and give it a name so that we can talk about it independently of any particular instance.
The hard part is that it's sometimes not clear what the similarities are or how we can express them independently. It took half a century, for example, to come up with category theory, which is probably the most powerful abstraction language yet found.
This is my excuse for answering this question. Since you're self-learning, I wanted to give you just a little picture of just how powerful abstraction can be.
First, let's consider sets.
Suppose that $A$ and $B$ are finite sets. Then the number of functions with domain $A$ and codomain $B$ is $|B|^{|A|}$.
Now let's think about the empty set $\emptyset$ for a moment.
For any non-empty finite set $A$, how many functions are there with domain $A$ and codomain $\emptyset$? Well, it's just $0^{|A|}$, which is $0$. There are no functions $f$ such that $f : A \rightarrow \emptyset$ if $A$ is nonempty.
What about the other way? How many functions are there with domain $\emptyset$ and codomain $A$? Well, it's $|A|^0$, which is $1$. There is exactly one function $f$ such that $f : \emptyset \rightarrow A$.
Note that the above argument also applies to infinite set, however we also need to consider the case $f : \emptyset \rightarrow \emptyset$. By convention, when doing combinatorics, $0^0 = 1$, and it turns out (if, for example, you consider the graph of the function) it makes sense to do this too.
The empty set is the only set with the following property:
For any set $A$, there is exactly one function $f$ such that $f : \emptyset \rightarrow A$.
Now, let's think about logic.
For logic, I'm going to use some notation that may be unfamiliar at the high school level. Given two propositions $A$ and $B$, we will denote $A \vdash B$ (pronounced "$A$ entails $B$", or "$A$ yields $B$") to mean that given the premise $A$, you can conclude $B$.
The proposition $\hbox{False}$ has the interesting property that from that premise, you can prove anything; this is known as ex falso quodlibet, or the principle of explosion.
But more than that, if you formalise the notion of what constitutes a "distinct proof" very carefully, you can show that $\hbox{False}$ is the only proposition with this property:
For any proposition $A$, there is exactly one proof of $\hbox{False} \vdash A$.
There's an abstraction to be discovered here.
In category theory, an object with this property is known as an "initial object". There is also the dual notion of a "terminal object", that is, an object $T$ such that for any other object $A$, there is exactly one "arrow" such that $A \rightarrow T$. It won't surprise you to learn that $\hbox{True}$ is the unique terminal object in logic.
There is also a terminal object in sets, and it's actually the "singleton set", that is, the set with only one element in it. Of course, I say "the" singleton set as if there's only one, when you can probably think of lots.
In category theory terms, we say that all singleton sets are isomorphic. They all have the same "shape", much like in Andrew's group theory example, where all the groups have the same "shape". You can think of them as different "physical" groups, or you can think of them as the same abstract group.
Informally, you can't tell the difference between any two singleton sets without looking inside the set to see what the element is. That's the price you pay for abstraction: the actual element inside the set is an irrelevant detail that you're abstracting away.
But what you gain is that it's possible to prove a theorem which is true of both sets-and-functions and propositions-and-proofs. An example of such a theorem is: "All initial objects are identical up to isomorphism." That's a very abstract statement, but you should now have an idea just how powerful that statement is.
Incidentally, since group theory has already come up, the "trivial group" (i.e. the group with one element) is both an initial object and a terminal object, which makes it very interesting indeed. That's a topic for another time.