When the inside of your mouth gets hurt or irritated, bacteria may enter and cause an infection. These infections can turn into an asbcess of the gum or tooth. The abscess is your body creating a barrier around the area to keep the infection from spreading. These infections do not go away on their own, so be aware of the symptoms and seek a dental expert immediately.