When skin warts appear, it can seem as if the harmless growths came out of nowhere. But common warts are actually an infection in the top layer of skin, caused by viruses in the human papillomavirus, or HPV, family. ... And most people will have at least one common wart at sometime in their lives, usually on their hands.