Wav is basically a raw audio format,
mp3 is an older comression format.
WMA is as glc said is a microsoft format made to compete with real audio and mp3, its compression makes files a bit smaller.
other formats: VQF its a new format that offers smaller files then mp3, but it takes more cpu power to play the songs. more info:
http://www.vqf.com