Here is an open-source very curious: how to build your own mp3 player
The site is also provided firmware (open-source of course) and many photos.

The cost should be around $ 20 but I saw the best items on ebay / similar at the same price, and more than a pastime, I do not know how useful it is to use it.