The American Mathematical Society runs a monthly column called ‘What’s New In Math,” featuring topics of general interest to their readers. In October 2002, the topic was data compression, which led to a fairly lengthy column with many, many references. Good reading!

http://www.ams.org/new-in-math/cover/compression1.html