Chrome opened public extensions just a few days ago and already the quality of extensions available are awesome.

Take a look at the Google Mail Checker Plus extension. The preview window itself is awesome and it works for GAFYD as well.