As in this thread:
http://forums.karamasoft.com/ShowPost.aspx?PostID=8446
I found I could not preview images in the server explorer dialog. Then I discovered that I could, as long as they were gif images, but only gifs... in my aspx page when setting up the editor I had this property set:
ImageFileTypes="jpg|jpeg|gif|png"
I discovered that by removing this, the image preview magically started working with all file types - but with it in, only gif images would preview.
ImageFileTypes="*" also results in no previews. The only way to make the preview pane work is by leaving this property out altogether.
It would be nice to have this property set, to stop users being silly, but as it is I will have to leave it out...