If you log out with them closed, like if you were dead, then that is the desktop that gets saved. (I know because I have had to do self-rescues more than once.
) The way to fix that is to get it all set up nice and pretty, the way you like it, and then log out. When you log back in, it should be fixed.
Other than the dying thing, I haven't experienced that problem just yet.