Is it possible to move the alert behind the other windows to read it later?

No, alerts are always displayed on top of other windows. You can re-view closed alert from the client History.