Can't decline when you're asleep. Checkmate!
I usually reply with a lengthy explanation that I would have attended had they given sufficient notice, but I don't check my mail in my sleep.
If I'm feeling SAUCY I'll wait until 2am their time to send it. They won't notice, but it amuses me.