My policy is to never take a deposit. Either I agree to hold it on trust or I don't.
Return the money. Sure, there are a thousand ways to justify keeping it but the truth is it's his money and shit happens. Give the man his money back. You won't regret it.