The mouse has been caught, I put down the trap without any bait in the hope that the mouse would get used to it (as suggested by Richard in the comments) but it ended up going right into the trap on the first day without any bait at all. I feel bad for the mouse, he should at least have had something to eat before he got evicted.
After taking a picture of him (which I'll put up later) I released the rodent into a lay by a couple of miles from the house.
Dormice favoured by Italian mafia seized in drugs raid
51 minutes ago