i caught a mouse once, at the house i babysit/nanny at, around midnight i went to the bathroom and it was trapped in the toilet bowl.
i found a empty plastic jar and scooped it up, and left it there till morning, after it had dried off, and had fed it a blueberry or two.
then me and the kid walked a couple blocks away and dumped it out at a forest.
just went far enough away so that the mouse wouldn't find it's way back into the house.