Go to the store and buy some Peppermint Oil and cotton swabs. This needs to be 100% peppermint oil, not peppermint extract - there is a difference. You don't have to buy the brand name stuff either, as long as it says 100% peppermint oil. So many people have reported difficulties finding real 100% peppermint oil, so here's a direct link to the real deal: 100% Peppermint Oil.
What you do is apply a few drops to the cotton swabs and strategically place the swabs throughout the house, or where the mice are thought to be having their fun.
The smell is so strong for the extremely sensitive noses on the mice that they can't stand to be around it. Be careful though, this is some potent stuff. If you spill too much you may irritate your own nose and throat! Keep it to a few drops per swab.
An alternative application method is to generously douse a swab and then use the swab to apply it to strategic locations (counter tops, on the floor near walls, under or around cabinets, etc...). Not only will you take care of your mice problems, but you'll also freshen up the place a bit. Now who says getting rid of mice is all work and no fun?