When the battery goes dead the camera is dead, and you are almost dead, too. My little Coolpix is the camera that fits into my pocket and is thus my best camera, even though the Fuji is of better quality, but it is a tad too big.
There are no small stores anymore that would carry gazillion types of batteries, so all you can do is order by Internet. But that works, and in a few days a huge DHL truck comes to your door and a friendly guy hands you the envelope containing a 31 x 43 x 7 mm item. :-)