I have used an Olympus C-770 UltraZoom for many years and for my level of photography. It does everything a full sized DSLR does without lens changes - The one listed below is the current camera from Olympus that is very similar to mine. The lens is removable, but does not have to be unmounted if you do not need more long range capabilities:
This image below was captured with the C-770 after sunset on Marco Island, Florida a few years ago, where the sun angle was still illuminating a severe thunderstorm inland about 50 miles.
Get the best camera you can afford made by Canon. I've had problems with Nikon. Sony, Panasonic, and Olympus make good cameras too. Wherever you buy, make sure they explain the details of the warranty.