What kind of potatoes are you growing?
I see you live in Texas, it is much warmer down there.
If the flowers are falling off, I wouldn't worry at all, unless you are attempting to harvest seeds as well as a fresh crop of potatoes.
You plants will flower, and bud at the same time as all of your other tubers.
The flowers falling off are probably from a little too much water, but I wouldn't worry about it, it will have no affect whatsoever on your yield.
Are you positive that it is the flowers falling off, and NOT the buds???