It does sound like a regulator problem, especially if it has happened with a new battery. I had this before when battery actually ran down after a ride, when I read the voltage it went down instead of up when bike was running! Voltage does not sound to bad, but if you are only getting a small increase when running then its worth checking or swapping out the regulator as an easy first step