I am exactly in the situation you are describing. I've always enjoyed math but never took it seriously, and now I regret it. Just cruised through college because no advanced math was ever required.

So I'm taking a math course in the evenings and going to try university this year!