It's not worth the hassle of moving just for the sake of moving and living in "your own place".

If the numbers stack up on the property as an investment (when it comes time to move out) then it could be a good idea.

If you are moving away from what you know and enjoy for little or no real monetary gain, then why do it?
Don't forget to factor in the costs of moving (time and money) as well as the addition of STAMP DUTY to the cost of the property. on $500k there is about $25k in stamp duty. How many months of rent does $25k buy you?

Your husband may perfer to pay a little extra for a better life style and enjoy the area you live in. Perhaps that money you have could buy a positive cashflow property with growth potential?

Just my thoughts.