Couldn't agree more! My Bride loves cool weather, and I despise being cold. If it weren't for her I would live below the Mason-Dixon and escape from these brutal IL winters.(I do have her considering the Carolinas. 
Aiken, SC has a great horse community. We trained there for several years and while the standardbred side of the horse has pretty much disappeared from western SC, the TB side is alive and very vibrant. Great training center in almost the center of town.
Problem there is the heat. Late July and August are almost unbearable. Nice town and only some 12 miles from Augusta, GA
(Masters golf tourny in the Spring).
Then there is always Pinehurst. Near the coast (watch for hurricanes) but kinda overrun by damyankees from the NE.
Nice town though.