I'm originally from Australia, so I grew up using "colour", "favourite", etc. I'm currently going to college in the U.S. though, so I've had to get used to omitting the "u" from those words. Even though I've been here for almost a year now, I still prefer the look of the "colour" over "color". I think people generally just prefer whichever spelling they grew up with.