I'm second generation So Cal kid. When I was growing up in West Covina we went once a year. From my first year. Then I moved to OC, and because it was closer, and I was dating my now wife, we went much more often. Then when our kids were older and passes cheeper, we became APs.
So yes, we go more often because we are 5 minutes away (depending on trafic

) but I would now say that I would not move away BECAUSE of Disneyland.
And yes, I did live in Anahiem for a few years, but now I live in Garden Grove (a block from the Anahiem border).