Is there a reason why people are so mean and inconsiderate to handicapped people.?

I was diagnosed with ataxia about a year ago. I walk as if were drunk, I also slur my speech, I receive dirty looks, snide comments and people run into me making me fall, I walk with a cane, I am a bit over weight. . Do these people maybe think I am drunk in public ?