I'd also imagine at least part of it is the same as how normal people seem to think ADHD people with amphetamine prescriptions are just constantly high.
They don't realize that whatever good feelings they're getting from taking 100mg of amphetamines at once don't apply at all to people chronically on small extended doses.