If you've been playing under the dash you may have knocked a vacuum hose off - have a look under there with a torch and engine running. The actual vacuum switching unit behind the knob also has a habit of breaking and when this happens it can do just as you describe.
"If anyone disagrees with anything I say, I am quite prepared not only to retract it, but also to deny under oath that I ever said it." --T. Lehrer
"The secret of success is sincerity. Once you can fake that you've got it made." -- Jean Giraudoux