There are all sorts of effects that drugs can have on the brain/body that aren't a "trip". Consider the effects of caffeine and alcohol for example.

Also consider the difference between high and low doses of alcohol: just because having 1 beer won't make you blind drunk doesn't mean that the effect is a placebo.