Psychedelics produce fast and persistent antidepressant effects and induce neuroplasticity resembling the effects of clinically approved antidepressants. We recently reported that pharmacologically diverse antidepressants, including fluoxetine and ketamine, act by binding to TrkB, the receptor for BDNF. Here we show that lysergic acid diethylamide (LSD) and psilocin directly bind to TrkB with affinities 1,000-fold higher than those for other antidepressants, and that psychedelics and antidepressants bind to distinct but partially overlapping sites within the transmembrane domain of TrkB dimers. The effects of psychedelics on neurotrophic signaling, plasticity and antidepressant-like behavior in mice depend on TrkB binding and promotion of endogenous BDNF signaling but are independent of serotonin 2A receptor (5-HT) activation, whereas LSD-induced head twitching is dependent on 5-HT and independent of TrkB binding. Our data confirm TrkB as a common primary target for antidepressants and suggest that high-affinity TrkB positive allosteric modulators lacking 5-HT activity may retain the antidepressant potential of psychedelics without hallucinogenic effects.