Traditional Chinese Insomnia Formula Works via Melatonin Receptors in Rats

A Traditional Chinese Insomnia Formula Works Through Melatonin Receptors in Rat Study

Rats given a classical herbal formula for insomnia fell asleep faster and slept longer — and researchers at Henan Provincial People’s Hospital traced the effect to melatonin receptors deep in the brain’s circadian control center. The study, published in CNS Neuroscience & Therapeutics, offers one of the most detailed mechanistic pictures yet of how Banxia Shumi Decoction (BXSMD), a Traditional Chinese Medicine formula, might influence sleep biology.

How the Study Was Designed: PCPA Insomnia and Luzindole Reversal

Guo and colleagues built their insomnia model using 4-Chloro-DL-phenylalanine (PCPA), a chemical that depletes serotonin and reliably disrupts sleep in rodents. They then applied network pharmacology — a computational method mapping which proteins a formula’s active compounds are likely to hit — to predict core targets before validating them in living animals.

The design included a built-in falsification test. A separate group of rats received luzindole, a non-selective melatonin receptor antagonist. If BXSMD truly works through melatonin signaling, blocking those receptors should undo its benefits. That is exactly what happened, which strengthens the causal claim considerably.

Melatonin Receptors as the Hub: What Changed in the Brain

Compared with untreated insomnia-model rats, BXSMD-treated animals showed significantly higher levels of 5-hydroxytryptamine (5-HT, or serotonin) and melatonin, along with increased MT1 and MT2 receptor expression in the suprachiasmatic nucleus (SCN) — the hypothalamic structure that coordinates the entire circadian system.

Downstream of those receptors, the formula shifted a cascade of sleep-relevant molecules, measured by ELISA, qRT-PCR, Western blot, and immunohistochemistry across the SCN, hippocampus, and serum:

• CLOCK and PER1 — core circadian clock genes — were upregulated at both mRNA and protein levels.
• CaMKII and the p-CREB/CREB protein ratio increased, pointing to enhanced synaptic plasticity signaling. Notably, total CREB mRNA stayed flat; only its phosphorylated (activated) form rose, which is how melatonin receptor activation typically acts on this pathway.
• GABARAP, a factor supporting GABAergic signaling, went up, while mGLuR1, a metabotropic glutamate receptor, went down — a pattern consistent with reduced excitatory drive.
• ADAM10, an enzyme that cleaves membrane proteins (a process called ectodomain shedding), increased — an unexpected finding suggesting melatonin signaling may also regulate how neurons release surface proteins involved in synaptic remodeling.

Every one of these changes was significantly reversed by luzindole. That convergence matters: it argues the herbal blend acts as a coherent signal through MT1/MT2 rather than scattering unrelated effects across brain tissue.

Where This Fits in Insomnia Pharmacotherapy

Modern insomnia drug development has largely moved toward orexin antagonists — newer agents like vornorexant, which showed sustained benefit over 52 weeks, and the DORAs that help patients taper off benzodiazepines. Melatonin-based strategies occupy a different niche: rather than blocking wakefulness, they nudge the circadian system itself.

Complicating the picture, insomnia rarely exists alone. A 2026 review from the Medical University of Lodz highlights the amygdala as a hub binding sleep loss to anxiety — during REM sleep the amygdala is highly active, and disrupted REM may intensify emotional processing rather than settle it. Because serotonin and melatonin signaling interact with both mood and sleep circuitry, approaches that restore monoamine balance, as BXSMD appears to do in rats, are mechanistically plausible targets for the insomnia-anxiety overlap.

What This Means — and What It Doesn’t

The honest caveat: this is a rat study. PCPA-induced insomnia is a chemical model, not the human disorder. Herbal formulas vary in composition between batches, dosing in rats does not translate directly to humans, and no controlled human trial of BXSMD supports its clinical use yet. Network pharmacology predictions, however well validated here, also carry uncertainty.

Still, the luzindole reversal experiment elevates this above most herbal-mechanism papers. It identifies MT1/MT2 receptors as testable targets — and suggests that if BXSMD holds up in humans, it would function less like a sedative and more like a circadian-signal restorer, conceptually closer to melatonin supplementation than to hypnotics. For readers exploring gentler options, evidence in humans remains stronger for magnesium and especially for CBT-I, which remains the first-line treatment.

Practical Applications

• Don’t self-prescribe BXSMD. The formula is unvalidated in humans; consult a qualified clinician before trying any herbal sleep preparation.
• Protect your melatonin signaling regardless: dim lights 1–2 hours before bed, keep a consistent sleep schedule, and get morning light exposure to support SCN function — the same circuitry this study targeted.
• If anxiety and insomnia travel together, address both; amygdala-centered research suggests they reinforce each other.
• For diagnosed insomnia disorder, CBT-I remains first-line, with medication decisions best made with a sleep physician.

Frequently Asked Questions

Can I take Banxia Shumi Decoction for my insomnia?

Not based on current evidence. The study was conducted in rats with chemically induced insomnia, and no human clinical trials have confirmed its safety or effectiveness.

How is this formula different from sleeping pills?

Rather than forcing sedation, BXSMD appears to work through melatonin receptors to restore circadian and sleep-signaling molecules — mechanistically more like supporting the body’s own clock than suppressing wakefulness.

Does this study prove melatonin supplements work for insomnia?

It shows melatonin receptor signaling can improve sleep in rats, but melatonin supplementation is a different intervention with its own evidence base, best discussed with a clinician.

Why did researchers use luzindole in the study?

Luzindole blocks melatonin receptors, so using it tests whether the formula’s effects depend on those receptors. Since it reversed nearly all benefits, the melatonin pathway was confirmed as the core mechanism.

Sources:
https://pubmed.ncbi.nlm.nih.gov/42763428/
https://pubmed.ncbi.nlm.nih.gov/42737711/
https://pubmed.ncbi.nlm.nih.gov/42736737/
https://pubmed.ncbi.nlm.nih.gov/42624113/
https://pubmed.ncbi.nlm.nih.gov/42567341/