Why Personal Testimony Is Not Medical Evidence — and What It Is Good For Instead

“It cured me.” Those three words carry more persuasive force than any meta-analysis ever written, and they are among the weakest forms of evidence that exist. This article explains why both of those things are true at once, and how to read a recovery story without either dismissing the person or believing the claim.


1. Start With Respect, Then Apply the Method

People who post recovery stories are not usually lying. They are describing what they experienced, in good faith, often after the worst year of their lives, and often because they want to help a stranger. Treating them as frauds is both unkind and analytically lazy.

The problem is not honesty. The problem is that a single person’s experience — however sincerely reported — cannot distinguish between this treatment worked, something else worked, nothing worked and the illness changed on its own, and the perception changed while the illness did not. No amount of sincerity separates those four. Only a study design does.

This matters practically on a forum like this one, where somebody reading at two in the morning after a diagnosis may make a decision based on what they find here.

2. The Specimen

A self-published book on cannabis oil contains a long chapter of testimonials. This article deliberately quotes none of them, because reproducing a specific story — even to criticise it — gives it a second life as an example, and the argument does not need one. (The history of the cannabis-oil cure claims that material like this draws on is covered in topic 1314.)

What is worth reporting is the structure of the collection. Read end to end, the same narrative shape repeats across melanoma, multiple sclerosis, insomnia, anxiety, burns, scars, warts, weight, menopause and addiction: a desperate situation, a decision to try the oil, improvement, gratitude.

That uniformity is the finding. Melanoma and insomnia are not similar conditions and do not resolve by similar mechanisms. When the same narrative arc fits every disease equally well, the arc is a property of how testimonials are written and selected, not a property of the diseases. A collection like that cannot be evidence for any specific claim, because it is equally compatible with every claim.

3. Eight Filters Between a Recovery and a Recovery Story

Filter 1 — Selection, or survivorship

Someone who recovers writes. Someone who deteriorates writes less, and someone who dies writes nothing. What accumulates in a collection of testimonials is therefore, by construction, the good outcomes. It looks like a success rate. It is not one — the denominator is missing and was never recorded.

This is not an argument that the failures outnumber the successes. It is an argument that the collection cannot tell you the ratio, and any impression of a ratio it gives you is an artefact of who wrote.

Filter 2 — No control group

The core question in any treatment claim is counterfactual: what would have happened to this person otherwise? A single case cannot answer it, because the same person cannot be observed both taking and not taking the treatment.

Control groups exist to supply that missing branch. Without one, “I took X and improved” is a sequence, and a sequence is not a cause.

Filter 3 — Placebo, and how large it is here

Placebo response is often dismissed as “just in your head,” which understates it badly. In cannabis pain research it has been measured directly, and the result should be uncomfortable for both sides of the argument.

A 2022 systematic review and meta-analysis by Gedin and colleagues in JAMA Network Open examined 20 double-blind, placebo-controlled trials of cannabis-based therapies for pain, covering 1,459 participants. Placebo produced a moderate-to-large reduction in pain, Hedges g = 0.64. The active cannabinoid arms showed a larger pooled reduction, g = 0.95 — but the between-group difference for active drug and placebo (g = 0.32) was not statistically significant (P = .09).

Read that carefully. People given an inert product reported substantial, real pain relief. If pooled blinded, controlled trials cannot reliably separate the drug from the placebo, an uncontrolled personal account has no chance whatsoever.

The same paper reported a second finding that explains a great deal about the information environment. Cannabinoid pain trials attracted proportionally high and strongly positive media coverage, and the amount of coverage was not associated with the trials’ clinical outcomes. The authors’ concern was that this coverage raises expectations, and expectation is precisely what drives placebo response — a feedback loop in which the reporting inflates the effect it is reporting on.

Filter 4 — Concurrent conventional treatment

Many recovery accounts describe someone who was also receiving surgery, chemotherapy or radiotherapy. A 2024 survey of 13,180 patients treated at 12 US NCI-Designated Cancer Centers (Ellison et al., JNCI Monographs) found that about a third (32.9%, weighted) reported using cannabis since their diagnosis. Everyone surveyed was a cancer-centre patient, and about 72% of the cannabis users said they used it during their treatment. So in that population, cannabis use mostly happened alongside conventional care. The survey was not designed to show whether anyone used cannabis instead of treatment.

When two things happen together and one of them is a therapy with a known survival benefit, attributing the outcome to the other one requires an argument, not an assumption.

Filter 5 — Spontaneous remission and natural fluctuation

Cancers occasionally regress without treatment. It is rare, the true incidence is unknown and probably under-recorded, and the published literature consists largely of individual case reports across many tumour types. But across millions of patients, rare events happen — and whoever they happen to will credit whatever they were doing at the time.

For chronic conditions the same problem appears in a milder and far more common form. Pain, fatigue, mood, spasticity and sleep all fluctuate. People seek treatment when symptoms are at their worst, which is the point from which improvement is most likely regardless of what is done. That is regression to the mean, and it manufactures apparent treatment effects reliably, in every field of medicine.

Filter 6 — Absent follow-up

Testimonials are written at the moment of hope, usually weeks or months in. Cancer outcomes are measured in years. Almost no testimonial has a five-year update attached, and the ones that would be most informative — the ones where things went badly afterwards — are precisely the ones nobody returns to write.

Filter 7 — Unverified diagnosis

Published case reports carry a diagnosis, staging, imaging and pathology because those are what make the case interpretable. Online accounts carry none of it. There is usually no way to establish what the condition was, how advanced, whether it was confirmed, or what the expected course would have been. “Stage 4” is a phrase people use loosely.

Filter 8 — Confirmation bias, in both directions

The person writing has already decided the treatment worked, and organises the account around that conclusion — details that fit are remembered, details that do not are not mentioned. The person collecting testimonials for a book or a website selects the ones that support the thesis. And the person reading, if they are frightened and looking for hope, weights the evidence accordingly.

None of this requires bad faith from anyone in the chain. It is ordinary human cognition, which is exactly why formal methods exist to constrain it.

4. What Study Designs Actually Control For

Design What it controls What it still cannot rule out
Personal testimonial Nothing Everything in section 3
Published case report Diagnosis verified, course documented Chance, concurrent treatment, selection
Case series Multiple patients described consistently No comparison group; selection
Observational cohort Comparison group, size Confounding — the groups differ in ways other than the treatment
Randomised controlled trial Confounding, by random allocation Blinding failure; small trials still mislead
Blinded, placebo-controlled RCT Confounding and expectation Publication bias; may not generalise
Systematic review / meta-analysis Single-study flukes and selective reporting Only as good as the trials it pools

Nothing in that table says testimonials are worthless. It says testimonials sit in the top row of this table, the weakest design, and approvals rest on the rows at the bottom.

5. What Testimonials Are Genuinely Good For

Dismissing patient reports entirely is its own error, and a costly one.

Generating hypotheses. Patient reports are frequently the first signal that something is worth testing, and they have repeatedly prompted formal studies. One cannabis-specific example: before cannabidiol was tested in randomised trials for Dravet syndrome, a severe childhood epilepsy, there were widely publicised family reports and a 2013 parent survey describing dramatic seizure reductions. The double-blind, placebo-controlled trial that followed (Devinsky et al., New England Journal of Medicine, 2017; 120 patients) confirmed that cannabidiol reduced convulsive seizures more than placebo. But complete seizure freedom was rare (5% versus 0%, not statistically significant), which is far less than the most striking reports had suggested. The correct response to a striking report is a study, not a conclusion — but the report earns the study, and the study measures how big the effect really is.

Detecting adverse effects. This is where patient reporting is not merely useful but indispensable. Rare harms usually appear after approval, in populations far larger than any trial, and pharmacovigilance systems exist precisely to collect them. A patient describing an unexpected reaction is contributing hard data.

Describing what living with a treatment is like. Trials measure endpoints. They rarely capture whether a medicine is tolerable to take daily for a decade, whether it interferes with work, or which side effect actually drives people to stop.

Mapping where care is failing. When many patients report self-sourcing because no clinician would engage with them, that is a real finding about a health system, and it does not depend on whether the treatment works.

6. Reading a Recovery Post

Ask What a stronger account contains
What was the diagnosis, and how was it confirmed? Named condition, staging, how it was established
What else were they receiving at the same time? A full treatment list, including conventional therapy
How long is the follow-up? Years, with updates — not weeks
Who else took it and did not improve? Any acknowledgement that a denominator exists
Was anything measured, or only felt? Scans, laboratory values, standardised scores
Who assembled this collection, and what do they gain? Independence from anyone selling a product
Does the same story shape appear for unrelated diseases? If yes, treat the shape as the author’s, not the disease’s

7. If You Are the Person With the Diagnosis

None of the above is a reason to disbelieve your own experience or to stay silent about it. It is a reason not to let a stranger’s account decide your treatment.

Three things are worth holding onto. Symptom relief and disease modification are different questions, and evidence for the first is not evidence for the second — a preparation may genuinely help you eat, sleep or feel less sick without doing anything to the illness. Your treating team needs to know everything you are taking, both because of interactions and because they cannot interpret your results otherwise. And a decision to decline or delay a treatment with a known survival benefit is the highest-stakes decision available to you; the related article on refusing conventional treatment sets out what is known about the outcomes of that choice.

If you have read a recovery story that you found genuinely convincing, post it in the replies and let’s work through it together against section 6 — not to score points, but because doing this once with a real example teaches the skill better than any checklist. And if you have a story of your own that did not end the way you hoped, that account is worth more to this community than any of the successful ones, and it takes more courage to post.

Related topics: topic 1314 (the history of the cannabis-oil cure claims), topic 1308, topic 1312, and the related article on refusing conventional treatment.


Sources

  • Gedin F, Blomé S, Pontén M, Lalouni M, Fust J, Raquette A, Vadenmark Lundquist V, Thompson WH, Jensen K. Placebo Response and Media Attention in Randomized Clinical Trials Assessing Cannabis-Based Therapies for Pain: A Systematic Review and Meta-analysis. JAMA Netw Open. 2022;5(11):e2243848. doi:10.1001/jamanetworkopen.2022.43848
  • Ellison GL, Helzlsouer KJ, Rosenfield SM, et al. Perceptions, prevalence, and patterns of cannabis use among cancer patients treated at 12 NCI-Designated Cancer Centers. J Natl Cancer Inst Monogr. 2024;2024(66):202–217. doi:10.1093/jncimonographs/lgae029
  • Devinsky O, et al. Trial of Cannabidiol for Drug-Resistant Seizures in the Dravet Syndrome. N Engl J Med. 2017. doi:10.1056/NEJMoa1611618
  • Koubeissi M. Anticonvulsant Effects of Cannabidiol in Dravet Syndrome. Epilepsy Curr. 2017;17(5):281–282.

This article is part of the Asiannabis Community educational series on evaluating medical claims. It is general information, not medical advice. If you are facing a treatment decision, the people who can help you make it are the clinicians who know your case.