Science and Research: How to Post a Study and Read It Critically (Study Designs, Trials and Statistics)

This sub-board is for published research on cannabis and on the endocannabinoid system. That is the body’s own signalling system, and cannabis compounds act on it. The sub-board is also for the slower work of reading that research properly.

After reading this topic, you should know three things. First, what each type of study can and cannot prove. Second, where a result from cells in a dish stops being useful. Third, why popular summaries of cannabis research so often claim more than the study found.

What to post here

  • Papers: studies published in scientific journals.
  • Preprints: studies posted online before other scientists have checked them (before peer review). Treat a preprint as unchecked work.
  • Trial registrations: the public record a research team files before a clinical trial starts. It states what the team plans to measure. You can then compare the plan with what the team later reported.
  • Review articles: papers that collect and summarise many earlier studies on one question.

Link to the study itself, not to a news report about it. News reports often shorten the result. They also tend to leave out the limits the researchers stated.

You are welcome to summarise a paper in your own words. Keep your summary clearly separate from the paper’s own conclusion. Sometimes a member writes “the study shows X” when the authors never concluded X. Spotting that mistake is the main job of this sub-board.

What to do: in every post, give the direct link to the paper or the registration. Mark which sentences are your summary and which are the authors’ conclusion.

Two habits before you post

Habit 1: name the study design

A case report, an observational study and a randomised controlled trial can support very different conclusions. Most arguments on this board end once everyone knows which design the study used. So the design is the first fact readers need.

What to do: start your post with one line: “Design: … ; number of participants: …”. Copy both from the paper’s methods section.

Habit 2: keep the mechanism separate from the outcome

A mechanism is how something might work. One example is a compound attaching to a receptor in tissue grown in the laboratory. An outcome is what actually happens to patients, or to plants in a grow room.

A pathway that looks plausible in tissue is a good reason to run a trial. It is not a reason to expect a particular result from that trial.

Here is an invented example of why. Researchers add a cannabinoid to cancer cells in a dish, and the cells die. In the dish, the cells sit directly in the compound, often at a high concentration. In a person, the compound is broken down by the liver and spread through the blood. The amount that reaches a tumour may be far lower. The immune system and other organs also change the picture. A lab result like this is a lead to test, not evidence that a treatment works.

What to do: add two lines to your post. Write “Mechanism shown:” and “Outcome shown in people (or plants):”. If the second line is empty, say so plainly.

Study designs: from weakest to strongest evidence

Design What it is What it can show What it cannot show
Cell culture (in vitro) Cells or tissue grown in a dish A possible mechanism What happens in a whole body
Animal study Tests in mice, rats or other animals An effect in a living animal The same effect in humans, because doses and metabolism differ
Case report / case series A description of one patient, or a few That something is possible; a question worth testing That the treatment caused the change, because there is no comparison group
Observational study Researchers watch groups but do not assign treatment A link (association) between two things That one thing caused the other
Randomised controlled trial Researchers assign treatment to people by chance Cause and effect, if the trial is well run Much, if the trial is very small or badly run
Systematic review / meta-analysis Combines all trials on one question using a stated method The best overall summary More than the quality of the trials it includes

Personal testimony ranks below a case report. Nobody has checked the details of a personal story in a structured way.

Treat this ranking as a guide, not a fixed rule. A large, careful observational study can tell you more than a tiny, badly run trial.

Clinical trial phases

Medicines are tested in stages, called phases:

  • Phase 1: a small group, often healthy volunteers. It tests safety, how the body handles the drug, and the dose range.
  • Phase 2: a larger group of patients. It gives a first look at whether the drug works, and at which dose.
  • Phase 3: large trials that compare the drug with a placebo or with standard treatment. Approval decisions are usually based on these.
  • Phase 4: studies after approval. They track side effects in everyday use.

What to do: when you post a trial, state its phase. A phase 1 or phase 2 result is not proof that a medicine works.

How to read a randomised controlled trial

A randomised controlled trial (often shortened to RCT) is a study that assigns participants to groups by chance, like drawing lots. Because of this, the groups are similar in age, health and habits. The treatment is then the main difference between them. Five features decide how much you can trust the result.

Placebo. A placebo is a dummy treatment that looks the same as the real one. It shows how much of the improvement comes from simply being treated and expecting to feel better. Cannabis trials have a particular difficulty here. Participants who feel the effects of THC may guess that they received the active drug.

Blinding. In a single-blind trial, the participants do not know which treatment they received. In a double-blind trial, neither the participants nor the researchers measuring the results know. Blinding matters because expectations change how people report pain, sleep or mood.

Crossover design. Each participant receives both treatments, one after the other. A gap called a washout period comes in between, so the first treatment can leave the body. Each person then serves as their own comparison, so fewer participants are needed. The risk is that the first treatment’s effect carries over if the washout is too short.

Primary outcome. This is the one main measurement the researchers name before the trial starts, usually in the trial registration. Secondary outcomes are the extra measurements. If a trial measures many things, a few will look positive by chance alone. So the primary outcome is the result that counts most.

Watch for one common pattern. The primary outcome shows no difference, but the press release highlights a secondary outcome that did. Treat that as a weak result.

What to do: before you post a trial, answer five questions. Was it randomised? Was there a placebo or another comparison? Who was blinded? Was it a crossover? What was the primary outcome, and did it show a difference?

Statistics: “significant” is not the same as “important”

p-value. This number tells you how likely it is to see a difference at least this large if the treatment had no real effect. By convention, a p-value below 0.05 is called “statistically significant”. A low p-value means chance is an unlikely explanation. It does not tell you how big or how useful the effect is.

Statistical significance versus clinical significance. A very large trial can detect a tiny difference and report it as statistically significant. Here is an invented example: a pain score that drops by a small fraction of a point on a 0–10 scale. Patients may not notice a change that small. A clinically significant result is one large enough to matter to the patient.

Confidence interval. This is the range of values that fit the data, usually given as a 95% interval. A narrow range means the estimate is fairly precise. A wide range means great uncertainty. The interval may include the “no effect” value: 0 for a difference, or 1 for a ratio. If it does, the result is not statistically significant.

Effect size. This is how big the difference between the groups actually is. Always look for it next to the p-value. A study that reports only “significant” without the size of the effect has told you half the story.

What to do: when you summarise a result, copy three numbers from the paper: the effect size, its confidence interval and the p-value. Say whether the result came from the primary or a secondary outcome.

Observational studies: a link is not a cause

In observational studies, researchers do not assign treatment. They watch what people already do. A cohort study follows a group over time and compares those who used cannabis with those who did not. A case-control study starts from people who already have a condition. It then compares their past habits with people who do not have the condition.

Odds ratio. This number compares the odds of an outcome in two groups. An odds ratio of 1 means no difference. A value of 2 means twice the odds in the first group, and 0.5 means half. When the outcome is rare, odds and risk are close. When it is common, the odds ratio makes the difference look larger than the change in risk.

Confounding. A confounder is a third factor linked both to the habit and to the outcome. Here is an invented example. A study finds that cannabis users have more lung problems. If those users also smoke more tobacco, tobacco may explain part of the result. Researchers adjust for confounders they measured. They cannot adjust for factors they never recorded.

Reverse causation. Sometimes the outcome comes first. For example, people with chronic pain may start using cannabis because of their pain. A study might then show that cannabis users report more pain, though cannabis did not cause it.

Because of these problems, an observational study shows an association, not a cause. Look at the wording: “linked to” and “associated with” are accurate. “Causes” or “prevents” is not, unless a trial supports it.

What to do: when you post an observational study, list the confounders the authors adjusted for. Name one important factor they did not measure.

The same habits for cultivation research

Translator’s note: most members of this forum are growers. The same reading habits apply to studies on light, humidity, feeding and pests. Many cultivation studies are small trials in one facility, with one or a few cultivars. A result from one cultivar may not hold for another.

Translator’s note: climate matters. Thai grow rooms can run hot, and rainy-season humidity is high. Power cuts also happen. Before you rely on a study, check the temperature and humidity it was run at. A result from a cooler, drier room may not transfer to your farm.

Translator’s note: comparing two of your own grow runs is an observational comparison, not a trial. The season, the batch of clones, the water or a power cut may differ between runs. Any of these can confound the result.

To test a change yourself, take clones from one mother plant. Split them into two groups in the same room at the same time. Change only one factor in one group. Record yield, days to harvest and any problems, and repeat over more than one run. The purpose is to learn whether the change works in your own conditions before you apply it to a whole room.

What to do: before you change a whole room because of a paper, run the split test above on a small batch. Post the result in Grow Diaries.

Finding trials and reading research in Thailand and Southeast Asia

Translator’s note: you can search trial registries to see whether a trial was registered before it started. A registry entry also shows the planned primary outcome. Useful registries include ClinicalTrials.gov, the WHO International Clinical Trials Registry Platform (ICTRP), and the Thai Clinical Trials Registry (TCTR, thaiclinicaltrials.org). TCTR is a WHO primary registry.

What to do: when someone posts a cannabis trial run in Thailand, search the registry for it. Compare the registered primary outcome with the one reported.

Translator’s note: most cannabis papers are published in English. When you summarise one in Thai, Vietnamese or another language, copy the study design, the numbers and the units exactly. Always include the link to the original paper so others can check your translation.

Translator’s note: a study does not change Thai law. Cannabis flower is a controlled herb under the Notification of the Ministry of Public Health Re: Controlled Herbs (Cannabis), B.E. 2568. The Notification was issued under the Thai Traditional Medicine Protection Act B.E. 2542 and has been in force since 26 June 2025. Flower may be sold only with a PT 33 (ภ.ท.33) prescription, for a maximum of 30 days. Advertising and online sale of flower are prohibited.

What to do: post studies here for discussion only. Do not combine a study with a claim that a named strain or product “treats” a condition, or with an offer to sell flower.

Where to start

  • Read the topic on the endocannabinoid system, linked in the first paragraph above. It explains the receptors and signalling that most cannabis studies refer to.
  • Related elsewhere on the forum: Cannabis Classification by Chemotype, in Genetics and Seeds. A chemotype is a grouping of plants by their cannabinoid content (for example, THC-dominant or CBD-dominant). Many studies sort their samples this way.

If you are unsure how to read a particular paper, open a topic here with the link. Name the design, and ask your question underneath. Other members can then work through it with you.