What science-backed can mean in an app description
An app calls itself science-backed, and you want to know what that covers.
Science-backed is a phrase that can mean very different things. It may point to a careful test of the exact product, or only to a paper about a related idea. This guide shows how to tell which one you are reading.
What does a provider statement look like?
Take a real one. The App Store listing describes Miracle of Mind as a simple, effective and free app designed to help you take charge of your mental wellbeing1.
That is the provider’s own description. It tells you what the app is meant to do and how it is offered. Independent measurement of the app is a separate question, and this description does not set out to answer it.
What would independent evidence look like?
Here is a small worked example using a real paper. We are not pairing it with the app above, only showing the questions to ask.
- Design: a 2014 review in JAMA Internal Medicine pooled 47 randomised trials2.
- Participants: the trials had 3,515 participants in total2.
- Outcome: it found moderate evidence that mindfulness meditation programs improved anxiety and depression and reduced pain2.
- Limits: evidence for stress and quality of life was low, and meditation was not shown to be better than other active approaches2.
- Authors’ summary: programs may produce small to moderate reductions in negative dimensions of psychological stress3. They called for stronger designs3.
Now the last question: does it concern the actual product? No.
These were mindfulness meditation programs in general, not any single app.
The paper is useful background, and it is not proof about a particular download.
What about catchy wellbeing words?
Words like brain-boosting, reset or detox sound scientific, but they are labels. A label becomes meaningful only when a source says what was measured and in whom.
If a page uses such a word without a source, you do not need to argue with it. You can simply hold it lightly and keep your own experience as the judge.
Try this: a five-step check for any description
Do it on the LRT with an app page open on your phone.
- Copy one sentence that sounds scientific.
- Underline the actual claim: what is it saying will change?
- Look for a named source. If none is given, mark it “provider says”.
- If a paper is named, ask the four questions: who took part, compared with what, what was measured, how long.
- Write one of three labels beside it: provider says, paper shows, or unknown.
Most descriptions end up with a mix. That is normal, and it is honest to leave “unknown” on the page.
Making it fit real life
You do not have to give up an app because its wording is loose. You can use it and still hold the claims lightly. Some people simply want a calm seven minutes, and that is a fair reason.
Where to go next
Return to the what the research says hub. To trace one benefit all the way to its measurement, read checking whether a claimed benefit was measured. For the reasons results do not travel between practices, see why evidence for one practice may not fit another.
Basics first? Try how to read meditation research.
To see what the official pages say about the app, read Miracle of Mind: what the official sources describe. Note your answers in the weekly reflection sheet, which keeps everything in your browser.
Common questions
Does science-backed mean the app was tested?
Not necessarily. It can mean the app draws on ideas that others have studied, or that a paper exists about a related practice. Whether the app itself was tested, in whom, and with what result are separate questions. A trustworthy description answers them, or says plainly that it does not.
Is an app description a source of evidence?
It is a source of information about what the provider intends and offers. That is useful, and it is not independent evidence. Independent evidence comes from people who do not benefit if the app succeeds, and who describe their method and limits openly so others can check them.
How do I read words like brain-boosting or reset?
Read them as labels, not measurements. A label tells you the mood the writer wants, while a measurement tells you what changed. Ask what was measured, in whom and for how long. If the description gives no source, hold the phrase lightly and judge the app by how it feels in your own days.
Sources
- The App Store listing describes Miracle of Mind as a simple, effective and free app designed to help you take charge of your mental wellbeing, and shows it as free to download. Apple App Store (Malaysia). Provider's own description.
- A 2014 systematic review and meta-analysis in JAMA Internal Medicine of 47 randomised trials with 3,515 participants found moderate evidence that mindfulness meditation programs improved anxiety and depression and reduced pain. JAMA Internal Medicine (via PubMed). Evidence for stress and quality of life was low, and meditation was not shown to be better than other active treatments. Trials published through November 2012. Verified via the NCBI record for PMID 24395196.
- The Goyal 2014 review concluded that meditation programs may produce small to moderate reductions in negative dimensions of psychological stress. JAMA Internal Medicine (via PubMed). The authors called for stronger study designs.
Read next
If the wording has not put you off, a short guided meditation is a simple way to find out what it is like for you, judged on your own experience.