In the field of mental health, interventions (e.g., support groups) and products (e.g., digital apps) aim to improve people’s mental health, well-being or quality of life. But, how do you know if they actually have a positive impact?
To investigate whether an intervention or product has led to change, you can conduct a before-and-after study (also called pre-post study). The UK Health Security Agency describes a before-and-after study as measuring an outcome variable in a group of participants before introducing an intervention or product, and then again afterwards. Examples of outcome variables are mental health, well-being or quality of life measurements. If you observe a change in your outcome variable, you may conclude it was due to the product or intervention. However, it cannot be ruled out that something else might have caused the change, such as unexpected life events or improved access to treatment or social support.
To conduct a before-and-after study, you should use the following steps as a guide:
- decide on the outcome variable you want to improve through your intervention
- recruit your sample
- get informed consent
- assess your outcome variable before starting the intervention
- deliver the intervention
- assess your outcome variable when the intervention is complete
- run your data analysis and compare your findings from before and after the intervention
For example, McKechnie and colleagues conducted a before-and-after study to investigate the effectiveness of an internet support forum for carers of people with dementia. They expected that using this forum for twelve weeks would decrease anxiety and depression in carers and change the quality of the relationship between the carer and the person with dementia. The researchers recruited a sample of 61 new forum users who gave informed consent to participate in the study. The forum users first completed questionnaires on the outcome variables of anxiety, depression and quality of relationship before starting the intervention. Then, they used the forum for twelve weeks. After using the forum, they completed the same questionnaires on anxiety, depression and quality of relationship again. The researchers ran their analysis and found that using the forum improved the quality of the relationship with the person with dementia. But they did not find change in users’ depression or anxiety over the 12-week study period.
(Author: Leonie Ader)