Skip navigation

Assessing relative efficacy of antidepressants

 

Clinical bottom line

Analysis of large numbers of trials in depression show that some drugs (sertraline, escitalopram, for example) do better than others in terms of both reducing depression scores in more people, and being more acceptable, so that more people are able to take the drugs.

These properties probably go together. While this is far from the whole story, there is important information to begin constructing useful care pathways designed to treat more people effectively at lowest cost and least hassle for all.


Reference


A Cipriani et al. Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis. Lancet 2009 373: 748-758.


Be honest. There are times when the eyes glaze over and the brain goes into a dreamlike trance when statistics and probabilities are thrown around, especially when devoid of any apparent link to reality. Statistics does that to most people, apart, that is, to some statisticians and a small number of pointy-headed academics.

The rest of us feel a need to be grounded, to have some grasp, however tenuous, of what the numbers mean, and how they affect us or other people. It's why we get cross with media headlines about a doubled risk of some incredibly rare event.

Even so, there are times when something comes along that makes us stop and think, and to grapple with the arcane world of statistics and meta-analysis. This meta-analysis on antidepressants is one such, perhaps because it might be something of a watershed, not because of the statistics, but the thinking behind it.

What is efficacy?

Let's start with something comparatively easy. What does efficacy mean? Now there are lots of different definitions, but let's keep this simple. To most of us simple folk, there are three questions we want answered, and we don't really care what they are called. Bandolier thinks these three questions worth asking about the "efficacy" of any intervention are:

That is where the multiple-treatment meta-analysis comes in, and can be helpful. Bandolier thinks there is a way of making the approach easier, and do-able on the back of an envelope, but first, a brief description on what was going on.

Background

Drug treatment of depression involves frequent switching to find a drug that works well for that particular patient, because of the usual problems of lack of efficacy or adverse events. Bandolier covered a terrific RCT that looked at just this issue (Bandolier 95-4), in which only 44% of patients started on a drug were on it at the end. The trial showed that having three SSRIs was much better than one. An accompanying editorial made the point that while the three SSRIs were equal on average in clinical trials, they were not equal for every individual patient.

Inevitably, we need more than one antidepressant. The question isn't whether they work or how well they work, but which of them works best, and how might we choose to use them in a sequential treatment cascade to get the best results for patients, both individually, and for the whole population with depression.

The multiple treatments meta-analysis set out to ask whether there any of 12 new generation antidepressants were noticeably better than the others.

Methods

The data set was 117 randomised trials comparing one antidepressant with another; placebo-only controls were not used. Trials lasted 6-12 weeks. Doses of drugs were set as low, medium, or high, depending on pre-set criteria.

Two outcomes were used. The first, and efficacy outcome, was at least 50% reduction in a recognised depression score, or clinical global impression of much or very much improved, at eight weeks. The second, acceptability, outcome was all-cause withdrawals at eight weeks.

Some sophisticated statistics were then done, both on pairwise analyses and then on all the data comparing direct and indirect comparisons, and did sensitivity analyses on does within the therapeutic range, and on methodological issues.

Results

Results were expressed as the probability of any of the 12 drugs being among the top four for both efficacy and acceptability. Figure 1 shows the cumulative probability for both criteria as a percentage - with higher percentages obviously better.

Figure 1: Probability of being among top four drugs for efficacy (at least 50% reduction in depression score) and acceptability (all cause withdrawal) at mean of eight weeks of treatment

Some drugs (sertraline, escitalopram) do well on both counts, while others (citalopram, mirtazapine, venlafaxine) do well in one but not the other. Some (paroxetine, reboxetine) have a low probability of being in the top four on either criterion.

Issues of dose and method made no difference to the overall results in sensitivity analyses, and direct and indirect analyses gave different results no more than may be expected by chance.

Comment

Terrific stuff. Knowing that several antidepressants perform generally better than others is useful, and we may conclude that those at the top of the ladder might come earlier any care pathway of treatment strategy, but that doesn't mean that the others are without effect.

Bandolier has tried a slightly different approach using the data from the paper. Figure 2 shows the numbers of patients with efficacy and acceptability criteria, the total number, and the percentage with each outcome. These were then simply divided into those with the best (shaded blue) and worse (shaded pink) performance for each outcome, with the others shaded yellow. There is broad agreement with the statistical approach. Drugs doing best with efficacy generally also did well for acceptability, while those doing worse for efficacy generally did worse on acceptability.

Figure 2: Simplified assessment of efficacy and acceptability using simple percentages for efficacy (at least 50% reduction in depression score) and acceptability (all cause withdrawal) at mean of eight weeks of treatment, together with some information on cost

In addition, simple cost information is provided, based on approximate cost for a month of treatment in the UK, using BNF costs for medium doses. Generally, those drugs doing better on efficacy and acceptability had lower costs.

The implication is again that in creating care pathways it would be better to use the drugs at the top of the table first. Note that two of the 12 drugs (bupropion, milnacipran) do not have a UK license for depression at the time of writing.

Objections

Not everyone likes the meta-analysis, and MeReC [1] took issue with it on a number of points. It is useful to question them.

Further comment

This approach has application way beyond just depression. This has every prospect of being a useful methodological simplification and advance that could be used much more widely. The use of a dichotomous measure of benefit, set at a high level, is in accord with developing thinking in a number of fields. Combining this with a measure of how many people can take the drug hits directly at effectiveness - because there's no benefit at all when people can't take it.

Changes in average scores usually reflect the experience of very few patients. Moreover, it is common to use last observation carried forward, meaning that people who discontinue can still contribute to efficacy measures, even when there can be none because they have stopped taking it.

There is one other comment. The authors suggest that their results make sertraline the base case - raising the base well above placebo. They raise the question whether sertraline should be the new placebo, or at least the common comparator for all future depression trials.

And finally, the main point in all of this is that of getting the bestest for the mostest with the leastest. What the meta-analysis provides is the raw material for the next step, namely creating and testing a care pathway or pathways for depression that provides good results for the largest number of sufferers in the shortest time and at the lowest cost.

Other references:

  1. MeReC Monthly No 13. April 2009.
  2. Cipriani et al. Escitalopram versus other antidepressive agents for depression. Cochrane Database of Systematic Reviews 2009, Issue 2. Art. No.: CD006532.
  3. Cipriani et al. Sertraline versus other antidepressive agents for depression. Cochrane Database of Systematic Reviews 2009, Issue 2. Art. No.: CD006117.