Subscribe to DSC Newsletter

Have a look at the lift chart below:

I'm used to looking at cumulative lift curve with respect to the baseline one (blue line) which
looks quite like many I've encountered before (i.e. the top deciles have the highest lift and the line eventually reduces itself to baseline).

However, I'm a bit confused by the lift (red line).
Is it really possible for it to be below the baseline for that long? Does this red lift line look strange to you? Maybe, I'm not interpreting it correctly or didn't run something right.


Views: 1990

Replies to This Discussion

Hm ...

If I understand this chart correctly, then the lift is calucaled for each decile. Could it be that your ranking of scores is so good, that indeed most positive class items have been ranked to the top, so that less positive class items are available at the lower deciles ?

Have you looked at the roc-curve / auc-value for this ranking ?
The red line doesn't make any sense. The blue line is not the cumulative lift of the red line, Why are the lines going in different directions between 50 & 60% ?. However the blue line does make sense since the cumulative lift value should always be equal to 1 at 100%. Maybe the red line represents the gains chart at the individual deciles, but then the y-axis would be wrong. Could be an overlay. Which package is this from?

-Ralph Winters
Hi Ralph,

Yeah, I'm confused by the red line as well.
The blue one does make sense to me as well for the same reasons you mentioned.
I also thought the red one could be the lift score for each decile separately (i.e. non-cumulative lift), but I'm only used to looking at cumulative lines in lift charts so I'm not quite sure.

By the way what do you mean by "could be an overlay"?

The chart is done in KNIME.

Thanks for your help guys !!
The graph is not explained properly in the legend. The blue line is the cumulative lift chart, which asymptotes at 1.00 at the 10th decile (100% of the cases). The red line appears to be the incremental or decile lift value. Sometimes this value is called the "Lift Index", or just the "Lift". The red line (decile lift) is greater than 1.0 only to about the 3rd decile, then is goes below 1.0 (the level of random expectation - via a coin toss). To the mass mail marketer (for example), this means that he should mail to only the top 3 deciles, or the top 30% of the scored list sorted in descending order. Beyond the 3rd decile, the model is not effective in predicting response at any level greater than the random expectation.
Thanks for your reply Robert.

It kind of looks odd to see the red line (decile lift) below the random expectation (green line) for deciles 4 to 10.

Is this even possible?

I know cumulative lift always = random expectation at the end of decile 10 and never goes below random expectation. However I wasn't sure if that's true for (non-cumulative) decile lift.



On Data Science Central

© 2019 is a subsidiary and dedicated channel of Data Science Central LLC   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service