Overall Lift or Decile Lift - AnalyticBridge2020-01-22T11:56:26Zhttps://www.analyticbridge.datasciencecentral.com/forum/topics/overall-lift-or-decile-lift?commentId=2004291%3AComment%3A60101&feed=yes&xn_auth=nodata, what's the overall lift…tag:www.analyticbridge.datasciencecentral.com,2010-02-08:2004291:Comment:601012010-02-08T20:22:10.341ZJozo Kovachttps://www.analyticbridge.datasciencecentral.com/profile/JozoKovac
data, what's the overall lift?<br />
<br />
'difference in sample size across deciles' - a decil = 10%, what difference?<br />
<br />
it there are enough data then lift is sensitive to good/bad distribution, not to sample size. random sampling keeps the distibution. so you can use simple average across multiple samples ...<br />
<br />
pls. explain your idea more :)
data, what's the overall lift?<br />
<br />
'difference in sample size across deciles' - a decil = 10%, what difference?<br />
<br />
it there are enough data then lift is sensitive to good/bad distribution, not to sample size. random sampling keeps the distibution. so you can use simple average across multiple samples ...<br />
<br />
pls. explain your idea more :) Tthanks arup. guess, i have c…tag:www.analyticbridge.datasciencecentral.com,2010-02-01:2004291:Comment:598732010-02-01T13:24:24.637ZDataLLigencehttps://www.analyticbridge.datasciencecentral.com/profile/datalligence
Tthanks arup. guess, i have confused everyone with my short quick question. I know about lift :)<br />
<br />
I just wanted to know how the cumulative lift can be used when your results are biased because of different sample sizes in the test and control groups. this question has more to do with measurement rather than modeling. also, this problem is commonly known as Simpson's paradox (an apparent paradox in which the successes in different groups seem to be reversed when the groups are combined)<br />
<br />
maybe…
Tthanks arup. guess, i have confused everyone with my short quick question. I know about lift :)<br />
<br />
I just wanted to know how the cumulative lift can be used when your results are biased because of different sample sizes in the test and control groups. this question has more to do with measurement rather than modeling. also, this problem is commonly known as Simpson's paradox (an apparent paradox in which the successes in different groups seem to be reversed when the groups are combined)<br />
<br />
maybe we need to make some modifications in the way we calculate overall lift in such scenarios? decile level lifts are calcul…tag:www.analyticbridge.datasciencecentral.com,2010-02-01:2004291:Comment:598712010-02-01T13:00:20.503Zarup guhahttps://www.analyticbridge.datasciencecentral.com/profile/arupguha
decile level lifts are calculated or if i may say lifts are calculated at the decile level only because thats why lift makes sense. after you have scored your population, and have divided them into groups: deciles, twentiles or whatever quintilies, and have sorted descending, then lift would be the ratio of model vs actual and you would contact only upto those deciles using the model where the lift is atleast 1.<br />
overal lift=cumulative lift? just add up the actuals and the models as you go down…
decile level lifts are calculated or if i may say lifts are calculated at the decile level only because thats why lift makes sense. after you have scored your population, and have divided them into groups: deciles, twentiles or whatever quintilies, and have sorted descending, then lift would be the ratio of model vs actual and you would contact only upto those deciles using the model where the lift is atleast 1.<br />
overal lift=cumulative lift? just add up the actuals and the models as you go down the deciles and take the ratios, thats cumulative or overall lift for you. that better be more than 1 too or the model is overall useless :)