tag:blogger.com,1999:blog-7922050474519830656.post4029585902940230699..comments2010-01-24T22:47:26.006-08:00Comments on INFORMS Data Mining Contest 2009: Questions about the submissionClaudia Perlichhttp://www.blogger.com/profile/11278698880954421534noreply@blogger.comBlogger14125tag:blogger.com,1999:blog-7922050474519830656.post-53315924119838463422009-09-21T09:54:32.576-07:002009-09-21T09:54:32.576-07:00After submission, do we get the AUC scores back im...After submission, do we get the AUC scores back immediately? If not, how do we know we are not making any mistake?leverhttp://www.blogger.com/profile/16889405625335777053noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-5768036232678918202009-09-20T09:12:28.547-07:002009-09-20T09:12:28.547-07:00Is there a restriction on number of decimals for t...Is there a restriction on number of decimals for the score? Is it possible to have PatientID, Score format? (We dropped 'RecordID' from the data to decrease the size of the data set)Duraihttp://www.blogger.com/profile/12652485162186506843noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-41356799862907785782009-09-18T17:15:55.781-07:002009-09-18T17:15:55.781-07:00The deadline is now 1 week away. It has been seve...The deadline is now 1 week away. It has been several weeks since there has been any response on this blog.<br /><br />Is the contest still on? How do we submit our solutions?Gordon V.http://www.blogger.com/profile/18418030264104121131noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-12271774874722938722009-09-11T21:38:45.731-07:002009-09-11T21:38:45.731-07:00Here's a 14-line C program to compute AUC.
pl...Here's a 14-line C program to compute AUC.<br /><br />plg.uwaterloo.ca/~gvcormac/auc-trivial.cGordon V.http://www.blogger.com/profile/18418030264104121131noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-59189929966398766782009-09-10T09:54:03.540-07:002009-09-10T09:54:03.540-07:00As the competition deadline is nearing, can you le...As the competition deadline is nearing, can you let us know how we submit/upload the results?Srihttp://www.blogger.com/profile/12798703886899360688noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-59475705013428320182009-09-09T15:37:38.903-07:002009-09-09T15:37:38.903-07:00Hi, John - here is an URL clearly explaining the s...Hi, John - here is an URL clearly explaining the simple AUC calculation by Hands and Till, <br /><br />http://www.csd.uwo.ca/faculty/ling/papers/ijcai03.pdfleverhttp://www.blogger.com/profile/16889405625335777053noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-67207290809137405362009-09-07T16:59:15.363-07:002009-09-07T16:59:15.363-07:00I can tell you how to compute AUC.
Let P be the s...I can tell you how to compute AUC.<br /><br />Let P be the set of scores that you give to positive examples (i.e. where field 9 = 2 or field 9 = 20, depending on the task).<br /><br />Let N be the set of scores that you give to negative examples (i.e. all the rest).<br /><br />AUC = |{x in P, y in N : x > y}|/|N|/|P|<br /><br />That is, the fraction of all pairs of positive and negative examples where the positive example gets the higher score.Gordon V.http://www.blogger.com/profile/18418030264104121131noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-5174148805907060682009-09-07T12:33:19.201-07:002009-09-07T12:33:19.201-07:00Hi Claudia - any update on my post from the 2nd of...Hi Claudia - any update on my post from the 2nd of September?Johnhttp://www.blogger.com/profile/05256426983065533545noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-58830826956333245972009-09-02T07:12:29.533-07:002009-09-02T07:12:29.533-07:00Hi Claudia - an you provide either (or preferably ...Hi Claudia - an you provide either (or preferably both):<br />1) A link to the scoring methodology<br />2) A simple 10 record example (false data) to demonstrate the score.<br /><br />Sounds dumb I know but just want to be sure I am on the right track.Johnhttp://www.blogger.com/profile/05256426983065533545noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-55479527529036352622009-08-22T09:01:09.003-07:002009-08-22T09:01:09.003-07:00I do not mind if people want to talk about their A...I do not mind if people want to talk about their AUC here. But you may want to clarify your evaluation methodology (test set, 10 fold CV, etc)<br /><br />There will be two winners - one for each task.<br /><br />ClaudiaRomanhttp://www.blogger.com/profile/12658682257506953156noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-90890572928723333242009-08-21T04:03:58.902-07:002009-08-21T04:03:58.902-07:00If we can submit for one or both of the tasks, how...If we can submit for one or both of the tasks, how will the contestants be evaluated on AUC? Do we have winners for each task? Or best of the two AUCs?Srihttp://www.blogger.com/profile/12798703886899360688noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-47650650081973676722009-08-20T16:42:23.737-07:002009-08-20T16:42:23.737-07:00Since there will be no leaderboard, can people jus...Since there will be no leaderboard, can people just talk about their current best score? We are getting about .83 AUC with very little effort. We would like to compare it to other people's scores.leverhttp://www.blogger.com/profile/16889405625335777053noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-91692950206618450952009-08-19T14:42:46.118-07:002009-08-19T14:42:46.118-07:00When is the deadline to submit the results?When is the deadline to submit the results?sonalhttp://www.blogger.com/profile/11763797547854695362noreply@blogger.comtag:blogger.com,1999:blog-7922050474519830656.post-56456700870283575072009-08-17T11:07:18.399-07:002009-08-17T11:07:18.399-07:00Question:
For the INFOMRS contest 2009, there are ...Question:<br />For the INFOMRS contest 2009, there are two tasks. Whether I have to finish both of them, or I can choose one?<br /><br />Answer: <br />You can do one or both, as you like!Claudia Perlichhttp://www.blogger.com/profile/11278698880954421534noreply@blogger.com