CASP8 DR Evaluations

CASP8 Preliminary Results of Disorder Predictions Based on 117 Targets

1. Explaination for all the values:

The score ranges from -1 to +1 and predicting all the residues in the targets to be ordered would result in a score equal to 0;

ROC, Receiver Operating Characteristic curves, is a widely used method to assess the performance of a classifier system and its dependence upon its discrimination threshold;

TP is the number of true positives, meaning correctly identified disordered residues;

FP is the number of false positives, meaning predicted as disordered, but experimentally ordered;

TN is the nuber of true negatives, meaning correctly identified ordered residues;

FN is the number of false negatives, meaning predicted as ordered but experimentally disordered,respectively;

positive sensitivity equals TP/(TP+FN);

positive specificity equals TP/(TP+FP);

negative sensitivity equals TN/(TN+FP);

negative specificity equals TN/(TN+FN);

2. The results of DR methods by the score based on 117 targets:

Number	Group Name	Roc Score	Score	total residues	total positives	positive sensitivity	positive specificity	negative sensitivity	negative specificity	product of positive sensitivity and negative sensitivity	f-measure of positive
1	MULTICOM_1	0.878977659295448	6.88964529982504	25148	1925	0.531948051948052	0.619105199516324	0.972871721999742	0.9616497829233	0.517517217313109	0.572226879016485
2	DISOclust_1	0.861674223647041	7.8215532242621	24021	1821	0.753432180120813	0.248280854144046	0.812882882882883	0.975723168423898	0.612452122633342	0.373485776507418
3	fais-server_1	0.861074229089056	6.61310311810499	24021	1821	0.522240527182867	0.53337072349972	0.962522522522523	0.960877776778487	0.502668269587545	0.527746947835738
4	MULTICOM-CMFR_1	0.858679757789135	8.05991073886202	25431	1944	0.723765432098765	0.298599320882852	0.859283859156129	0.974081760702737	0.62191995361763	0.422776442307692
5	3Dpro_1	0.855331251904476	4.82594468120665	23934	1894	0.377507919746568	0.72736520854527	0.987840290381125	0.948629689338155	0.372917533063624	0.497045533541884
6	GS-MetaServer2_1	0.851786631052397	5.35622357463165	24976	1894	0.409714889123548	0.710622710622711	0.986309678537388	0.953190420365098	0.404105760583428	0.519758874748828
7	mariner1_3	0.847159036921872	7.77168394677726	23148	1743	0.663798049340218	0.356768424298489	0.902546134080822	0.970560160763627	0.599108363242405	0.464099478539912
8	mariner1_1	0.84629988569756	7.46862277518576	23148	1743	0.622489959839357	0.395696571845368	0.922588180331698	0.967754581985691	0.574301879322945	0.483835005574136
9	Distill-Punch1_1	0.845943651673247	0.79801938998756	23311	1743	0.0671256454388985	0.75	0.998191765578635	0.929777585834593	0.0670042665362595	0.123222748815166
10	mariner1_5	0.845059967570753	7.93369535165025	23148	1743	0.692484222604705	0.329151895282247	0.885073580939033	0.972486012011704	0.612899490644528	0.446210720887246
11	mariner1_4	0.842627599864536	7.07580266113703	23148	1743	0.573149741824441	0.455748175182482	0.944265358561084	0.964497041420118	0.541205446473048	0.507750952986023
12	metaprdos_1	0.842484517847816	6.43148370075571	22363	1650	0.505454545454545	0.539456662354463	0.9656254526143	0.960801268194264	0.488079774230501	0.521902377972466
13	Distill-Punch2_1	0.838947038043612	0.823129372102824	23730	1757	0.0631758679567444	0.880952380952381	0.999317344013107	0.930266056600576	0.0631327405722566	0.11789697291556
14	CBRC_POODLE_1	0.838928900069757	6.25903875775363	24021	1821	0.522240527182867	0.402966101694915	0.936531531531532	0.959835649323669	0.489094720750404	0.454915092083234
15	GeneSilicoMetaServer_1	0.838626740237528	6.3375800768738	24976	1894	0.489440337909187	0.627198917456022	0.976128585044624	0.958847561494595	0.477756704507057	0.549822064056939
16	DISOPRED_1	0.831242226575834	6.49677823571042	24021	1821	0.521691378363537	0.484941296579888	0.95454954954955	0.960520351736017	0.497980270220797	0.502645502645503
17	mariner1_2	0.82997827730986	6.65211681354761	23148	1743	0.53241537578887	0.489968321013728	0.954870357393132	0.961654276842006	0.508387660161117	0.510310695628265
18	Biomine_1	0.824670119151756	6.39437201772324	23472	1801	0.517490283176013	0.470469459868753	0.95159429652531	0.959564468847425	0.492440801977562	0.49286092014807
19	OnD-CRF_1	0.819774255309675	5.21367261979102	24021	1821	0.469522240527183	0.309670409272003	0.914144144144144	0.954562558795861	0.429211006723363	0.373199476211261
20	Spritz2_1	0.79050271853402	5.43066108821448	24021	1821	0.43437671609006	0.513970110461339	0.966306306306306	0.954185570678765	0.419740960070449	0.470833333333333
21	GSmetaDisorder_1	0.771793480025729	6.31000408096637	24504	1902	0.579390115667718	0.289162949357124	0.880143350146005	0.961339583434011	0.509946357445267	0.385786802030457
22	Distill_1	0.757841065942384	5.6365118021731	24021	1821	0.670510708401977	0.173486786018755	0.737972972972973	0.964670552905847	0.494818780889621	0.275651879444633
23	LEE-SERVER_1	0.7413007194534	3.59493099521749	21955	1720	0.309883720930233	0.449409780775717	0.967729182110205	0.942847513120516	0.299883519805081	0.36682725395733
24	LEE-SERVER_2	0.729800943564282	3.12045775449784	21955	1720	0.282558139534884	0.387250996015936	0.961996540647393	0.940386473429952	0.271819952764322	0.32672268907563
25	LEE-SERVER_5	0.646742138993039	3.57300425129901	14819	1161	0.285099052540913	0.766203703703704	0.992605066627617	0.9423090289845	0.282990764042844	0.415568110483365
26	LEE-SERVER_3	0.633815896900459	3.46849111641474	15084	1172	0.287542662116041	0.54885993485342	0.980089131684876	0.942294402211472	0.281817438035668	0.377379619260918
27	LEE-SERVER_4	0.615370003969241	2.89577636817599	14819	1161	0.242894056847545	0.629464285714286	0.987845951090936	0.938835154129845	0.239941910600899	0.35052827843381

Last modified on Oct 8th, 2009.