CASP8 DP Evaluations

Preliminary Results of CASP8 Domain Predictions Based on 128 Targets

1. Explaination for the values:

Domain number accuracy is the percentage of proteins whose domain numbers are correctly predicted by a predictor.

NDO score (the Normalized Domain Overlap score) is calculated as follows: Predicted and official domains are compared first. The number of residues that overlap between predicted domains and linkers, and defined domains and linkers are summed for each protein.

2. CASP8 domain predictors ranked by the multi-domain number accuracy based on 40 targets.

Rank	Predictor	domain number accuracy	average ndo score	the number of predicted proteins	the number of correct predictions
1	MULTICOM_1	0.692	0.845	39	27
2	MUProt_1	0.658	0.822	38	25
3	MULTICOM-CMFR_1	0.65	0.827	40	26
4	BAKER-GINZU_1	0.475	0.757	40	19
5	BAKER-DP_HYBRID_1	0.45	0.741	40	18
6	BAKER-ROSETTADOM_1	0.45	0.748	40	18
7	Distill_1	0.436	0.631	39	17
8	3Dpro_1	0.436	0.6	39	17
9	LEE-SERVER_1	0.414	0.797	29	12
10	DomPred_1	0.257	0.652	35	9
11	ProtAnG_s_1	0.1	0.572	40	4

3. CASP8 domain predictors ranked by the single-domain number accuracy based on 88 targets.

Rank	Predictor	domain number accuracy	average ndo score	the number of predicted proteins	the number of correct predictions
1	ProtAnG_s_1	1	0.932	88	88
2	LEE-SERVER_1	0.944	0.972	54	51
3	DomPred_1	0.919	0.974	74	68
4	MULTICOM-CMFR_1	0.898	0.956	88	79
5	MUProt_1	0.89	0.956	82	73
6	MULTICOM_1	0.864	0.947	88	76
7	BAKER-ROSETTADOM_1	0.833	0.939	84	70
8	BAKER-DP_HYBRID_1	0.821	0.927	84	69
9	BAKER-GINZU_1	0.821	0.928	84	69
10	3Dpro_1	0.728	0.911	81	59
11	Distill_1	0.728	0.883	81	59

4. CASP8 domain predictors ranked by the domain number accuracy combining the single and multiple domain prediction based on 128 targets.

Rank	Predictor	domain number accuracy	the number of predicted proteins	the number of correct predictions	average ndo score
1	MULTICOM-CMFR_1	0.82	0.916	128	105
2	MUProt_1	0.817	0.914	120	98
3	MULTICOM_1	0.811	0.915	127	103
4	LEE-SERVER_1	0.759	0.911	83	63
5	ProtAnG_s_1	0.719	0.82	128	92
6	BAKER-GINZU_1	0.71	0.873	124	88
7	BAKER-ROSETTADOM_1	0.71	0.877	124	88
8	DomPred_1	0.706	0.871	109	77
9	BAKER-DP_HYBRID_1	0.702	0.867	124	87
10	3Dpro_1	0.633	0.81	120	76
11	Distill_1	0.633	0.801	120	76

Last modified on Nov. 21, 2008.