EVA (benchmark)

EVA is a continuously running benchmark project for assessing the quality of protein structure prediction and secondary structure prediction methods. Methods for predicting both secondary structure and tertiary structure - including homology modeling, protein threading, and contact order prediction - are compared to results from each week's newly solved protein structures deposited in the Protein Data Bank. The project aims to determine the prediction accuracy that would be expected for non-expert users of common, publicly available prediction webservers; this is similar to the related LiveBench project and stands in contrast to the bi-yearly benchmark CASP, which aims to identify the maximum accuracy achievable by prediction experts.

References

• Rost B, Eyrich VA. (2001). EVA: large-scale analysis of secondary structure prediction. Proteins Suppl 5:192-9. PMID 11835497
• Eyrich VA, Marti-Renom MA, Przybylski D, Madhusudhan MS, Fiser A, Pazos F, Valencia A, Sali A, Rost B. (2001). EVA: continuous automatic evaluation of protein structure prediction servers. Bioinformatics 17(12):1242-3. PMID 11751240
• Koh IY, Eyrich VA, Marti-Renom MA, Przybylski D, Madhusudhan MS, Eswar N, Grana O, Pazos F, Valencia A, Sali A, Rost B. (2003). EVA: Evaluation of protein structure prediction servers. Nucleic Acids Res 31(13):3311-5. PMID 12824315