Ontology Performance Profiling and Model Examination: First Steps
T. Wang, and B. Parsia. Proceedings of the 6th International Semantic Web Conference and 2nd Asian Semantic Web Conference (ISWC/ASWC2007), Busan, South Korea, volume 4825 of LNCS, page 589--602. Berlin, Heidelberg, Springer Verlag, (November 2007)
"Reasoner performance can be scary, so much so, that we cannot deploy the technology in our products." -- Michael Shepard (http://lists.w3.org/Archives/Public/public-owl-dev/2007JanMar/0047.html). What are typical OWL users to do when their favorite reasoner never seems to return? In this paper, we present our first steps considering this problem. We describe the challenges and our approach, and present a prototype tool to help users identify reasoner performance bottlenecks with respect to their ontologies. We then describe 4 case studies on synthetic and real-world ontologies. While the anecdotal evidence suggests that the service can be useful for both ontology developers and reasoner implementors, much more is desired.