The SEALS project conducted the first worldwide evaluation of semantic tools using their SEALS platform. They evaluated ontology engineering tools, storage and reasoning systems, ontology matching tools, semantic search tools, and semantic web services tools. The results showed that certain tools performed better than others in each category. A white paper summarizing the results will be published soon, and the next evaluation campaign using the SEALS platform will begin in July 2011.
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
1st SEALS evaluation campaign results: a worldwide evaluation of semantic technologies
1. Results of the first worldwide evaluation campaign for semantic tools Dr Lyndon Nixon, STI International On behalf of the SEALS Project http://www.seals-project.eu 06.09.11
2.
3. SEALS (Semantic Evaluation At Large Scale) Universidad Politécnica de Madrid, Spain (Coordinator) University of Sheffield, UK Forschungszentrum Informatik, Germany University of Innsbruck, Austria Institut National de Recherche en Informatique et en Automatique, France University of Mannheim, Germany University of Zurich, Switzerland STI International, Austria Open University, UK Oxford University, UK Contact person: Asunción Gómez Pérez <asun@fi.upm.es> http://www.seals-project.eu/ EC contribution: 3.500.000 € Duration: June 2009-May 2012 1 3 1 2 1 2
4.
5.
6. Overall SEALS Platform Architecture SEALS Service Manager Runtime Evaluation Service SEALS Portal Test Data Repository Service Tools Repository Service Results Repository Service Evaluation Descriptions Repository Service SEALS Repositories Technology Providers Evaluation Organisers Technology Adopters Software agents, i.e., technology evaluators Entity management requests Evaluation requests
The SEALS platform is composed of seven components, four vertical components each one devoted to deal with the management of a SEALS entitiy, and two horizontal components, the first one devoted to the integration and coordination of the rest of the components, and the other devoted to the execution of the evaluations. The las t one is the SEALS portal that will be the UI of the platform. And this is how the different components are meant to be related to each other. The users will use the SEALS portal to submit entitiy management requests to the SEALS service manager, which will redirect to the appropriate entity management component. The user will also use the portal to submit evaluation requests to the SEALS service manager, which will forward the request to the Runtime Evaluation Service.
![Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],06.09.11](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)