The WP2 KPIs have been proposed in the shared WP2/WP4 discussions and have been approved by the EB in the April 2019 EB telco. We have established the following Key Performance Indicators for WP2.
- Number of catalogues connected to the federation
- Number of metadata elements that are searchable through the federated search per connected catalogue
- Number of searches per month
- Number of requests
Measuring of the KPI’s
The KPIs are measured on a monthly basis and the measurement will start at the point that the first connection in the federation is established.
Number of catalogues connected to the federation
The number of catalogues connected to the federation is established by listing the catalogues visible in one of the participating catalogues. We will establish an API for the federation protocol to enumerate the number of catalogues connected. Until such an API is established the number of participating catalogues will be counted manually.
Number of metadata elements that are searchable through the federated search per connected catalogue
The number of metadata elements that are searchable through the federated search is established by listing the elements per catalogue in each of the participating catalogues. We will establish an API for the federation protocol to publish and enumerate the searchable metadata elements in the catalogues connected. Until such an API is established the number will be counted manually.
Number of searches per month
The number of searches per month will be established by counting the number of requests made to the federated search API from each of the catalogues participating in the federated search. For each of the nodes we will only count the number of requests originating from that node. The total number will be the grand total of the numbers from the individual catalogues.
Number of requests
The number of requests per month will be established by counting the number of requests made in the request portals of each of the catalogues participating in the federated search. The number of requests will be deduplicated when the same request is filed in multiple portals. The requests will be counted in the month they were first filed in the portal. The number will be the total number of requests, regardless of whether the request is successful or not.