In searching engines, especially for ranked search approaches, How to evaluate the results returned by IR Systems . The precision is evaluated by the below equation:
(Number of relevant documents in retrieved documents)/(Number of retrieved documents).
However, how to decide which returned documents are relevant for the given query? For that, should we go through each returned document to find if it is relevant or not? Or should we say if any returned document contains all the query keywords?