Measuring Search, A Human Approach

James Rubinstein writes about human judgments for evaluating search:

Many people will dismiss human rating as an unnecessary step in developing or tuning a search algorithm. I assure you, it is not. You need to understand what relevance truly looks like within your search application, and that means having people look at some search results

Read more: