The Methodology of Search Log Analysis

Used properly, the data stored in search logs of Web search engines, Intranets, and Websites can provide important insights into understanding the information searching tactics of searchers.

With this understanding of users, one can improve information system design, interface development, and information architecture construction for content collections.

I wrote a book chapter that presents a review of and foundation for conducting Web search transaction log analysis. The chapter outlines a search log analysis methodology consisting of collection, preparation, and analysis. The three stages of the methodology are presented in detail with discussions of the goals, metrics, and processes at each stage.

The chapter also provides suggestions on ways to leverage the strengths and addressing the limitations of transaction log analysis for Web searching research.

See the book chapter on methodology of search log analysis