Matches in ScholarlyData for { <https://w3id.org/scholarlydata/inproceedings/www2012/paper/1242> ?p ?o. }
Showing items 1 to 14 of
14
with 100 items per page.
- 1242 creator aaron-koehl.
- 1242 creator haining-wang.
- 1242 type InProceedings.
- 1242 label "Surviving a Search Engine Overload".
- 1242 sameAs 1242.
- 1242 abstract "Search engines are an essential component of the Web, but their web crawling agents can impose a significant burden on heavily loaded web servers. Unfortunately, blocking or deferring web crawler requests is not a viable solution as with purely malicious entities. We conduct a quantitative measurement study on the impact and cost of web crawling agents, seeking optimization points for this class of request. Based on our measurements, we present a practical approach for mitigating a search engine overload, implement the scheme on a very busy live web server, and evaluate its effectiveness. Our experimental results show that the proposed scheme is a practical and effective strategy for mitigating the threat of crawler overload to service quality.".
- 1242 hasAuthorList authorList.
- 1242 isPartOf proceedings.
- 1242 keyword "Caching".
- 1242 keyword "Dynamic Website".
- 1242 keyword "Overload".
- 1242 keyword "Search Engine".
- 1242 keyword "Web Crawler".
- 1242 title "Surviving a Search Engine Overload".