Matches in ScholarlyData for { ?s ?p ?o. }
- authorList hasLastItem item-5.
- item-1 type ListItem.
- item-1 hasContent ding-zhou.
- item-1 next item-2.
- item-2 type ListItem.
- item-2 hasContent shuyi-zheng.
- item-2 next item-3.
- item-2 previous item-1.
- item-3 type ListItem.
- item-3 hasContent jiang-bian.
- item-3 next item-4.
- item-3 previous item-2.
- item-4 type ListItem.
- item-4 hasContent hongyuan-zha.
- item-4 next item-5.
- item-4 previous item-3.
- item-5 type ListItem.
- item-5 hasContent c-lee-giles.
- item-5 previous item-4.
- 865 creator derek-leonard.
- 865 creator dmitri-loguinov.
- 865 creator hsin-tsang-lee.
- 865 type InProceedings.
- 865 label "IRLbot: Scaling to 6 Billion Pages and Beyond".
- 865 sameAs 865.
- 865 abstract "This paper shares our experience in designing web crawlers that scale to billions of pages and models their performance. We show that with the quadratically increasing complexity of verifying URL uniqueness, BFS crawl order, and fixed per-host rate-limiting, current crawling algorithms cannot effectively cope with the sheer volume of URLs generated in large crawls, highly-branching spam, legitimate multi-million-page blog sites, and infinite loops created by server-side scripts. We offer a set of techniques for dealing with these issues and test their performance in an implementation we call IRLbot. In our recent experiment that lasted 41 days, IRLbot running on a single server successfully crawled 6.3 billion valid HTML pages (7.6 billion connection requests) and sustained an average download rate of 308 mb/s (1789 pages/s). Unlike our prior experiments with algorithms proposed in related work, this version of IRLbot did not experience any bottlenecks and successfully handled content from over 260 million hosts, parsed out 394 billion links, and discovered a subset of the web graph with 41 billion unique nodes.".
- 865 hasAuthorList authorList.
- 865 hasTopic World_Wide_Web.
- 865 isPartOf proceedings.
- 865 keyword "algorithms".
- 865 keyword "crawler".
- 865 keyword "scalability".
- 865 title "IRLbot: Scaling to 6 Billion Pages and Beyond".
- authorList type List.
- authorList hasFirstItem item-1.
- authorList hasItem item-1.
- authorList hasItem item-2.
- authorList hasItem item-3.
- authorList hasLastItem item-3.
- item-1 type ListItem.
- item-1 hasContent hsin-tsang-lee.
- item-1 next item-2.
- item-2 type ListItem.
- item-2 hasContent derek-leonard.
- item-2 next item-3.
- item-2 previous item-1.
- item-3 type ListItem.
- item-3 hasContent dmitri-loguinov.
- item-3 previous item-2.
- 879 creator jens-grossklags.
- 879 creator john-chuang.
- 879 creator nicolas-christin.
- 879 type InProceedings.
- 879 label "Secure or insure? A game-theoretic analysis of information security games".
- 879 sameAs 879.
- 879 abstract "Despite general awareness of the importance of keeping one's system secure, and widespread availability of consumer security technologies, actual investment in security remains highly variable across the Internet population, allowing attacks such as distributed denial-of-service (DDoS) and spam distribution to continue unabated. By modeling security investment decision-making in established (e.g., weakest-link, best-shot) and novel games (e.g., weakest-target), and allowing expenditures in self-protection versus self-insurance technologies, we can examine how incentives may shift between investment in a public good (protection) and a private good (insurance), subject to factors such as network size, type of attack, loss probability, loss magnitude, and cost of technology. We can also characterize Nash equilibria and social optima for different classes of attacks and defenses. In the weakest-target game, an interesting result finds that, for almost all parameter settings, more effort is exerted at Nash equilibrium than at the social optimum. We may attribute this to the "strategic uncertainty" of players seeking to self-protect at just slightly above the lowest protection level.".
- 879 hasAuthorList authorList.
- 879 hasTopic World_Wide_Web.
- 879 isPartOf proceedings.
- 879 keyword "Economics of Internet".
- 879 keyword "Incentive-Centered Design and Engineering".
- 879 keyword "Reliability".
- 879 keyword "Security".
- 879 title "Secure or insure? A game-theoretic analysis of information security games".
- authorList type List.
- authorList hasFirstItem item-1.
- authorList hasItem item-1.
- authorList hasItem item-2.
- authorList hasItem item-3.
- authorList hasLastItem item-3.
- item-1 type ListItem.
- item-1 hasContent jens-grossklags.
- item-1 next item-2.
- item-2 type ListItem.
- item-2 hasContent nicolas-christin.
- item-2 next item-3.
- item-2 previous item-1.
- item-3 type ListItem.
- item-3 hasContent john-chuang.
- item-3 previous item-2.
- 899 creator bowei-du.
- 899 creator eric-brewer.
- 899 type InProceedings.
- 899 label "DTWiki: A Disconnection and Intermittency Tolerant Wiki".
- 899 sameAs 899.
- 899 abstract "Wikis have proven to be a valuable tool for collaboration and content generation on the web. Semi-structured and easy to use, wikis are well suited for meeting many emerging region needs in the areas of educational, collaboration facilitation and local content generation. However, despite their usefulness, current wiki software does not work well with the network environments found in emerging regions. This paper details the design and implementation of DTWiki, a wiki system which explictly addresses these network issues. The DTWiki system is able to cope with long-lasting partitions and bad connectivity while providing the functionality of popular wiki software such as ``MediaWiki'' and ``TWiki''.".
- 899 hasAuthorList authorList.
- 899 hasTopic World_Wide_Web.
- 899 isPartOf proceedings.
- 899 keyword "application".
- 899 keyword "technology for developing regions".
- 899 keyword "wiki".
- 899 title "DTWiki: A Disconnection and Intermittency Tolerant Wiki".
- authorList type List.
- authorList hasFirstItem item-1.
- authorList hasItem item-1.
- authorList hasItem item-2.
- authorList hasLastItem item-2.
- item-1 type ListItem.
- item-1 hasContent bowei-du.