- A multi-layer bloom filter for duplicated URL detection
2010/08/01 by Cen Zhiwang, Jungang Xu, Jian Sun · 1 citation
Computer Science · Chemistry · #Web Data Mining and Analysis #Caching and Content Delivery #Spam and Phishing Detection #Bloom filter #Computer science #Bloom #Filter (signal processing) #Layer (electronics) #The Internet #Web crawler #Algorithm #World Wide Web #Biology #Chemistry #Computer vision
- An Architectural Framework of a Crawler for Retrieving Highly Relevant Web Documents by Filtering Replicated Web Collections
2010/06/01 by Shashi Shekhar, Rohit Agrawal, K. V. Arya · 1 citation
Computer Science · #Web Data Mining and Analysis #Caching and Content Delivery #Algorithms and Data Compression #Web crawler #Computer science #World Wide Web #Information retrieval #Web search engine #Web page #Search engine #Web modeling #Web search query #Static web page #Spamdexing #Data Web #Web navigation
- Mining the Web's link structure
1999/01/01 by Soumen Chakrabarti, S. Chakrabarti, B.E. Dom +13 · 9 citations
Computer Science · Physics and Astronomy · #Complex Network Analysis Techniques #Computer science #HITS algorithm #Hyperlink #Hypertext #Index (typography) #Information retrieval #Search engine #Set (abstract data type) #Web Data Mining and Analysis #Web crawler #Web navigation #Web page #Web search engine #Web visibility and informetrics #World Wide Web