Page aggregation for web sites

A method for determining whether first and second linked World Wide Web pages are part of the same Web site, the method comprising:n(a) determining a multi-byte IP address of a server on which resides the first page and a multi-byte IP address of a server on which resides the second linked page, the multi-byte IP address having at least four bytes;(b) if a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said first page is different than a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said second page, determining whether said first and second linked pages reside on at least one other combination of servers;(c) if said first page and said second linked page reside on at least one other combination of servers, repeating (a) and (b) for said at least one other combination of servers, such that if the leading subset of the bytes of a multi-byte IP address, the multi-byte IP address having at least four bytes, of a server from said combination upon which resides said first page is identical to the leading subset of the bytes of a multi-byte IP address, the multi-byte IP address having at least four bytes, of a server from said combination upon which resides said second page, concluding that said first and second linked pages are part of said same Web site, and concluding said process; and,(d) if (b) does not yield at least one other combination of servers, concluding that said first and second linked pages are not part of said same Web site.

A device for determining whether first and second linked World Wide Web pages are part of the same Web site, the device comprising:n(a) means for determining a multi-byte IP address of a server on which resides the first page and a multi-byte IP address of a server on which resides the second page, the multi-byte IP address having at least four bytes;(b) means for comparing said IP addressesn(i) such that an identity between a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said first page and a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said second page indicates that said first and second linked pages are part of said same Web site, and(ii) such that a difference between said leading subset of the bytes of said multi-byte IP address of said server upon which resides said first page and said leading subset of the bytes of said multi-byte IP address of said server upon which resides said second page requires a determination of whether said first page and said second page reside on at least one other combination of servers; and,(c) means for analyzing said at least one other combination of servers on which said first page and said second page reside, such that an absence of at least one other combination of servers on which said first page and said second page reside indicates that said first page and said second page are not part of said same Web site.

A computer storage medium containing a computer program having means for determining whether first and second linked World Wide Web pages are part of said same Web site, comprising:n(a) means for determining a multi-byte IP address of a server on which resides the first page and a multi-byte IP address of a server on which resides the second linked page, the multi-byte IP address having at least four bytes;(b) means for comparing said IP addressesn(i) such that an identity between a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said first page and a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said second page indicates that said first and second linked pages are part of said same Web site, and(ii) such that a difference between said leading subset of the bytes of said multi-byte IP address of said server upon which resides said first page and said leading subset of the bytes of said multi-byte IP address of said server upon which resides said second page requires a determination of whether said first page and second page reside on at least one other combination of servers; and,(c) means for analyzing said at least one other combination of servers on which said first page and said second page reside, such that an absence of at least one other combination of servers on which said first page and said second page reside indicates that said first page and said second page are not part of said same Web site.

A method of determining whether first and second pages are associated with the same site, the method of comprising:ndetermining Internet Protocol (IP) addresses of a pair of servers on which reside the first and second pages,based on a leading subset of one or more of the bytes of said IP addresses of said pair of servers being different, determining whether said first and second pages reside on one or more different pairs of servers, andbased on said first and second pages residing on one or more different pairs of servers:ndetermining IP addresses of each of said one or more different pairs of servers,comparing a leading subset of one or more of the bytes of said IP addresses of each of said one or more different pairs of servers to provide a comparison result for each of said one or more different pairs of servers, anddetermining that said first and second pages are associated with said same site based on at least one of said comparison results indicating that said leading subset of the bytes of said IP addresses of said one or more different pairs of servers are identical.

A method of identifying pages that are associated with the same site as a starting page, said method comprising:nbased on a pre-determined link processing order, processing all of said links on said starting page and all of said links on pages associated with said same sites as said starting page, wherein processing includes:nidentifying on a page one or more links to one or more different pages,determining IP addresses of a pair of servers on which reside said starting page and one of said one or more different pages,comparing a leading subset of one or more of the bytes of said IP addresses to provide a comparison result for said pair of servers, anddetermining that said starting page and said one of said one or more different pages are associated with said same site based on said comparison result for said pair of servers indicating that said leading subset of the bytes of said IP addresses of said pair of servers are identical.

A method of determining whether a site includes data related to a search query, said method comprising:ndetermining whether a starting page that is associated with said site includes data related to said search query,based on said starting page not including data related to said search query, processing one or more of: one or more links on said starting page and one or more links on pages determined to be associated with said same site as starting page, wherein processing includes:nidentifying on a page one or more links to one or more different pages, determining IP addresses of a pair of servers on which reside said starting page and one of said one or more different pages,comparing a leading subset of one or more of the bytes of said IP addresses to provide a comparison result for said pair of servers,determining that said starting page and said one of said one or more different pages are associated with said same site based on said comparison result indicating that said leading subset of the bytes of said IP addresses of said pair of servers are identical, andbased on said starting page and said one of said one or more different pages being associated with said same site, determining whether said one of said one or more different pages includes data related to said search query, andbased on one or more pages determined to be associated with said same site as said starting page including data related to said search query, determining that said site includes data related to said search query.