Comments on: Average length of a URL http://www.supermind.org/blog/559/average-length-of-a-url A blog on Lucene, Solr, Nutch, crawling and vertical search Thu, 26 Aug 2010 08:00:19 +0000 http://wordpress.org/?v=abc hourly 1 By: Average length of a URL (Part 2) :: Kelvin Tan - Lucene Solr Nutch Consultant http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-17165 Average length of a URL (Part 2) :: Kelvin Tan - Lucene Solr Nutch Consultant Mon, 16 Aug 2010 19:49:18 +0000 http://www.supermind.org/?p=559#comment-17165 [...] 16 Aug 2010 at 02:49 pm | Tagged as: programming Here’s a follow-up on my previous attempt at calculating the average length of a URL, which was naive and totally [...]

[...] 16 Aug 2010 at 02:49 pm | Tagged as: programming Here’s a follow-up on my previous attempt at calculating the average length of a URL, which was naive and totally [...]

]]> By: Kelvin http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-17092 Kelvin Fri, 02 Jul 2010 14:31:45 +0000 http://www.supermind.org/?p=559#comment-17092 @Luying - you're absolutely right and when I have abit more time, I'm planning to perform a more comprehensive survey based on blog URLs, news feeds and the lot. @Luying - you’re absolutely right and when I have abit more time, I’m planning to perform a more comprehensive survey based on blog URLs, news feeds and the lot.

]]> By: Luying http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-17090 Luying Fri, 02 Jul 2010 13:40:08 +0000 http://www.supermind.org/?p=559#comment-17090 But these are mostly top level pages which usually have shorter URLs. But these are mostly top level pages which usually have shorter URLs.

]]> By: Brodie http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-16986 Brodie Tue, 23 Feb 2010 07:11:47 +0000 http://www.supermind.org/?p=559#comment-16986 Interesting, but I would be interested to see more statistical analysis of the URLs. i.e. smallest, largest, and 95%/98%/99.5% confidence for length of URL. I see that the raw mean helps with your requirement, but it doesn't answer questions like "How long should I make a database field to store a URL?". If we knew that (as an example), 98% of URLs will fit into a VARCHAR(100) field, and 99.5% will fit into VARCHAR(200) then it would make it easier to make these choices. Perhaps you would you like to contribute such knowledge to the benefit of all? :-) Regards, Brodie Interesting, but I would be interested to see more statistical analysis of the URLs. i.e. smallest, largest, and 95%/98%/99.5% confidence for length of URL. I see that the raw mean helps with your requirement, but it doesn’t answer questions like “How long should I make a database field to store a URL?”.

If we knew that (as an example), 98% of URLs will fit into a VARCHAR(100) field, and 99.5% will fit into VARCHAR(200) then it would make it easier to make these choices. Perhaps you would you like to contribute such knowledge to the benefit of all? :-)

Regards,
Brodie

]]>