Comments on: Average length of a URL http://www.supermind.org/blog/559/average-length-of-a-url A blog on Lucene, Solr, crawling and vertical search Tue, 31 Jan 2012 16:00:00 +0000 hourly 1 http://wordpress.org/?v= By: How Much Money Do I Need to Buy the Internet? « here is a fantasy http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-19086 How Much Money Do I Need to Buy the Internet? « here is a fantasy Mon, 17 Oct 2011 01:40:40 +0000 http://www.supermind.org/?p=559#comment-19086 [...] let’s look at the average length of a url. It comes to 34 characters. Urls can be larger or smaller, but for our estimate, [...]

[...] let's look at the average length of a url. It comes to 34 characters. Urls can be larger or smaller, but for our estimate, [...]

]]> By: Warren http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-18913 Warren Sun, 29 May 2011 20:17:31 +0000 http://www.supermind.org/?p=559#comment-18913 You could also use MySQL's `text` data type, and not need to worry about field-size. You could also use MySQL's `text` data type, and not need to worry about field-size.

]]> By: Average length of a URL (Part 2) :: Kelvin Tan - Lucene Solr Nutch Consultant http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-17165 Average length of a URL (Part 2) :: Kelvin Tan - Lucene Solr Nutch Consultant Mon, 16 Aug 2010 19:49:18 +0000 http://www.supermind.org/?p=559#comment-17165 [...] 16 Aug 2010 at 02:49 pm | Tagged as: programming Here’s a follow-up on my previous attempt at calculating the average length of a URL, which was naive and totally [...]

[...] 16 Aug 2010 at 02:49 pm | Tagged as: programming Here's a follow-up on my previous attempt at calculating the average length of a URL, which was naive and totally [...]

]]> By: Kelvin http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-17092 Kelvin Fri, 02 Jul 2010 14:31:45 +0000 http://www.supermind.org/?p=559#comment-17092 @Luying - you're absolutely right and when I have abit more time, I'm planning to perform a more comprehensive survey based on blog URLs, news feeds and the lot. @Luying - you're absolutely right and when I have abit more time, I'm planning to perform a more comprehensive survey based on blog URLs, news feeds and the lot.

]]> By: Luying http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-17090 Luying Fri, 02 Jul 2010 13:40:08 +0000 http://www.supermind.org/?p=559#comment-17090 But these are mostly top level pages which usually have shorter URLs. But these are mostly top level pages which usually have shorter URLs.

]]> By: Brodie http://www.supermind.org/blog/559/average-length-of-a-url/comment-page-1#comment-16986 Brodie Tue, 23 Feb 2010 07:11:47 +0000 http://www.supermind.org/?p=559#comment-16986 Interesting, but I would be interested to see more statistical analysis of the URLs. i.e. smallest, largest, and 95%/98%/99.5% confidence for length of URL. I see that the raw mean helps with your requirement, but it doesn't answer questions like "How long should I make a database field to store a URL?". If we knew that (as an example), 98% of URLs will fit into a VARCHAR(100) field, and 99.5% will fit into VARCHAR(200) then it would make it easier to make these choices. Perhaps you would you like to contribute such knowledge to the benefit of all? :-) Regards, Brodie Interesting, but I would be interested to see more statistical analysis of the URLs. i.e. smallest, largest, and 95%/98%/99.5% confidence for length of URL. I see that the raw mean helps with your requirement, but it doesn't answer questions like "How long should I make a database field to store a URL?".

If we knew that (as an example), 98% of URLs will fit into a VARCHAR(100) field, and 99.5% will fit into VARCHAR(200) then it would make it easier to make these choices. Perhaps you would you like to contribute such knowledge to the benefit of all? :-)

Regards,
Brodie

]]>