| ||
Wed 2024-11-20
Tue 2024-11-19
Mon 2024-11-18
Sun 2024-11-17
Love, Acceptance, and Screeching Modems Sat 2024-11-16
Fri 2024-11-15
Search
Archives
2023
12 11 10 09 08 07 06 05 04 03 02 01
2022
2021
2020
2019
2018
2017
2016
2015
2014
2013
2012
2011
2010
2009
2008
2007
2006
2005
2004
2003
One good site
MDN
Nelson Minar
Blog licensed under a Creative Commons License
|
Some old broken Blosxom URL I had created a spider trap on my blog,
infinite URLs. But so far Inktomi is the only one dumb enough to fall
into it, querying URLs like
/~nelson/weblog/tech/Value%20Added%20<something>.html/
I fixed the bug a month ago and have now modified Blosxom to return
404 on these URLs. But Inktomi continues to hit me thousands of times
a day.
tech/dotnet/tech/dotnet/tech/photo/tech/dotnet/tech/ph oto/tech/photo/tech/bittorrent/tech/good/tech/bittorre nt/tech/photo/tech/good Spiders are a really dumb way to index the web. Too bad more clever solutions don't work. |
|
