Nelson's Weblog: tech / bad / badRobots


Mastodon @nelson@tech.lgbt Linkblog Sat 2024-12-21 License Plate Game Fri 2024-12-20 The Loves of my Life Musk + AfD Thu 2024-12-19 Another $2B Wed 2024-12-18 mail-tester.com Kenji and alcohol Amazon Time Sync hydroxychloroquine fraud withdrawn Tue 2024-12-17 A New Social Tacticalgramma Sun 2024-12-15 Drone nonsense Sat 2024-12-14 OK Nintendo 64 Fri 2024-12-13 Unix Windows LocalThunk interview Sora AI gymnastics Thu 2024-12-12 Queer interview Tue 2024-12-10 OldInsuranceMaps.net Sanborn Maps Harmeet Dhillon (CW: anti-trans) Uranian (sexuality) Search Archives 2023 12 11 10 09 08 07 06 05 04 03 02 01 2022 12 11 10 09 08 07 06 05 04 03 02 01 2021 12 11 10 09 08 07 06 05 04 03 02 01 2020 12 11 10 09 08 07 06 05 04 03 02 01 2019 12 11 10 09 08 07 06 05 04 03 02 01 2018 12 11 10 09 08 07 06 05 04 03 02 01 2017 12 11 10 09 08 07 06 05 04 03 02 01 2016 12 11 10 09 08 07 06 05 04 03 02 01 2015 12 11 10 09 08 07 06 05 04 03 02 01 2014 12 11 10 09 08 07 06 05 04 03 02 01 2013 12 11 10 09 08 07 06 05 04 03 02 01 2012 12 11 10 09 08 07 06 05 04 03 02 01 2011 12 11 10 09 08 07 06 05 04 03 02 01 2010 12 11 10 09 08 07 06 05 04 03 02 01 2009 12 11 10 09 08 07 06 05 04 03 02 01 2008 12 11 10 09 08 07 06 05 04 03 02 01 2007 12 11 10 09 08 07 06 05 04 03 02 01 2006 12 11 10 09 08 07 06 05 04 03 02 01 2005 12 11 10 09 08 07 06 05 04 03 02 01 2004 12 11 10 09 08 07 06 05 04 03 02 01 2003 12 11 10 09 08 07 06 05 04 03 02 01 2002 12 11 10 09 08 07 06 05 04 03 02 01 2001 12 11 10 09 08 07 One good site MDN Nelson Minar nelson@monkey.org Blog licensed under a Creative Commons License		301 redirect, eight months later About eight months ago I moved my blog to a new domain and set up 301 redirects to point everyone to it. 301 means "moved permanently": all bots should eventually stop hassling the old URL. Does it work? Mostly; here's a list of hits in last week's traffic from various bots. 808 hits, Rojobot A feed aggregator with several old RSS URLs they apparently have no way of updating. 424 hits, TailRank robot A service that claims to "find hot stories", in my case by looking at eight-month-old URLs and not following the "hot lead" that the site has moved. Grabs both RSS feeds and some HTML. 390 hits, Feedfetcher-Google RSS crawler for Google Reader. I'm pretty sure I know the guy responsible for this bot; tsk tsk, B. 254 hits, Yahoo! Slurp and 160 Googlebot Basic crawlers trying to grab some HTML. Arguably legitimate: they're verifying the 301 redirect is still live. 136 hits, BecomeBot Some shopping site bot. Guys, I got nothing to sell. 108 hits, AppleSyndication There's one person who uses the Safari RSS reader! Too bad about the bug. None of this matters much; the 301 is cheap to serve and other than the Rojo and Safari examples I think no one would care that I stopped serving it. At least the big consumers like BlogLines have all switched over. tech • bad 2006-08-13 16:45 Z Nelson's Weblog • tech • bad