Spider of Archive.org: Referer and User Agent

Today the spider of the Archive was accessing my site. It looks like this in the server logs:

207.241.226.200 - - [28/Apr/2011:07:12:07 +0200] "GET /robots.txt HTTP/1.1" 200 864 "-" "ia_archiver(OS-Wayback)"
207.241.226.200 - - [28/Apr/2011:07:12:07 +0200] "GET / HTTP/1.1" 200 86476 "-" "ia_archiver(OS-Wayback)"

So the referer is - and the user agent ia_archiver(OS-Wayback).

Comments