Reviewing Headers
If you need to review web server headers, you can use the wget command.
wget -S http://www.mysite.com
or if you want it to behave as if you were a spider, you can pass the –spider option to it like this:
wget -S –spider http://www.mysite.com
You can also use lynx or curl. See some examples below.
lynx -head -dump http://www.mysite.com
or
curl -I http://www.mysite.com