FCKW 0 Report post Posted January 21, 2005 (edited) Ip-Adressen von Suchmaschinen Um auch immer zu wissen wer die Seite gerade besucht, ist es interessant zu wissen, welche IP-Adressen den Suchmaschinen zuzuordnen sind. Daher stelle ich die aktuellen IP-Adressen der Spiders, Crawler und Robots zur Verfügung. Fast/Alltheweb IP-Adresse # FAST 146.101.142.222 146.101.142.223 146.101.142.224 146.101.142.225 146.101.142.226 146.101.142.227 146.101.142.228 146.101.142.229 146.101.142.230 146.101.142.231 146.101.142.232 146.101.142.233 146.101.142.234 146.101.142.235 146.101.142.236 146.101.142.237 146.101.142.238 146.101.142.239 146.101.142.240 146.101.142.241 146.101.142.242 146.101.142.243 146.101.142.244 146.101.142.245 146.101.142.246 146.101.142.247 146.101.142.248 146.101.142.249 146.101.142.250 146.101.142.251 146.101.142.252 146.101.142.253 200.221.10.240 207.201.123.246 208.186.202.28 209.202.148 209.67.247 213.188.8.2 213.188.8.4 213.188.8.76 216.35.112.141 216.35.112.142 216.35.112.143 216.35.112.50 216.35.112.51 62.41.154 64.41.254.23 64.41.254.24 64.41.254.25 66.77.73 66.77.74 Altavista IP-Adresse # Alta Vista 128.177.243 128.177.244.100 128.177.244.86 194.112.94.250 194.112.94.251 194.112.94.252 194.201.146.1 194.201.146.24 194.221.84.11 194.221.84.15 194.221.84.31 194.221.84.32 194.221.84.33 194.221.84.34 194.221.84.38 194.221.84.39 194.221.84.40 194.221.84.41 194.51.33.72 204.123.13.36 204.123.13.65 204.123.13.66 204.123.2 204.123.28.10 204.123.28.11 204.123.28.20 204.123.28.21 204.123.28.27 204.123.28.30 204.123.28.31 204.123.28.32 204.123.28.33 204.123.9 204.152.190 204.152.191 205.229.83.18 208.185.243.148 208.221.32 208.221.35.200 208.221.35.201 208.221.35.202 208.221.35.203 208.221.35.204 208.221.35.205 208.221.35.206 208.221.35.207 209.247.40.246 209.73.160.1 209.73.160.250 209.73.160.254 209.73.162 209.73.164 209.73.174.250 209.73.174.251 209.73.180 212.187.213.171 212.187.213.172 212.187.213.173 212.187.213.174 212.187.213.175 212.187.226 212.187.226.42 212.187.226.83 212.187.226.84 212.187.226.85 212.187.226.87 212.187.226.88 212.187.226.93 212.187.226.99 212.187.227 216.39.48 216.39.50 216.39.51 216.198.200.119 64.152.75 66.17.148.128 66.17.148.129 66.17.148.130 66.17.148.131 66.17.148.132 66.17.148.133 66.17.148.134 66.17.148.135 66.17.148.136 66.17.148.137 66.17.148.138 66.17.148.139 66.17.148.140 66.17.148.141 66.17.148.142 66.17.148.143 66.17.148.144 66.17.148.145 66.17.148.146 66.17.148.147 66.17.148.148 66.17.148.149 66.17.148.150 66.17.148.151 66.17.148.152 66.17.148.153 66.17.148.154 66.17.148.155 66.17.148.156 66.17.148.157 66.17.148.158 66.17.148.159 66.17.148.160 66.17.148.161 66.17.148.162 66.17.148.163 66.17.148.164 66.17.148.165 66.17.148.166 66.17.148.167 66.17.148.168 66.17.148.169 66.17.148.170 66.17.148.171 66.17.148.172 66.17.148.173 66.17.148.174 66.17.148.175 66.17.148.176 66.17.148.177 66.17.148.178 66.17.148.179 66.17.148.180 66.17.148.181 66.17.148.182 66.17.148.183 66.17.148.184 66.17.148.185 66.17.148.186 66.17.148.187 66.17.148.188 66.17.148.189 66.17.148.190 66.17.148.191 Lycos IP-Adresse # Lycos 166.48.225.254 202.232.118.40 202.232.118.51 206.79.171 207.77.90 207.77.91.184 208.146.26 208.146.27.123 208.146.27.124 208.146.27.57 208.146.27.58 208.146.27.59 208.146.27.60 208.146.27.62 208.146.27.89 208.146.27.90 208.146.27.91 208.146.27.92 208.146.27.93 208.146.27.94 208.146.27.95 208.146.27.96 209.202.192 209.202.192.147 209.202.193 209.202.194.237 209.202.194.238 209.202.240.109 209.202.240.8 209.67.228 209.67.229 211.51.63.4 213.193.19.35 64.89.33 Inktomi IP-Adresse # Inktomi # UA "Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)" 141.185.209 169.207.238 199.177.18.9 202.212.5.30 202.212.5.32 202.212.5.33 202.212.5.34 202.212.5.35 202.212.5.36 202.212.5.37 202.212.5.38 202.212.5.39 202.212.5.47 202.212.5.48 203.255.234.102 203.255.234.103 203.255.234.105 203.255.234.106 209.1.12 209.1.13.101 209.1.13.231 209.1.13.232 209.1.32.122 209.1.38 209.131.40 209.131.48 209.131.49.37 209.131.50.153 209.131.51.166 209.131.60.19 209.131.60.169 209.131.60.170 209.131.60.171 209.131.62.107 209.131.62.108 209.131.62.109 209.131.62.214 209.185.122 209.185.141 209.185.143 209.185.143.96 209.185.143.98 209.67.206.126 209.67.206.127 209.67.206.133 210.150.10 210.150.25 211.169.241.21 213.216.143.37 213.216.143.38 213.216.143.39 216.155.200 216.155.204.40 216.198.200.123 216.239.193.71 216.239.193.72 216.239.193.73 216.239.193.74 216.239.193.75 216.239.193.76 216.239.193.77 216.239.193.78 216.239.193.79 216.239.193.80 216.239.193.81 216.239.193.82 216.239.193.83 216.239.193.84 216.239.193.85 216.239.193.86 216.32.237.1 216.32.237.10 216.32.237.11 216.32.237.12 216.32.237.13 216.32.237.14 216.32.237.15 216.32.237.16 216.32.237.17 216.32.237.18 216.32.237.19 216.32.237.20 216.32.237.21 216.32.237.22 216.32.237.23 216.32.237.24 216.32.237.25 216.32.237.26 216.32.237.27 216.32.237.28 216.32.237.29 216.32.237.30 216.32.237.7 216.32.237.8 216.32.237.9 62.172.199.20 62.172.199.21 62.172.199.22 62.172.199.23 62.172.199.24 62.27.59.245 64.75.36.42 64.75.36.43 64.75.36.44 64.75.36.45 64.75.36.47 64.75.36.77 64.75.36.79 64.75.36.80 66.196.65 66.196.72 66.196.73 66.196.74 66.196.78 66.196.81.10 66.196.81.102 66.196.81.103 66.196.81.104 66.196.81.105 66.196.81.106 66.196.81.107 66.196.81.108 66.196.81.109 66.196.81.11 66.196.81.110 66.196.81.111 66.196.81.112 66.196.81.113 66.196.81.114 66.196.81.115 66.196.81.116 66.196.81.117 66.196.81.118 66.196.81.119 66.196.81.12 66.196.81.120 66.196.81.121 66.196.81.122 66.196.81.123 66.196.81.124 66.196.81.125 66.196.81.126 66.196.81.127 66.196.81.128 66.196.81.129 66.196.81.13 66.196.81.130 66.196.81.131 66.196.81.132 66.196.81.133 66.196.81.134 66.196.81.135 66.196.81.136 66.196.81.137 66.196.81.138 66.196.81.139 66.196.81.14 66.196.81.140 66.196.81.141 66.196.81.142 66.196.81.143 66.196.81.144 66.196.81.145 66.196.81.146 66.196.81.147 66.196.81.148 66.196.81.149 66.196.81.15 66.196.81.150 66.196.81.151 66.196.81.152 66.196.81.153 66.196.81.154 66.196.81.155 66.196.81.156 66.196.81.157 66.196.81.158 66.196.81.159 66.196.81.16 66.196.81.160 66.196.81.161 66.196.81.162 66.196.81.163 66.196.81.164 66.196.81.165 66.196.81.166 66.196.81.167 66.196.81.168 66.196.81.169 66.196.81.17 66.196.81.170 66.196.81.171 66.196.81.172 66.196.81.173 66.196.81.174 66.196.81.175 66.196.81.176 66.196.81.177 66.196.81.178 66.196.81.179 66.196.81.18 66.196.81.180 66.196.81.181 66.196.81.182 66.196.81.183 66.196.81.184 66.196.81.185 66.196.81.187 66.196.81.188 66.196.81.189 66.196.81.19 66.196.81.190 66.196.81.191 66.196.81.192 66.196.81.193 66.196.81.194 66.196.81.195 66.196.81.196 66.196.81.197 66.196.81.198 66.196.81.199 66.196.81.20 66.196.81.200 66.196.81.201 66.196.81.202 66.196.81.203 66.196.81.204 66.196.81.205 66.196.81.206 66.196.81.207 66.196.81.208 66.196.81.209 66.196.81.21 66.196.81.210 66.196.81.211 66.196.81.212 66.196.81.213 66.196.81.214 66.196.81.215 66.196.81.216 66.196.81.217 66.196.81.218 66.196.81.219 66.196.81.22 66.196.81.23 66.196.81.86 66.196.81.87 66.196.81.88 66.196.81.93 66.196.81.94 66.196.81.95 66.196.81.96 66.196.90 66.196.97 66.196.99.20 Wisenut IP-Adresse # WISEnut # UA "Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)" 64.241.243.123 64.241.242.177 64.241.243.65 64.241.243.124 65.116.145.141 65.113.96.174 65.116.145 66.35.208.59 66.35.208.60 66.35.208.112 66.35.208.158 66.35.208.160 66.35.208.206 66.35.208.210 66.35.208.211 208.232.154.64 209.249.66.10 209.249.66.26 209.249.66.36 209.249.67.101 209.249.67.102 209.249.67.103 209.249.67.104 209.249.67.105 209.249.67.106 209.249.67.107 209.249.67.108 209.249.67.109 209.249.67.110 209.249.67.111 209.249.67.112 209.249.67.113 209.249.67.114 209.249.67.115 209.249.67.116 209.249.67.117 209.249.67.118 209.249.67.119 209.249.67.120 209.249.67.121 209.249.67.122 209.249.67.125 209.249.67.126 209.249.67.127 209.249.67.128 209.249.67.129 209.249.67.130 209.249.67.131 209.249.67.132 209.249.67.133 209.249.67.134 209.249.67.135 209.249.67.136 209.249.67.137 209.249.67.138 209.249.67.139 209.249.67.140 209.249.67.141 209.249.67.142 209.249.67.143 209.249.67.144 210.109.141.5 216.34.42.12 216.34.42.14 216.34.42.36 216.34.42.38 216.34.42.42 216.34.42.47 216.34.42.54 216.34.42.55 216.34.42.56 216.34.42.57 216.34.42.59 216.34.42.110 216.34.42.111 216.34.42.112 216.34.42.113 216.34.42.114 216.34.42.115 216.34.42.116 216.34.42.117 216.34.42.171 216.34.42.172 216.34.42.173 216.34.42.176 216.34.42.210 216.34.42.211 216.34.42.212 216.34.42.213 216.34.42.214 216.34.42.215 216.34.42.216 216.34.42.217 216.88.158.142 Google-IP-Adresse # Google # UA "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" # UA "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)" 164.71.1.146 164.71.1.147 164.71.1.148 164.71.1.149 192.51.44.10 192.51.44.13 192.51.44.18 192.51.44.19 207.88.29.130 209.185.108 209.185.253 210.131.75.80 210.131.75.81 210.131.75.82 210.131.75.83 210.131.75.84 212.105.61.249 216.239.33.96 216.239.33.97 216.239.33.98 216.239.33.99 216.239.37.98 216.239.37.99 216.239.39.98 216.239.39.99 216.239.41.96 216.239.41.97 216.239.41.98 216.239.41.99 216.239.45.4 216.239.46 216.239.51.96 216.239.51.97 216.239.51.98 216.239.51.99 216.239.53.98 216.239.53.99 216.239.57.96 216.239.57.97 216.239.57.98 216.239.57.99 216.239.59.98 216.239.59.99 62.27.59.227 63.83.186.67 64.68.80 64.68.81 64.68.82 64.68.83 64.68.84 64.68.85 64.68.86 64.68.87 64.68.88 64.208.32.4 64.208.32.11 64.208.32.12 64.208.33.33 64.208.36 64.208.37 weiters gibt es eine weitere Liste von möglichen Google-IP-Adressen: 209.185.253.167 c2.googlebot.com 209.185.253.168 c3.googlebot.com 209.185.253.169 c1.googlebot.com 209.185.253.170 c4.googlebot.com 209.185.253.171 c5.googlebot.com 209.185.253.172 c6.googlebot.com 209.185.253.173 c7.googlebot.com 209.185.253.174 c8.googlebot.com 209.185.253.175 c9.googlebot.com 209.185.253.176 c10.googlebot.com 209.185.253.177 c11.googlebot.com 209.185.253.178 c12.googlebot.com 209.185.253.179 c13.googlebot.com 209.185.253.180 c14.googlebot.com 209.185.253.181 c15.googlebot.com 209.185.253.182 c16.googlebot.com 209.185.253.183 c17.googlebot.com 209.185.253.184 c18.googlebot.com 209.185.253.185 c19.googlebot.com 209.185.253.186 c20.googlebot.com 209.185.253.187 c21.googlebot.com 209.185.253.188 c22.googlebot.com 209.185.108.138 a1.google.com 209.185.108.139 a2.google.com 209.185.108.140 a3.google.com 209.185.108.141 a4.google.com 209.185.108.142 a5.google.com 209.185.108.143 a6.google.com 209.185.108.144 a7.google.com 209.185.108.145 a8.google.com 209.185.108.146 a9.google.com 209.185.108.147 a10.google.com 209.185.108.148 a11.google.com 209.185.108.149 a12.google.com 209.185.108.150 a13.google.com 209.185.108.151 a14.google.com 209.185.108.152 a15.google.com 209.185.108.153 a16.google.com 209.185.108.154 a17.google.com 209.185.108.155 a18.google.com 209.185.108.156 c2.google.com 209.185.108.157 c3.google.com 209.185.108.158 c1.google.com 209.185.108.159 a19.google.com 209.185.108.160 a20.google.com 209.185.108.161 c4.google.com 209.185.108.162 a21.google.com 209.185.108.163 a22.google.com 209.185.108.164 a23.google.com 209.185.108.165 a24.google.com 209.185.108.134 ns.google.com 209.185.108.135 ns2.google.com 64.209.181.52 crawler1.googlebot.com 64.208.33.33 crawl1.googlebot.com 64.209.181.53 crawler2.googlebot.com 64.68.82.22 64.68.82.23 64.68.82.24 64.68.82.25 64.68.82.26 64.68.82.27 64.68.82.28 64.68.82.29 64.68.82.30 64.68.82.1 64.68.82.2 64.68.82.3 64.68.82.4 64.68.82.5 64.68.82.6 64.68.82.7 64.68.82.8 64.68.82.9 64.68.82.10 64.68.82.11 64.68.82.12 64.68.82.13 64.68.82.14 64.68.82.15 64.68.82.16 64.68.82.17 64.68.82.18 64.68.82.19 64.68.82.20 64.68.82.21 64.68.82.50 64.68.82.51 64.68.82.52 64.68.82.53 64.68.82.54 64.68.82.55 64.68.82.56 64.68.82.57 64.68.82.58 64.68.82.59 64.68.82.60 64.68.82.31 64.68.82.32 64.68.82.33 64.68.82.34 64.68.82.35 64.68.82.36 64.68.82.37 64.68.82.38 64.68.82.39 64.68.82.40 64.68.82.41 64.68.82.42 64.68.82.43 64.68.82.44 64.68.82.45 64.68.82.46 64.68.82.47 64.68.82.48 64.68.82.49 64.68.82.76 64.68.82.77 64.68.82.78 64.68.82.79 64.68.82.80 64.68.82.61 64.68.82.62 64.68.82.63 64.68.82.64 64.68.82.65 64.68.82.66 64.68.82.67 64.68.82.68 64.68.82.69 64.68.82.70 64.68.82.71 64.68.82.72 64.68.82.73 64.68.82.74 64.68.82.75 Most google Agents, are:Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/) Googlebot/2.1 (+http://www.googlebot.com/bot.html) (version maybe 2.0) Other Possible Agents: Googlebot/2.0 beta (googlebot(at)googlebot.com) Googlebot/2.1 (+http://googlebot.com/bot.html) Googlebot/2.0 (+http://googlebot.com/bot.html) Googlebot/1.0 (googlebot(at)googlebot.com) Googlebot/2.1w (+http://googlebot.com/bot.html) Googlebot-w/2.1 (+http://googlebot.com/bot.html) Googlebot/1.0 The spider formerly known as Backrub has changed to Google Bot. Backrub is 100% defunct. Also here is what we believe to be someone at the keyboard. dsl.google.com Mozilla/4.51 [en] (X11; I; Linux 2.2.5-15 i686) 207.88.29.130 (a good ip# to know). Their main googlebot routers: 209.185.253.166 switch2.googlebot.com, 209.185.108.136 switch.google.com ASK-Jeeves/Teoma IP-Adresse # Ask Jeeves/Teoma # UA "Mozilla/2.0 (compatible; AskJeeves/Teoma)" 140.239.126.13 140.239.251.220 140.239.251.221 140.239.251.222 140.239.251.223 140.239.251.224 140.239.251.230 207.204.132.233 207.204.132.234 208.178.104.55 209.67.252.197 209.67.252.199 209.67.252.211 209.67.252.212 209.67.252.213 209.67.252.214 209.67.252.215 209.67.252.216 211.13.230.249 216.200.130.200 216.200.130.201 216.200.130.202 216.200.130.203 216.200.130.204 216.200.130.205 216.200.130.206 216.200.130.207 216.200.130.208 216.200.130.209 216.200.130.210 216.200.130.242 216.200.130.244 216.200.130.245 216.200.130.246 216.200.130.248 216.200.130.249 216.200.130.26 216.200.130.77 216.200.130.78 216.200.130.79 216.200.130.85 216.200.130.86 216.200.130.87 216.200.130.88 216.200.130.89 216.34.121.100 216.34.121.18 216.34.121.19 216.34.121.31 216.34.121.32 216.34.121.33 216.34.121.34 216.34.121.67 216.34.121.68 63.236.92.143 63.236.92.144 63.236.92.145 63.236.92.146 63.236.92.147 63.236.92.148 63.236.92.149 63.236.92.150 63.236.92.151 63.236.92.152 63.236.92.153 64.55.148.37 64.55.148.38 64.55.148.39 64.55.148.43 64.55.148.44 64.55.148.45 64.55.148.50 64.55.148.51 64.55.148.52 64.55.148.53 64.55.148.54 65.192.195.0 65.192.195.1 65.192.195.10 65.192.195.11 65.192.195.12 65.192.195.13 65.192.195.14 65.192.195.15 65.192.195.16 65.192.195.17 65.192.195.18 65.192.195.19 65.192.195.2 65.192.195.20 65.192.195.21 65.192.195.22 65.192.195.23 65.192.195.24 65.192.195.25 65.192.195.26 65.192.195.27 65.192.195.28 65.192.195.29 65.192.195.3 65.192.195.30 65.192.195.31 65.192.195.4 65.192.195.5 65.192.195.6 65.192.195.7 65.192.195.8 65.192.195.9 65.214.36.100 65.214.36.101 65.214.36.102 65.214.36.103 65.214.36.104 65.214.36.105 65.214.36.106 65.214.36.107 65.214.36.108 65.214.36.109 65.214.36.110 65.214.36.111 65.214.36.112 65.214.36.113 65.214.36.114 65.214.36.115 65.214.36.116 65.214.36.117 65.214.36.118 65.214.36.119 65.214.36.12 65.214.36.120 65.214.36.121 65.214.36.122 65.214.36.123 65.214.36.125 65.214.36.126 65.214.36.127 65.214.36.128 65.214.36.129 65.214.36.140 65.214.36.141 65.214.36.142 65.214.36.143 65.214.36.144 65.214.36.145 65.214.36.146 65.214.36.147 65.214.36.148 65.214.36.149 65.214.36.150 65.214.36.151 65.214.36.152 65.214.36.153 65.214.36.154 65.214.36.155 65.214.36.156 65.214.36.157 65.214.36.158 65.214.36.159 65.214.36.160 65.214.36.161 65.214.36.162 65.214.36.163 65.214.36.164 65.214.36.165 65.214.36.166 65.214.36.167 65.214.36.168 65.214.36.169 65.214.36.175 65.214.36.176 65.214.36.177 65.214.36.178 65.214.36.179 65.214.36.185 65.214.36.196 65.214.36.197 65.214.36.198 65.214.36.199 65.214.36.20 65.214.36.201 65.214.36.203 65.214.36.205 65.214.36.206 65.214.36.207 65.214.36.21 65.214.36.210 65.214.36.211 65.214.36.212 65.214.36.215 65.214.36.216 65.214.36.217 65.214.36.218 65.214.36.219 65.214.36.22 65.214.36.221 65.214.36.222 65.214.36.23 65.214.36.233 65.214.36.24 65.214.36.240 65.214.36.241 65.214.36.242 65.214.36.243 65.214.36.244 65.214.36.245 65.214.36.246 65.214.36.248 65.214.36.249 65.214.36.25 65.214.36.250 65.214.36.251 65.214.36.252 65.214.36.26 65.214.36.27 65.214.36.28 65.214.36.29 65.214.36.30 65.214.36.31 65.214.36.32 65.214.36.33 65.214.36.34 65.214.36.42 65.214.36.43 65.214.36.44 65.214.36.45 65.214.36.46 65.214.36.50 65.214.36.51 65.214.36.52 65.214.36.53 65.214.36.54 65.214.36.55 65.214.36.58 65.214.36.59 65.214.36.7 65.214.36.8 65.214.36.80 65.214.36.81 65.214.36.82 65.214.36.83 65.214.36.84 65.214.36.85 65.214.36.86 65.214.36.87 65.214.36.88 65.214.36.89 65.214.36.9 65.214.38.10 Diverse Suchmaschinen IP-Adressen # Misc # 100hot 206.253.217.18 # 2kcity.com 63.222.37.101 63.222.37.105 # A-Online 195.3.97.3 # Abacho 193.110.40.93 194.231.30.86 194.231.30.87 194.231.30.88 194.231.30.89 194.231.30.90 194.231.30.91 194.231.30.92 194.231.30.93 194.231.30.108 194.231.30.109 194.231.68.166 # Abadoor 209.68.2.36 # Abrexa.co.uk 194.117.133.180 # Acoon 194.231.42.185 # Ah-Ha 208.204.161.8 216.250.141.186 # Aeiwi # UA "Marvin v0.3" 207.126.112.254 209.120.206.178 212.91.134.190 216.178.189.230 130.225.20.4 64.247.218.197 # Ahoy! The Homepage Finder 140.142.13.196 # Aladin 194.231.30.14 194.231.0.71 194.231.30.11 # Allesklar 195.37.68.3 195.37.68.65 195.37.68.180 195.37.68.181 # AllFreak.com 209.239.48.69 # ANAGRAROBOT 194.231.42.178 # Ananzi 167.160.195.61 # AnnoMille 80.16.145.187 # Ano-Kato.com (Greek) # UA "ano-kato.com v2.14 spider" 64.246.36.123 # AntiSearch # 62.210.155.50 # 62.210.155.56 # 62.210.155.58 # 62.210.155.59 # Apidom (Guadeloupe) 192.41.9.30 192.41.9.30 208.237.120.82 # Arianna 195.210.89.11 195.210.91.24 195.210.91.80 195.210.91.112 195.210.91.113 195.210.91.187 195.210.91.212 195.210.91.213 195.210.91.214 195.210.91.235 195.210.91.215 192.92.126.4 192.92.126.5 # Backrub 171.64.68.80 171.64.75.100 171.64.75.104 # Baidu # UA "BaiDuSpider" # UA "Baiduspider+(+http://www.baidu.com/search/spider.htm)" 162.105.207.185 162.105.207.192 202.103.134.196 202.108.249.184 202.108.249.185 202.108.249.186 202.108.249.187 202.108.249.188 202.108.249.189 202.108.249.190 202.108.250.195 202.108.250.196 202.108.250.197 202.108.250.198 202.108.250.199 202.108.250.206 202.108.250.207 202.108.250.226 202.108.250.241 202.108.250.242 202.108.250.243 211.100.24.90 211.100.24.91 211.100.24.92 211.100.24.93 211.100.24.94 211.100.24.95 211.100.24.96 211.100.24.97 211.100.25.196 211.100.25.197 211.100.25.198 211.100.25.199 211.100.25.200 211.100.25.202 211.100.25.204 211.101.48.53 61.149.2.221 # Batsch 204.251.93.10 # Bellnet bellnet.com 208.28.152.71 # BizSearch 194.198.230.36 # BlackSpider 210.159.73.36 210.159.73.35 # BlackWidow 140.190.65. # Blitzsuche blitzsuche.de 194.231.30.106 194.231.30.107 194.231.30.108 # Boitho # UA "boitho.com-robot/1.1" 217.118.38.226 217.118.38.227 217.118.38.228 217.118.38.229 217.118.38.230 217.118.38.231 217.118.38.232 217.118.38.233 217.118.38.234 # Brainbot (Gigabaz) 151.189.96.99 134.93.7.97 134.93.7.98 # Brainysearch 64.57.64.90 # Brazilian Research Network 200.215.16.125 # CACTVS Chemistry Spider 131.188.128.229 194.199.4.2 # Chimera (eSense) 192.115.137.202 192.115.136.15 64.28.94.71 # Cipinet # UA "CipinetBot (http://www.cipinet.com/bot.html)" # 203.122.61.30 # Claymont 198.138.63.1 198.138.63.22 198.139.155.10 # Colorstamps 209.10.61.5 # Combine System 130.235.86.152 # Comunet 195.76.40.251 # ConceptBot 66.47.255.121 # Crawler.de # UA "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler)" 80.182.226.190 195.20.224.72 195.20.224.73 # CS Hkust Wise 143.89.40.159 # CurryGuide 192.41.34.245 192.41.43.146 192.41.49.235 # DavesEngine 208.185.131.219 208.185.131.220 208.185.131.221 208.185.131.222 216.200.195.53 216.200.195.58 216.200.195.60 216.200.195.57 216.200.195.59 216.200.195.61 # DeepIndex # UA "DeepIndex" 62.212.117.198 # DIE-KRAEHE # UA "-DIE-KRAEHE- META-SEARCH-ENGINE/1.0 http://www.die-kraehe.com" 217.160.94.14 # Domanova 217.146.97.27 # DragonNext 210.199.215.54 # eFamily 208.186.202.21 # Egoto.com Spain # UA "EgotoBot/4.8 (+http://www.egoto.com/about.htm)" 62.57.74.14 # EDSA Phillipines 210.16.10.40 # entireweb.com # UA "Speedy_Spider (http://www.entireweb.com)" 193.15.210.29 193.15.210.29 62.13.25.201 62.13.25.209 # Esoterica 209.198.242.61 # Eule 194.231.76.158 # EuroFerret (MuscatFerret) 194.168.54.6 194.168.54.11 # EuroOne 195.95.124.3 195.95.124.7 # EuroSeek 212.209.54.40 212.209.54.134 195.242.46.55 # ExactSeek.com # UA "eseek-larbin_2.6.2 crawler@exactseek.com" 207.36.47.237 216.110.167.157 # Exalead (NG/1.0) # UA "Exalead NG/MimeLive Client (convert/http/0.120)" 195.154.174.164 195.154.174.167 213.174.84.195 # Excite 198.3.103 199.172.148.105 199.172.148.11 199.172.148.37 199.172.149 199.172.152.238 199.172.152.34 199.172.152.54 199.172.152.56 199.172.152.57 199.172.152.95 199.172.153.174 199.172.153.178 199.172.156.168 199.172.156.169 199.172.156.170 199.172.156.219 199.172.157.28 204.62.245.167 204.62.245.169 204.62.245.178 204.62.245.187 204.62.245.32 216.131.41.1 216.131.41.10 216.131.41.2 216.131.41.3 216.131.41.4 216.131.41.5 216.131.41.6 216.131.41.7 216.131.41.8 216.131.41.9 # Exodus.Net 209.67.252.214 # EZResult 64.14.66.11 64.14.66.100 # FetchRover 192.41.15.30 # FindLink.com 207.86.79.6 207.86.79.12 # findquick.com 207.153.57.51 # Fireball # UA "Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5)" 193.7.255.21 193.7.255.33 193.7.255.90 193.7.255.121 193.7.255.122 193.7.255.130 193.7.255.142 193.7.255.22 193.7.255.241 193.7.255.242 193.7.255.244 # First-Search 217.75.104.26 63.121.41.166 63.121.41.172 63.121.41.173 63.121.41.174 63.121.41.176 63.121.41.177 208.131.25.166 208.131.25.167 208.131.25.169 198.173.35.169 198.173.35.170 198.173.35.171 63.121.41.175 # Fish search 131.155.70.189 # Flix 195.190.21.70 # Francoroute 132.218.30.216 # FreeFind 205.179.93.66 # Funkycat Search 151.196.224.70 209.176.27.63 64.208.104.2 # FunnelWeb 203.21.15.10 # Galaxy # UA "Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.ads-work.com; +http://www.galaxy.com/info/crawler.html)" 208.131.25.6 216.206.178.81 216.206.178.83 216.206.178.85 208.131.25.168 63.121.41.178 63.121.41.179 # Gais 140.123.101.14 # gasta 194.46.8.25 # Geobot # UA "Geobot/0.1 http://www.geobot.co.uk" 216.127.80.23 # Gigablast # UA "Gigabot/1.0" # 208.254.87.133 # 216.243.113.1 # 216.243.113.81 # 216.243.113.84 # 217.75.103.130 # Goo 210.150.25.156 202.229.31.13 202.229.31.14 202.229.31.15 210.150.10.100 # GoZero Search 216.181.122.11 216.181.122.110 # GoZilla 212.125.68.30 # Grub 206.30.142.100 # Harvest 193.62.81.96 193.62.81.96 # HiddenStreet.com 64.246.15.61 # HI (HTML Index) Search 192.41.170.17 # Hitbox 208.232.223.80 # Hitsearch 216.55.4.15 # HotBot 209.1.12.2 209.1.12.220 209.1.12.221 209.1.12.222 209.1.12.224 209.1.12.225 209.1.12.226 209.1.12.227 209.1.12.228 209.1.12.229 209.1.12.230 209.1.12.231 209.1.12.232 209.1.12.233 209.1.12.234 209.1.12.235 209.1.12.236 209.1.12.237 209.1.12.238 209.1.12.239 209.1.12.240 209.1.12.241 209.1.12.242 # HotWired 204.62.132.20 # HTDig 209.75.193.22 # Hubat 209.114.176.250 # IBM_Planetwide 204.146.80.99 204.146.81.99 # icorus.com 209.239.36.253 # ICQ 205.188.147.53 205.188.147.56 205.188.252.121 # Ideare 212.123.67.70 # IErachnid # UA "IErachnid 3.0 http://uk.searchengineeurope.com" 193.120.253.2 # ILSE 213.244.181.190 212.72.39.2 194.134.109.3 194.134.109.7 194.134.109.17 194.134.109.21 212.72.39.8 212.72.39.3 212.72.39.4 212.72.39.5 212.72.39.6 212.72.39.7 212.72.39.9 212.72.39.10 212.72.39.11 212.72.39.12 212.72.39.13 212.72.39.14 212.72.39.15 212.72.39.16 212.72.39.17 212.72.39.18 212.72.39.19 212.72.39.20 212.72.39.21 212.72.39.22 212.72.39.23 212.72.39.24 212.72.39.27 212.72.39.28 212.72.39.29 212.72.39.30 212.72.39.194 212.72.39.195 212.72.39.196 212.72.39.197 212.72.39.198 212.72.39.199 212.72.39.200 212.72.39.201 212.72.39.202 212.72.39.203 212.72.39.204 212.72.39.205 212.72.39.206 212.72.39.207 212.72.39.208 212.72.39.209 212.72.39.210 212.72.39.211 212.72.39.212 212.72.39.213 212.72.39.214 212.72.39.215 212.72.39.216 212.72.39.217 212.72.39.218 212.72.39.219 212.72.39.220 212.72.39.221 # Infobee 210.165.39.216 210.165.39.217 210.165.39.216 210.165.39.244 210.165.39.245 210.165.39.246 210.165.39.247 210.165.39.248 210.165.39.249 210.165.39.250 210.165.39.252 210.165.39.254 # Infomak 165.254.215.60 165.254.215.61 165.254.215.62 165.254.215.63 # Informant 129.170.24.57 # Infoseek 195.145.119.24 195.145.119.25 198.5.208 198.5.210 202.33.250.146 202.33.250.147 202.33.250.148 202.33.250.149 202.33.250.150 202.33.250.151 202.33.250.152 202.33.250.153 202.33.250.154 204.162.96 204.162.97.1 204.162.97.152 204.162.97.17 204.162.97.2 204.162.97.205 204.162.97.228 204.162.97.231 204.162.97.3 204.162.97.32 204.162.98.11 204.162.98.12 204.162.98.124 204.162.98.126 204.162.98.151 204.162.98.161 204.162.98.168 204.162.98.18 204.162.98.192 204.162.98.2 204.162.98.237 204.162.98.27 204.162.98.3 204.162.98.36 204.162.98.38 204.162.98.4 204.162.98.45 204.162.98.48 204.162.98.49 204.162.98.5 204.162.98.6 204.162.98.7 204.162.98.8 204.162.98.80 204.162.98.88 204.162.98.9 204.162.98.91 204.162.98.98 204.202.132.19 205.226.201 205.226.203.186 205.226.203.35 205.226.203.56 205.226.203.62 205.226.204.238 206.3.30.196 206.3.30.250 206.3.30.251 210.148.160.157 210.155.157 210.155.159 210.236.233.130 210.236.233.131 210.236.233.132 210.236.233.133 210.236.233.135 210.236.233.136 210.236.233.137 210.236.233.139 210.236.233.150 210.236.233.151 210.236.233.155 210.236.233.160 210.236.233.161 211.13.222.230 211.18.214.194 212.185.44.10 212.185.44.11 212.185.44.12 212.185.44.15 # InfoSpiders 128.255.244.88 # Inter-Fux 195.57.152.80 # Internet Archiver # 206.132.56.130 # Internet Portal 3000 209.133.111.132 216.200.196.8 216.200.196.9 216.200.196.10 216.200.196.11 216.200.196.12 216.200.196.13 216.200.196.14 216.200.196.15 # Intersearch 194.232.15.65 # ISIZE (jp) 133.194.226.226 # iSparkle 193.195.19.10 # ISpi Crawler 207.82.104.100 # it LOOX 66.240.140.190 # iWon 216.33.59.61 # JAYDE.COM 208.239.240.102 66.28.139.66 # JAYDE.DE 195.226.160.249 # jblue 216.234.161.144 # Jippii.fi 195.211.11.50 # Job Robot (Jobot) 216.148.213.150 # The Jubii Indexing Robot 212.112.128.30 # JumpStation 139.153.13.200 # Kanoodle 216.33.119.136 216.33.119.138 38.170.72.194 # Keywen Encyclopedia # UA "EasyDL/3.04 http://keywen.com/Encyclopedia/Bot" 24.57.240.53 # Kolibri 151.189.12.140 # Kuloko # UA "kulokobot www.kuloko.com kuloko@backweave.com" # UA "kuloko-bot/0.2" 66.90.81.41 66.227.104.196 # Look.com # UA "NetResearchServer(http://www.look.com)" 209.87.232.5 # Looksmart # UA "Mozilla/4.0 (compatible; grub-client-1.2.1; Crawl your own stuff with http://grub.org)" # UA "MARTINI" 207.138.42.212 64.241.242.160 64.241.242.18 64.241.242.34 # Lotse 195.20.224.66 # Magpie 195.153.48.120 # mande 216.94.9.119 # Mcmail 195.44.0.150 195.44.0.104 195.44.0.152 195.44.0.153 # MerzScope 207.158.203.71 # Metager 130.75.2.24 130.75.6.10 # Mirago (UK) # UA "HenryTheMiragoRobot" # UA "HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)" 194.202.39.44 217.154.244.217 217.154.244.228 217.154.244.229 217.154.244.230 217.154.244.231 217.154.244.232 217.154.244.233 217.154.244.234 217.154.244.235 217.205.60 217.205.61 # Mister-Jack 195.200.163.250 195.200.169.193 # MixCat 198.31.135.245 # MSN # UA "MSNBOT/0.1 (http://search.msn.com/msnbot.htm)" 131.107.137.37 131.107.137.47 131.107.137.165 131.107.137.166 131.107.163.47 131.107.163.48 131.107.163.49 131.107.163.57 131.107.163.58 204.4.80.10 204.95.98.251 204.95.98.252 #131.107.3.11 #131.107.3.12 #131.107.3.13 #131.107.3.14 #131.107.3.15 #131.107.3.16 #131.107.3.17 #131.107.3.18 #131.107.3.19 #131.107.3.20 #131.107.3.21 #131.107.3.22 #131.107.3.24 #131.107.3.25 #131.107.3.26 #131.107.3.27 #131.107.3.28 #131.107.3.29 #131.107.3.30 #131.107.3.31 #131.107.3.32 #131.107.3.33 #131.107.3.34 #131.107.3.35 #131.107.3.36 #131.107.3.37 #131.107.3.38 #131.107.3.39 #131.107.3.40 #131.107.39.12 #131.107.3.44 #131.107.3.45 #131.107.3.46 #131.107.3.70 #131.107.3.71 #131.107.3.72 #131.107.3.73 #131.107.3.74 #131.107.3.75 #131.107.3.76 #131.107.3.77 #131.107.3.78 #131.107.3.79 #131.107.3.82 #131.107.3.83 #131.107.3.84 #131.107.3.85 #131.107.3.86 #131.107.3.87 #131.107.3.93 #131.107.3.94 #63.64.43.138 #63.64.43.137 #208.249.151.138 #208.249.151.139 #192.237.67.205 #192.237.67.206 #207.46.104.80 #207.46.125.16 #208.147.66.138 #208.147.66.139 #207.46.71.10 #207.46.71.11 #203.127.3.12 #203.127.3.14 #203.41.151.8 #203.41.151.9 #207.46.36.9 #207.46.36.10 #207.46.36.11 #207.46.38.9 #207.46.38.10 #207.46.11.19 #207.46.11.20 #207.46.11.21 #207.46.44.9 #207.46.44.10 #207.46.46.9 #207.46.46.10 #207.46.40.9 #207.46.40.10 #207.46.48.9 #207.46.48.10 #207.46.42.9 #207.46.42.10 # MotionBridge 213.41.71.18 # myEfinder.com 24.42.211.66 # Nathan 194.221.102.137 # NationalDirectory 66.27.55.14 209.116.58.140 199.184.188.143 199.184.188.151 199.184.188.160 204.210.31.231 209.116.58.143 209.191.102.228 # Naver # UA "Cowbot-0.1 (NHN Corp. / 2-3011-1954 / nhnbot@naver.com)" 218.145.25.45 220.73.165.12 # NDV 194.231.30.16 # Netcraft 195.188.192.23 # NetMind 208.222.98.150 # NetNose UA "Mozilla/4.0 (compatible; MSIE 5.0;NetNose-Crawler 2.0; A New Search Experience: http://www.netnose.com)" 199.35.98.30 # NetScoop 150.59.20.63 150.59.20.20 # Netseek 216.71.78.11 # Nit-Net 212.63.155.1 # NorthernLight 195.228.240.177 204.166.111.29 205.181.75.130 205.181.75.60 205.181.75.66 205.181.75.75 205.181.75.76 208.219.77 216.34.102 216.34.109.190 216.34.109.191 216.34.109.192 64.95.79.195 64.95.79.40 # The NorthStar Robot 129.110.16.16 129.110.10.1 # The NWI Robot 130.235.86.136 130.235.86.137 # NTT Cyberspace Laboratories 210.165.39.210 210.165.39.211 210.165.39.212 210.165.39.213 210.165.39.214 210.165.39.215 210.165.39.253 # Nutch # UA "Nutch" # UA "NutchCVS/0.03-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)" # UA "NutchOrg/0.03-dev (Nutch; www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)" 131.114.2.96 209.25.87.38 66.113.7.112 66.113.76.111 66.113.76.112 # Nzexplorer 202.36.240.1 # Oberland Net 194.221.132.133 # Occam 128.95.1.184 128.95.1.208 128.95.1.84 # onlinepilot.de 195.20.225.123 212.227.109.241 195.20.225.112 195.20.225.115 212.227.109.14 212.227.109.57 212.227.109.58 212.227.109.197 212.227.109.225 212.227.109.229 212.227.118.9 212.227.118.25 212.227.118.130 212.227.119.5 # Only 64.23.82.44 # Openfind # UA "Openfind data gatherer,Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)" # UA "Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)" 210.59.144.148 210.59.144.149 211.72.252.182 209.133.111.58 211.72.252.49 212.98.78.29 205.158.61.194 205.158.61.197 205.158.61.198 205.158.61.200 205.158.61.201 205.158.61.202 205.158.61.207 209.133.111.56 209.133.111.57 216.250.80.67 66.7.131.130 66.7.131.131 66.7.131.132 66.7.131.133 66.7.131.134 66.7.131.135 66.7.131.136 66.7.131.137 66.7.131.138 66.7.131.139 66.7.131.140 66.7.131.141 66.7.131.142 66.7.131.143 66.7.131.144 66.7.131.145 66.7.131.146 66.7.131.147 66.7.131.148 66.7.131.149 66.7.131.150 66.7.131.151 66.7.131.152 66.7.131.153 66.7.131.154 66.7.131.155 66.7.131.156 66.7.131.157 66.7.131.158 66.7.131.159 66.7.131.160 66.7.131.161 66.7.131.162 66.7.131.163 66.7.131.164 66.7.131.165 66.237.60 211.72.252.150 211.72.252.243 211.155.160.2 211.155.160.5 211.155.160.12 140.123.103.4 211.72.252.147 211.72.252.242 # Open Text 204.138.115.2 # Physics.org # UA "BravoBrian SpiderEngine MarcoPolo" 213.215.133.19 # Picsearch # UA "psbot/0.1 (+http://www.picsearch.com/bot.html)" 213.242.179.43 217.75.104.23 217.75.104.26 62.119.21.136 62.119.21.132 62.119.21.135 62.119.21.137 62.119.21.138 62.119.21.139 62.119.21.150 62.119.21.157 # Pioneer 128.109.136.132 # PGP Key Agent 195.120.233.1 # Pinpoint 209.116.70.46 # Pizilla 161.58.207.17 216.218.130.79 216.218.155.2 216.218.197.2 # PlanetClick 207.87.8.78 207.87.10.33 # Pompos # UA "Pompos/1.3 http://dir.com/pompos.html" 212.27.33.160 212.27.33.161 212.27.33.162 212.27.33.163 212.27.33.164 212.27.33.165 212.27.33.166 212.27.33.167 212.27.33.168 212.27.33.169 212.27.41.11 # Pop.gr # UA "Pop.gr/6.1 Arachne(compatible; MSIE 6.0; Windows 98; Corus)" 195.186.149.91 # PortalB 209.10.169.15 209.10.169.16 209.10.169.17 # Portal Juice 209.20.44.236 # psi.net 154.15.28.143 # Qango 212.78.64.35 217.158.17.25 # Questfinder 216.104.145.71 # Queue # UA "Look.com" 64.40.105.197 # Realnames 63.251.238.8 216.86.229.85 216.86.229.86 # Rex 212.172.94.128 206.215.122.20 # SafetyNet Robot 209.254.2.2 # Scrub the web # UA "Scrubby/2.2 (http://www.scrubtheweb.com/)" # UA "Scrubby/2.1 (http://www.scrubtheweb.com/abs/meta-check.html)" 64.140.165.133 208.234.1.83 208.145.190.250 208.145.190.251 208.145.190.254 # Search.ch 195.141.85.142 195.141.85.146 # SearchHippo 206.40.146.58 208.148.122.27 208.148.122.28 208.148.122.29 # SearchKing 208.165.96.26 # SearchMil.com 206.129.98.7 206.129.98.16 206.129.98.19 # Searchopolis 206.129.0.3 206.129.0.131 206.129.0.132 206.129.1.24 206.129.1.27 # SearchSpider # UA "Searchspider/1.2 (SearchSpider; http://www.searchspider.com; webmaster@searchspider.com)" 24.90.243.203 # SearchWho 216.205.148.106 # Senrigan 133.9.222.37 # searchengine.com 194.201.93.6 194.201.93.18 194.201.93.118 # Semantic Discovery # UA "semanticdiscovery/0.2(http://www.semanticdiscovery.com/sd/robot.html)" 68.166.53.158 69.3.78.160 # Singing Fish # UA "asterias/2.0" 63.251.10.139 63.251.169.236 # Slider 216.188.26.203 # SmartDesk 128.121.225.20 # Smart Spider 207.16.241 # Sofcom 203.89.255.8 # Sonera 194.197.68.46 # speedfind 194.97.8.162 194.97.8.163 192.109.251.26 194.221.132.56 194.221.132.139 # Splat! Search # UA "libwww-perl/5.45" 128.211.213.117 207.44.130.81 207.44.142.84 209.150.128.145 216.71.84.57 216.71.84.212 216.71.187.134 # Spry Wizard Robot 198.147.135.13 165.121.1.77 165.121.2.77 198.185.1.224 # Spider 194.231.30.15 # SpiderBot 209.203.234.4 207.77.90.17 # Suchmaschine.de 195.20.227.67 # SuperSnooper 207.8.212.162 207.8.212.163 162.33.251.50 # surfnomore 66.28.248.146 # Szukacz.pl # UA "Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html; info@szukacz.pl)" 62.181.185.37 62.181.185.44 193.218.115.6 193.218.115.81 193.218.115.254 194.181.35.5 194.181.35.6 213.134.142.22 213.134.142.50 # Tecnoseek.it 212.97.42.229 # Thunderstone # UA "T-H-U-N-D-E-R-S-T-O-N-E" 198.49.220.81 207.218.150.79 63.251.4.43 208.51.0.20 208.51.0.74 208.51.0.79 # Tiscalinet.it 195.130.233.22 195.130.233.30 195.130.233.60 # TitIn 161.53.120.3 # T-Online 212.185.44.13 # Track 194.151.1.60 # UCSD Crawl 132.239.50.245 # UKSearchPages # UA "uksearchpages.co.uk" 217.151.96.52 # Valkyrie 209.67.119.9 # Verno 133.9.215.72 133.9.215.87 # Vindex 193.172.236.108 193.172.237.17 193.172.236.114 193.172.237.16 193.172.236.8 # vision-search 128.2.206.215 # voila.fr 195.101.94.80 195.101.94.81 195.101.94.15 195.101.94.101 195.101.94.166 195.101.94.208 195.101.94.209 209.185.188.207 216.35.76.11 # VWbot 216.13.169.244 # W3matter.com 64.95.2.212 # W8 Search 216.104.145.2 216.104.145.160 # Walhello # UA "appie 1.1 (www.walhello.com)" 212.127.141.18 212.58.162.42 212.58.162.78 212.58.169.133 212.58.169.181 213.73.161.41 213.73.197.30 213.10.10.117 213.10.10.118 80.60.35.143 # Web21 206.253.217.18 # WebBandit Web Spider 199.182.120.206 # Web Core 193.136.20.2 193.136.20.250 # WebCrawler 198.3.99.101 204.62.245.77 204.62.245.88 # Web.de 194.45.170.120 # WebFind 65.105.223.11 # WebGather (Chinese) # UA "WebGather 3.0" 61.139.65.222 144.214.122.55 # WebsearchUS # UA "MSIE 6.0" 217.73.164.106 # Webseek.de 62.96.181.197 # Webtop 212.111.41.2 212.111.41.33 212.111.41.34 212.111.41.35 212.111.41.36 212.111.41.52 212.111.41.53 212.111.41.151 212.111.41.154 212.111.41.153 212.111.41.152 212.135.14.4 # Web Wombat 202.139.99.130 202.139.99.131 202.139.99.131 210.8.18.66 203.9.252.2 # whatUseek 209.69.255.132 209.69.255.131 209.69.255.160 # WhizBang 63.173.190.2 63.173.190.16 63.173.190.30 63.173.190.152 63.225.238.7 63.225.238.11 216.250.143.106 216.250.143.102 208.1.109.130 # WholeWeb.net 63.140.184.187 192.41.47.46 209.19.244.162 63.140.184.168 63.140.184.171 63.140.184.172 # WhoWhere Robot 205.230.7.23 # Wild Ferret Web Hopper 207.178.193.51 # wise-guys.nl # UA "Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)" # UA "Bilbo" 212.19.205.147 # Witch witch.de 212.172.247.162 # wolong.de 209.78.25.59 # WORLD SEARCH CENTER 207.153.39.132 207.153.23.8 # The World Wide Web Worm 128.138.236.20 # Wotbox # UA "Wotbox/alpha0.5.1 (bot@wotbox.com; http://www.wotbox.com) Java/1.4.1_02" 81.5.184.25 # XTRA 203.96.111.201 # Yeehaa 208.197.37.29 # Yuntis # UA "Gulper Web Bot 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)" 130.245.134.62 130.245.134.63 130.245.134.64 # Zao - Kototoi Project # UA "Zao/0.1 (http://www.kototoi.org/zao/)" 133.11.36.24 133.11.36.25 133.11.36.26 133.11.36.28 133.11.36.34 133.11.36.36 133.11.36.37 133.11.36.39 133.11.36.41 133.11.36.42 133.11.36.45 133.11.36.46 133.11.36.50 133.11.36.52 133.11.36.54 # zSearch.net 216.55.128.47 Non-Suchmaschinen IP-Adressen # Alexa # UA "ia_archiver" # Has many IPS crawl8-public.alexa.com 209.247.40.99 # Almaden # UA "http://www.almaden.ibm.com/cs/crawler" # IBM research project wfp2.almaden.ibm.com 198.4.83.49 # Cyveillance # UA "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)" # A snoop bot to check for copyright/trademark violations 63.148.99.224 - 63.148.99.255 # Curl # UA "curl/7.9.1 (win32) libcurl 7.9.1" # it's a php tool used to grab web pages, etc. # comes from a multitude of IPS # DTSearch # UA "dtSearchSpider" # retail search software # probably coming from many IPS 64.222.18.44 # Eidetica.com # UA "Mozilla/4.7 (compatible; http://eidetica.com/spider)" # Search engine hosting/spidering service idle.eidetica.com 62.58.2.5 # Fantoma # UA "Mozilla/4.0 (fantomBrowser)" # UA "Mozilla/4.0 (stealthBrowser)" # UA "Mozilla/4.0 (cloakBrowser)" # UA "Mozilla/4.0 (fantomCrew Browser)" # UA "multiBlocker browser - IP blocker for Spam, Fraud + Snoop Protection" # UA "multiBlocker browser" # does spidering for promotional purposes and cataloging purposes # also spoofs referring URL in header with link to their website # Girafa.com # UA "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com)" # a client program similar to Alexa 64.210.196.195 64.210.196.198 # Googlebot Fake # UA "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" # This is somebody in China with a bot faking Googlebot's user agent # I've heard reports it's a hacker 211.154.211.209 # Grub.org # UA "-" # open source spider brain.grub.org 208.128.7.215 # IncyWincy # UA "IncyWincy data gatherer(webmaster@loopimprovements.com,http://www.loopimprovements.com/robot.html)" # appears to be a search engine spider for sale to anybody dsl081-243-066.sfo1.dsl.speakeasy.net 64.81.243.66 64.133.109.250 # Indy Library # UA "Mozilla/3.0 (compatible; Indy Library)" # An email harvester # Probably running from many independent locations/IPS 211.101.236.91 211.101.236.162 212.1.26.100 # Inria.fr # UA "Sqworm/2.9.72-BETA (beta_release; 20010821-737; i686-pc-linux-gnu)" # UA "larbin" (or some variations on larbin) # a French research institute # larbin appears to be a distributed spider 213.97.108.143 63.212.171.171 # Internetseer.com # UA "sitecheck.internetseer.com" # an uptime verifier 198.139.155.7 198.139.155.32 # Larbin # UA "larbin" # a crawler available under GPL # related to Xyleme # running in a number of independent locations # Lexis-Nexis.com # UA "LNSpiderguy" # snoop bot 198.185.18.207 # LinkWalker # UA "LinkWalker" # looks like a link verifier 209.167.50.22 209.167.50.25 # Lite Bot # UA "Lite Bot 0916b" # Probably a distributed bot used for a variety # of purposes. Does not obey robots.txt 24.126.133.124 # MarkWatch.com # UA "MarkWatch/1.0" # trademark violation investigation bot 204.62.226.36 206.190.171.174 206.190.171.175 # Metacarta.com # UA "flunky" # This bot belongs to an information gathering company # Also known as Bigfoot 66.28.20.194 66.28.44.122 66.28.44.123 66.28.44.125 66.28.68.234 66.28.68.235 66.28.68.236 66.28.68.237 # Microsoft URL control # UA "Microsoft URL Control - 5.01.4319" # VisualBasic tool for grabbing web pages. Probably in use # from multiple independent IPS 195.166.231.3 # NameProtect # UA "NAMEPROTECT" # UA "Mozilla/4.7" # UA "RPT-HTTPClient/0.3-3" # UA "NPBot-1/2.0 (http://www.nameprotect.com/botinfo.html)" # snoop bot to check for trademark violations crawler918.com 12.40.85 12.148.209.196 # NetMechanic # UA "NetMechanic V2.0" 147.208.15.13 216.182.214.7 # PicaLoader # UA "PicaLoader 1.0" # A site/picture downloader # Robozilla # UA "Robozilla/1.0" # Link checker for ODP... http://www.dmoz.org 207.200.81.145 # RPT-HTTPClient # UA "RPT-HTTPClient/0.3-3" # A Java library used for spidering # ScoutAbout # UA "ScoutAbout" # is not a SE spider -- it's for sale to anybody zeus.nj.nec.com 138.15.164.9 # SlySearch # UA "TurnitinBot/1.4 http://www.turnitin.com/robot/crawlerinfo.html" # UA "SlySearch" # a bot used to verify plagiarism, etc. # Spidersoft # UA "WebZIP/4.0 (http://www.spidersoft.com)" # web page downloader probably from many independent IPS 212.253.129.11 # Teleport Pro # UA "Teleport Pro/1.28" # a personal bot for windows # operating from many IPS... not worth listing any # Teradex Mapper # UA "(Teradex Mapper; mapper@teradex.com; http://www.teradex.com)" # a bot that belongs to the human reviewed Teradex directory 64.69.79.210 # Tivra # UA "tivraSpider/1.0 (crawler@tivra.com)" # looks like an IBM or AT&T research spider panchma.tivra.com 207.140.168.143 207.140.168.146 # Tracerlock # http://www.tracerlock.com # news monitoring service # UA "libwww-perl/5.47" tracerlock.com 209.61.182.37 # UbiCrawler # UA "UbiCrawler/v0.3beta (http://ubi.imc.pi.cnr.it/projects/ubicrawler/)" # an experimental bot 146.48.78.32 146.48.78.38 # Webclipping.com # UA "Webclipping.com" # a data mining bot 209.73.228.163 209.73.228.167 # Webrank # UA "webrank" # looks like a ranking checker xs4.kso.co.uk 207.235.6.157 # Websquash.com # UA: "websquash.com ( Add Url Robot )" # A fishy engine that belongs to sitereleases.com, a SEO company 66.221.171.1 # websmostlinked.com # UA "lwp-trivial/1.34" # UA "AESOP_com_SpiderMan" # could be a legitimate spider but more likely a hazard for cloakers 64.14.241.54 # Whizbang # UA "ozilla/4.7 (compatible; Whizbang)" # WhizBang is a company that sells a spider to build databases pixnat06.whizbang.com 63.173.190.16 pixnat09.whizbang.com 63.173.190.19 # X-Crawler # UA "TECOMAC-Crawler/0.3" # UA "X-Crawler" # a distributed spider sold by Arexera # Xyleme.com # UA "cosmos/0.8)_(robot@xyleme.com)" # related to Inria.fr # related to Larbin 212.73.246.73 212.73.246.71 # Yahoo.com URL verifiers # UA "Mozilla/4.05" morgue1.corp.yahoo.com 216.145.54.35 hanta.yahoo.com 216.145.50.40 # Zealbot # UA "Mozilla/4.0(compatible; Zealbot 1.0)" # LookSmarts link checker 64.241.242.11 64.241.243.32 64.241.243.65 64.241.243.66 # Zeus Webster # UA "Zeus 60359 Webster Pro V2.9 Win32" # directory builder available retail Edited January 21, 2005 by FCKW Share this post Link to post
