Was ist spbot?
indexiert und analysiert Inhalte von Webseiten.
Der Webrobot spbot indexiert und analysiert Inhalte von Webseiten. Er zeigt sich meistens mit der IP Adresse 104.131.10.13 und unter Verwendung des User Agent Mozilla/5.0 (compatible; spbot/5.0.3; http://OpenLinkProfiler.org/bot ). Mit 0.997% Marktanteil ist spbot auf Platz 10 der aktivsten Webrobots im Internet.
robots.txt – spbot blockieren
Füge diese Zeilen in deine robots.txt ein, um spbot den Zugriff auf deine Website zu verwehren:
robots.txt
User-agent: spbot
Disallow: /Du kannst den Zugriff auch gezielt einschränken, statt ihn komplett zu blockieren:
robots.txt (selektiv)
User-agent: spbot
Disallow: /wp-admin/
Disallow: /wp-includes/
Allow: /IP-Adressen 177 bekannte IPs
Diese IP-Adressen wurden bisher von spbot verwendet:
104.131.10.13
104.131.111.228
104.131.120.61
104.131.121.101
104.131.15.48
104.131.165.26
104.131.176.180
104.131.208.42
104.131.211.228
104.131.212.219
104.131.217.128
104.131.217.162
104.131.217.189
104.131.217.241
104.131.218.16
104.131.218.26
104.131.22.162
104.131.231.207
104.131.34.250
104.131.34.43
104.131.45.205
104.131.5.148
104.131.73.194
104.131.82.152
104.131.89.3
104.131.92.245
104.131.99.129
104.236.105.155
104.236.17.151
104.236.224.236
104.236.227.76
104.236.32.239
104.236.43.75
104.236.48.35
104.236.76.134
104.236.80.75
107.170.1.51
107.170.118.58
107.170.129.218
107.170.134.148
107.170.136.81
107.170.155.171
107.170.16.77
107.170.170.224
107.170.171.19
107.170.172.145
107.170.19.35
107.170.190.146
107.170.191.153
107.170.21.131
107.170.3.249
107.170.38.42
107.170.42.13
107.170.42.130
107.170.42.21
107.170.42.245
107.170.42.252
107.170.42.33
107.170.42.5
107.170.5.94
107.170.50.206
107.170.55.230
107.170.55.235
107.170.7.16
107.170.70.46
107.170.96.62
138.197.18.68
138.197.99.225
159.203.119.216
159.203.128.29
159.203.173.158
159.65.175.12
159.65.183.67
159.65.185.88
159.65.186.217
159.65.242.13
159.65.242.31
159.65.245.55
159.65.246.7
159.65.247.27
159.65.253.230
159.65.44.137
159.65.44.150
159.65.47.33
159.89.186.129
159.89.186.17
159.89.188.152
159.89.37.236
159.89.40.106
159.89.41.81
159.89.45.235
162.243.104.54
162.243.106.111
162.243.106.229
162.243.109.121
162.243.109.44
162.243.109.79
162.243.110.113
162.243.111.72
162.243.121.7
162.243.14.238
162.243.17.150
162.243.17.74
162.243.19.11
162.243.192.177
162.243.192.225
162.243.192.235
162.243.192.247
162.243.192.29
162.243.193.136
162.243.193.14
162.243.193.98
162.243.194.124
162.243.196.238
162.243.196.54
162.243.198.188
162.243.202.203
162.243.203.197
162.243.205.182
162.243.210.53
162.243.215.134
162.243.215.233
162.243.217.240
162.243.218.100
162.243.219.232
162.243.219.67
162.243.227.51
162.243.23.37
162.243.235.184
162.243.237.170
162.243.245.102
162.243.247.126
162.243.255.53
162.243.27.120
162.243.27.245
162.243.32.128
162.243.39.228
162.243.46.25
162.243.49.233
162.243.50.70
162.243.53.226
162.243.72.12
162.243.72.200
162.243.75.131
162.243.78.49
162.243.80.111
162.243.80.148
162.243.81.123
162.243.81.128
162.243.81.161
162.243.84.47
162.243.87.220
162.243.87.94
162.243.97.119
162.243.97.129
165.227.105.107
165.227.110.68
165.227.210.215
165.227.214.96
165.227.70.239
165.227.98.228
174.138.58.47
45.55.132.69
45.55.141.157
45.55.143.180
45.55.143.49
45.55.167.204
45.55.196.31
45.55.202.231
45.55.216.163
45.55.231.12
45.55.235.95
45.55.237.90
45.55.247.211
45.55.53.91
45.55.69.224
45.55.78.156
User Agents
Mit diesen User-Agent-Strings identifiziert sich spbot:
Mozilla/5.0 (compatible; spbot/5.0.3; http://OpenLinkProfiler.org/bot )Mozilla/5.0 (compatible; spbot/4.4.2; http://OpenLinkProfiler.org/bot )Mozilla/5.0 (compatible; spbot/4.4.1; http://OpenLinkProfiler.org/bot )Mozilla/5.0 (compatible; spbot/4.4.0; http://OpenLinkProfiler.org/bot )Mozilla/5.0 (compatible; spbot/4.3.0; http://OpenLinkProfiler.org/bot )