Vorsicht bei 2.1 und Spiders

[kdt 0]

Hi,

wie viele schon gemerkt haben sollten, wurde der Inhalt der Datei conf_global.php stark angepasst. Ich hatte mir mal hier aus dem Forum eine Liste aller BOT's besorgt und hatte die immer im 2.0x drinne.

Wenn man diese Liste übernimmt, dann kommt es alsbald zu Problemen, denn einige dieser Einträge ernthalten ein << ' >> Zeichen, was dann zu Fehlern führen wird.

Findet man zwar schnell nur kommt der Fehler erst wenn man mal im ACP die Skin Tools laufen lässt.

Also leibe Anfänger, aufpassen !

VG

KDT

Hier mal meine abgeänderte Spider Datei:

---------------------------------------

acme.spider=[bOT] Acme.Spider

ahoythehomepagefinder=[bOT] Ahoy! The Homepage Finder

alkaline=[bOT] Alkaline

appie=[bOT] Walhello appie

arachnophilia=[bOT] Arachnophilia

architext=[bOT] ArchitextSpider

aretha=[bOT] Aretha

ariadne=[bOT] ARIADNE

arks=[bOT] arks

aspider=[bOT] ASpider (Associative Spider)

atn.txt=[bOT] ATN Worldwide

atomz=[bOT] Atomz.com Search Robot

auresys=[bOT] AURESYS

backrub=[bOT] BackRub

bigbrother=[bOT] Big Brother

bjaaland=[bOT] Bjaaland

blackwidow=[bOT] BlackWidow

blindekuh=[bOT] Die Blinde Kuh

bloodhound=[bOT] Bloodhound

brightnet=[bOT] bright.net caching robot

bspider=[bOT] BSpider

cactvschemistryspider=[bOT] CACTVS Chemistry Spider

calif=[bOT] Calif

cassandra=[bOT] Cassandra

cgireader=[bOT] Digimarc Marcspider/CGI

checkbot=[bOT] Checkbot

churl=[bOT] churl

cmc=[bOT] CMC/0.01

collective=[bOT] Collective

combine=[bOT] Combine System

conceptbot=[bOT] Conceptbot

coolbot=[bOT] CoolBot

core=[bOT] Web Core / Roots

cosmos=[bOT] XYLEME Robot

cruiser=[bOT] Internet Cruiser Robot

cusco=[bOT] Cusco

cyberspyder=[bOT] CyberSpyder Link Test

deweb=[bOT] DeWeb© Katalog/Index

dienstspider=[bOT] DienstSpider

digger=[bOT] Digger

diibot=[bOT] Digital Integrity Robot

directhit=[bOT] Direct Hit Grabber

dnabot=[bOT] DNAbot

download_express=[bOT] DownLoad Express

dragonbot=[bOT] DragonBot

dwcp=[bOT] DWCP (Dridus Web Cataloging Project)

e-collector=[bOT] e-collector

ebiness=[bOT] EbiNess

eit=[bOT] EIT Link Verifier Robot

elfinbot=[bOT] ELFINBOT

emacs=[bOT] Emacs-w3 Search Engine

emcspider=[bOT] ananzi

esther=[bOT] Esther

evliyacelebi=[bOT] Evliya Celebi

nzexplorer=[bOT] nzexplorer

fdse=[bOT] Fluid Dynamics Search Engine robot

felix=[bOT] Felix IDE

ferret=[bOT] Wild Ferret Web Hopper #1, #2, #3

fetchrover=[bOT] FetchRover

fido=[bOT] fido

finnish=[bOT] Hämähäkki

fireball=[bOT] KIT-Fireball

fish=[bOT] Fish search

fouineur=[bOT] Fouineur

francoroute=[bOT] Robot Francoroute

freecrawl=[bOT] Freecrawl

funnelweb=[bOT] FunnelWeb

gama=[bOT] gammaSpider, FocusedCrawler

gazz=[bOT] gazz

gcreep=[bOT] GCreep

getbot=[bOT] GetBot

geturl=[bOT] GetURL

golem=[bOT] Golem

googlebot=[bOT] Googlebot (Google)

grapnel=[bOT] Grapnel/0.01 Experiment

griffon=[bOT] Griffon

gromit=[bOT] Gromit

gulliver=[bOT] Northern Light Gulliver

hambot=[bOT] HamBot

harvest=[bOT] Harvest

havindex=[bOT] havIndex

hometown=[bOT] Hometown Spider Pro

htdig=[bOT] ht://Dig

htmlgobble=[bOT] HTMLgobble

hyperdecontextualizer=[bOT] Hyper-Decontextualizer

iajabot=[bOT] iajaBot

ibm=[bOT] IBM_Planetwide

iconoclast=[bOT] Popular Iconoclast

ilse=[bOT] Ingrid

imagelock=[bOT] Imagelock

incywincy=[bOT] IncyWincy

informant=[bOT] Informant

infoseek=[bOT] InfoSeek Robot 1.0

infoseeksidewinder=[bOT] Infoseek Sidewinder

infospider=[bOT] InfoSpiders

inspectorwww=[bOT] Inspector Web

intelliagent=[bOT] IntelliAgent

irobot=[bOT] I, Robot

iron33=[bOT] Iron33

israelisearch=[bOT] Israeli-search

javabee=[bOT] JavaBee

jbot=[bOT] JBot Java Web Robot

jcrawler=[bOT] JCrawler

jeeves=[bOT] Jeeves

jobo=[bOT] JoBo Java Web Robot

jobot=[bOT] Jobot

joebot=[bOT] JoeBot

jubii=[bOT] The Jubii Indexing Robot

jumpstation=[bOT] JumpStation

katipo=[bOT] Katipo

kdd=[bOT] KDD-Explorer

kilroy=[bOT] Kilroy

ko_yappo_robot=[bOT] KO_Yappo_Robot

labelgrabber.txt=[bOT] LabelGrabber

larbin=[bOT] larbin

legs=[bOT] legs

linkidator=[bOT] Link Validator

linkscan=[bOT] LinkScan

linkwalker=[bOT] LinkWalker

lockon=[bOT] Lockon

logo_gif=[bOT] logo.gif Crawler

lycos_=[bOT] Lycos

macworm=[bOT] Mac WWWWorm

magpie=[bOT] Magpie

marvin=[bOT] marvin/infoseek

mattie=[bOT] Mattie

mediafox=[bOT] MediaFox

merzscope=[bOT] MerzScope

meshexplorer=[bOT] NEC-MeshExplorer

mindcrawler=[bOT] MindCrawler

moget=[bOT] moget

momspider=[bOT] MOMspider

monster=[bOT] Monster

motor=[bOT] Motor

muscatferret=[bOT] Muscat Ferret

mwdsearch=[bOT] Mwd.Search

myweb=[bOT] Internet Shinchakubin

nagios=[bOT] Nagios monitoring checker

netcarta=[bOT] NetCarta WebMap Engine

netcraft=[bOT] Netcraft Web Server Survey

netmechanic=[bOT] NetMechanic

netscoop=[bOT] NetScoop

newscan-online=[bOT] newscan-online

nhse=[bOT] NHSE Web Forager

nomad=[bOT] Nomad

northstar=[bOT] The NorthStar Robot

occam=[bOT] Occam

octopus=[bOT] HKU WWW Octopus

openfind=[bOT] Openfind data gatherer

orb_search=[bOT] Orb Search

packrat=[bOT] Pack Rat

pageboy=[bOT] PageBoy

parasite=[bOT] ParaSite

patric=[bOT] Patric

pegasus=[bOT] pegasus

perignator=[bOT] The Peregrinator

perlcrawler=[bOT] PerlCrawler 1.0

phantom=[bOT] Phantom

piltdownman=[bOT] PiltdownMan

pimptrain=[bOT] Pimptrain.coms robot

pioneer=[bOT] Pioneer

pitkow=[bOT] html_analyzer

pjspider=[bOT] Portal Juice Spider

pka=[bOT] PGP Key Agent

plumtreewebaccessor=[bOT] PlumtreeWebAccessor

poppi=[bOT] Poppi

portalb=[bOT] PortalB Spider

puu=[bOT] GetterroboPlus Puu

python=[bOT] The Python Robot

raven=[bOT] Raven Search

rbse=[bOT] RBSE Spider

resumerobot=[bOT] Resume Robot

rhcs=[bOT] RoadHouse Crawling System

road_runner=[bOT] Road Runner: The ImageScape Robot

robbie=[bOT] Robbie the Robot

robi=[bOT] ComputingSite Robi/1.0

robofox=[bOT] RoboFox

robozilla=[bOT] Robozilla

roverbot=[bOT] Roverbot

rules=[bOT] RuLeS

safetynetrobot=[bOT] SafetyNet Robot

scooter=[bOT] Scooter (AltaVista)

search_au=[bOT] Search.Aus-AU.COM

searchprocess=[bOT] SearchProcess

senrigan=[bOT] Senrigan

sgscout=[bOT] SG-Scout

shaggy=[bOT] ShagSeeker

shaihulud=[bOT] ShaiHulud

sift=[bOT] Sift

simbot=[bOT] Simmany Robot Ver1.0

site-valet=[bOT] Site Valet

sitegrabber=[bOT] Open Text Index Robot

sitetech=[bOT] SiteTech-Rover

slcrawler=[bOT] SLCrawler

slurp=[bOT] Inktomi Slurp

smartspider=[bOT] Smart Spider

snooper=[bOT] Snooper

solbot=[bOT] Solbot

spanner=[bOT] Spanner

speedy=[bOT] Speedy Spider

spider_monkey=[bOT] spider_monkey

spiderbot=[bOT] SpiderBot

spiderline=[bOT] Spiderline Crawler

spiderman=[bOT] SpiderMan

spiderview=[bOT] SpiderView

spry=[bOT] Spry Wizard Robot

ssearcher=[bOT] Site Searcher

suke=[bOT] Suke

suntek=[bOT] suntek search engine

sven=[bOT] Sven

tach_bw=[bOT] TACH Black Widow

tarantula=[bOT] Tarantula

tarspider=[bOT] tarspider

techbot=[bOT] TechBOT

templeton=[bOT] Templeton

teoma_agent1=[bOT] TeomaTechnologies

titin=[bOT] TitIn

titan=[bOT] TITAN

tkwww=[bOT] The TkWWW Robot

tlspider=[bOT] TLSpider

ucsd=[bOT] UCSD Crawl

udmsearch=[bOT] UdmSearch

urlck=[bOT] URL Check

valkyrie=[bOT] Valkyrie

verticrawl=[bOT] Verticrawl

victoria=[bOT] Victoria

visionsearch=[bOT] vision-search

voyager=[bOT] Voyager

vwbot=[bOT] VWbot

w3index=[bOT] The NWI Robot

w3m2=[bOT] W3M2

wallpaper=[bOT] WallPaper

wanderer=[bOT] the World Wide Web Wanderer

wapspider=[bOT] w@pSpider by wap4.com

webbandit=[bOT] WebBandit Web Spider

webcatcher=[bOT] WebCatcher

webcopy=[bOT] WebCopy

webfetcher=[bOT] Webfetcher

webfoot=[bOT] The Webfoot Robot

weblayers=[bOT] Weblayers

weblinker=[bOT] WebLinker

webmirror=[bOT] WebMirror

webmoose=[bOT] The Web Moose

webquest=[bOT] WebQuest

webreader=[bOT] Digimarc MarcSpider

webreaper=[bOT] WebReaper

websnarf=[bOT] Websnarf

webspider=[bOT] WebSpider

webvac=[bOT] WebVac

webwalk=[bOT] webwalk

webwalker=[bOT] WebWalker

webwatch=[bOT] WebWatch

whatuseek=[bOT] whatUseek Winona

whowhere=[bOT] WhoWhere Robot

wired-digital=[bOT] Wired Digital

wmir=[bOT] w3mir

wolp=[bOT] WebStolperer

wombat=[bOT] The Web Wombat

worm=[bOT] The World Wide Web Worm

wwwc=[bOT] WWWC Ver 0.2.5

wz101=[bOT] WebZinger

xget=[bOT] XGET

nederland.zoek=[bOT] Nederland.zoek

antibot=[bOT] Antibot

aport=[bOT] Aport

awbot=[bOT] AWBot

baiduspider=[bOT] BaiDuSpider

bobby=[bOT] Bobby

boris=[bOT] Boris

bumblebee=[bOT] Bumblebee (relevare.com)

cscrawler=[bOT] CsCrawler

daviesbot=[bOT] DaviesBot

digout4u=[bOT] Digout4u

echo=[bOT] EchO!

exactseek=[bOT] ExactSeek Crawler

ezresult=[bOT]Ezresult

fast-webcrawler=[bOT] Fast-Webcrawler (AllTheWeb)

gigabot=[bOT] GigaBot

gnodspider=[bOT] GNOD Spider

grub=[bOT] Grub.org

henrythemiragorobot=[bOT] Mirago

ia_archiver=[bOT] Alexa (IA Archiver)

internetseer=[bOT] InternetSeer

jennybot=[bOT] JennyBot

justview=[bOT] JustView

linkbot=[bOT] LinkBot

linkchecker=[bOT] LinkChecker

metager-linkchecker=[bOT] MetaGer LinkChecker

microsoft_url_control=[bOT] Microsoft URL Control

mercator=[bOT] Mercator

msiecrawler=[bOT] MSIECrawler

msnbot=[bOT] MSNBot

perman=[bOT] Perman surfer

petersnews=[bOT] Petersnews

pompos=[bOT] Pompos

psbot=[bOT] psBot

rambler=[bOT] StackRambler

redalert=[bOT] Red Alert

shoutcast=[bOT] Shoutcast Directory Service

slysearch=[bOT] SlySearch

surveybot=[bOT] SurveyBot

turnitinbot=[bOT] Turn It In

turtle=[bOT] Turtle

turtlescanner=[bOT] Turtle

ultraseek=[bOT] Ultraseek

unlost_web_crawler=[bOT] Unlost Web Crawler

voila=[bOT] Voila

webbase=[bOT] WebBase

webcompass=[bOT] webcompass

webclipping.com=[bOT] WebClipping.com

wisenutbot=[bOT] WISENutbot (Looksmart)

yandex=[bOT] Yandex bot

zealbot=[bOT] ZealBot

zyborg=[bOT] Zyborg (Looksmart)

Edited September 20, 2005 by kdt