nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-07 10:07:18 +00:00

100 lines
1 KiB
Text

360Spider
404enemy
Abonti
AfD-Verbotsverfahren
AhrefsBot
Alligator
AlphaBot
Apexoo
BBBike
BDCbot
BDFetch
BacklinkCrawler
CSHttp
CheTeam
Cosmos
Custo
Devil
DigitalPebble
Discoverybot
DnyzBot
DomCopBot
EMail Siphon
Ecxi
Express WebPictures
ExtractorPro
GPTBot
GT::WWW
Genieo
GrapeFX
GrapeshotCrawler
GridBot
HTTrack
IDBot
Indy Library
Information Security Team InfraSec Scanner
JamesBOT
Jbrofuzz
Kinza
Libwhisker
Lightspeedsystems
Linkbot
LinqiaRSSBot
Lipperhey
MIDown tool
MIIxpc
MSFrontPage
MarkMonitor
MauiBot
Meanpathbot
Microsoft URL Control
Morfeus Fucking Scanner
NPbot
Navroad
Nettrack
Nuclei
Nutch
Offline Explorer
OutfoxBot
Petalbot
Scrapy
ScrepyBot
SeekportBot
SemanticJuice
SeoSiteCheckup
Shodan
Siteimprove
SocialRankIOBot
SpankBot
Spider_Bot/3.0
Sqlworm
Stripper
Sucker
Surfbot
T8Abot
Telesphoreo
Telesphorep
Toata
UnisterBot
Upflow
WASALive-Bot
WEBDAV
WeSEE
Web Collage
WebCopier
WebsiteQuester
Whack
WinHTTrack
Zade
Zauba
Zitebot
archive.org_bot
crawler4j
meanpathbot
seocompany.store
seoscanners
seostar
siteripz
sp_auditbot
spyfu
zauba.io