nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-14 10:10:03 +00:00

250 lines
2.6 KiB
Text

ADmantX
Abonti
AfD-Verbotsverfahren
AiHitBot
Alexibot
Anarchy
Ankit
Apexoo
Aspiegel
AwarioRssBot
AwarioSmartBot
BDFetch
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
Buddy
BuiltWith
Bullseye
CATExplorador
CSHttp
CazoodleBot
CheTeam
CheeseBot
Cocolyzebot
CopyRightCheck
Craftbot
Crawling at Home Project
Custo
DBLBot
DTS Agent
DataCha0s
Demon
Deusu
DigitalPebble
Disco
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Dotbot
Download Wonder
ECCP/1.0
EMail Wolf
Ebingbong
Ecxi
EroCrawler
ExtractorPro
FHscan
Flunky
Freeuploader
Fuzz
Fyrebot
GT::WWW
Go!Zilla
Gotit
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Heritrix
Hloader
Humanlinks
IRLbot
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InternetSeer
Iskanie
JamesBOT
JetCar
Jetty
Jorgee
Jyxobot
Keyword Density
Kinza
LWP::Simple
Lanshanbot
Larbin
Leap
LexiBot
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
MTRobot
Mag-Net
Mail.RU_Bot
MarkWatch
MauiBot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Moblie Safari
Mojolicious
Mozlila
Musobot
Nessus
Net Vampire
NetAnts
Netcraft
Netvibes
Nimbostratus
Octopus
OnCrawl
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PageGrabber
Pandalytics
Panscient
Pavuk
Petalbot
ProPowerBot
Pump
PxBroker
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankurBot
RedesScrapy
Ripper
RocketCrawler
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
Scanbot
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice
SeobilityBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitevigil
SlySearch
Snake
Sosospider
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
SputnikBot
Sqlworm
Sqworm
Surfbot
Swiftbot
T0PHackTeam
Teleport
TeleportPro
Toata
Tracemyfile
Trendiction
Turingos
Twice
URLy Warning
URLy.Warning
V-BOT
VB Project
VeriCiteCrawler
VoidEYE
WBSearchBot
WEBDAV
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Web Enhancer
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSauger
Webalta
WebsiteExtractor
Webster
Whatweb
WiseGuys Robot
Woobot
Wotbox
Wprecon
Zauba
Zeus
ZoomBot
ZoominfoBot
crawler4j
dataforseo.com
evc-batch
instabid
iubenda-radar
linkdexbot
lwp-request
meanpathbot
mediawords
oBot
page scorer
probe-image-size
ripz
satoristudio.net
scalaj-http
seobility
seoscanners
seostar
serpstatbot
sexsearcher
siteripz
spyfu
trendiction.de
voyagerx.com
webmeup-crawler
x09Mozilla