nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-10 22:07:07 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
80legs
ADmantX
AIBOT
ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator
Anarchie
Anarchy
Anarchy99
Anthill
Apexoo
Asterias
Atomseobot
Attach
AwarioRssBot
BBBike
BDFetch
BLEXBot
BackDoorBot
BatchFTP
BetaBot
BlackWidow
Blackboard
Brandprotect
Buddy
BuiltWith
BunnySlippers
CCBot
CSHttp
Calculon
Cegbfeieh
CherryPicker
Collector
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
DBLBot
DTS Agent
DatabaseDriverMysqli
Demon
Disco
Dispatch
DittoSpyder
DomainAppender
DomainStatsBot
Dragonfly
Ecxi
Evil
Express WebPictures
Ezooms
FDM
FemtosearchBot
Fimap
Flunky
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GermCrawler
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
GrapeFX
GridBot
HTMLparser
HaosouSpider
IDBTE4M
Id-search
Image Sucker
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
IstellaBot
JennyBot
JetCar
Joomla
JustView
Kinza
LWP::Simple
Larbin
LexiBot
Libwhisker
LinkScan
Linkbot
LinkpadBot
Lipperhey
Lipperhey Spider
Litemage_walker
MJ12bot
MSIECrawler
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access
Minefield
Mister PiX
Mojolicious
Morfeus Fucking Scanner
NPbot
NetLyzer
NetMechanic
NetSpider
Netvibes
Nibbler
Niki-bot
Nimbostratus
Ninja
Nuclei
Octopus
Offline Navigator
OpenVAS
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PageGrabber
PageScorer
PageThing.com
Papa Foto
Pavuk
Petalbot
Pockey
Psbot
PxBroker
QueryN Metasearch
Re-re
ReGet
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks
SEOprofiler
SMTBot
ScanAlert
Scanbot
Scrapy
ScreenerBot
ScrepyBot
Searchestate
Seekport
SemrushBot
SeoSiteCheckup
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Siteimprove
Snake
Snoopy
Spbot
Spinn3r
SputnikBot
Stripper
Sucker
Surfbot
Suzuran
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesphoreo
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turnitin
URLy Warning
Upflow
VelenPublicWebCrawler
WASALive-Bot
WBSearchBot
WISENutbot
WWWOFFLE
WallpapersHD
WeSEE
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebEnhancer
WebFetch
WebImageCollector
WebPix
WebReaper
WebSauger
WebSucker
WebZIP
Webshag
WebsiteExtractor
Webster
Whacker
Widow
Xaldon WebSpider
Xenu
Zauba
Zermelo
ZoomBot
ZyBorg
adscanner
arquivo.pt
autoemailspider
backlink-check
crawl.sogou.com
crawler.feedback
demandbase-bot
facebookscraper
heritrix
isitwp.com
linkdexbot
lwp-request
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
oBot
polaris version
probe-image-size
scalaj-http
scan.lol
serpstatbot
spyfu
xpymep1.exe