nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-04-18 10:07:26 +00:00

100 lines
1.1 KiB
Text

Aipbot
Alligator
Aspiegel
AwarioSmartBot
Bandit
Battleztar Bazinga
Bigfoot
BlowFish
Bolt
BuzzSumo
CCBot
Cliqzbot
Cloud mapping
Cosmos
Crawling at Home Project
DSearch
DatabaseDriverMysqli
Demon
Discoverybot
DomCopBot
DomainAppender
DomainStatsBot
Domains Project
EasyDL
Evil
Express WebPictures
FDM
Fimap
Freeuploader
FrontPage
Fuzz
GoZilla
HybridBot
Id-search
Intelliseek
JOC Web Spider
JennyBot
Jorgee
Kenjin Spider
Larbin
Libwhisker
LinksManager
Ltx71
MFC_Tear_Sample
MQQBrowser
Majestic12
MarkWatch
MauiBot
Mediatoolkitbot
MegaIndex.ru
Net Vampire
Offline Explorer
OpenVAS
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
PageThing.com
RSSingBot
Rankivabot
ReGet
Rogerbot
Scrapy
SearchmetricsBot
SiteSucker
Siteimprove
Snapbot
Sottopop
Sucuri
Surfbot
Thumbor
Toata
True_Robot
TurnitinBot
UnisterBot
VidibleScraper
Voltron
WASALive-Bot
WPScan
WallpapersHD
WebBandit
WebLeacher
WebStripper
Webalta
Website Quester
Woobot
Wprecon
Xaldon_WebSpider
Zitebot
coccocbot
cognitiveseo
crawler.feedback
internetVista monitor
isitwp.com
lwp-trivial
probe-image-size
ripz
seobility
sitechecker.pro
spyfu
sysscan