nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-02 10:07:26 +00:00

100 lines
1.1 KiB
Text

404checker
AIBOT
AhrefsBot
AiHitBot
AwarioSmartBot
BatchFTP
Battleztar Bazinga
BetaBot
Bolt
CCBot
Citoid
Cloud mapping
CopyRightCheck
DBLBot
DomCopBot
DomainAppender
ECCP/1.0
ExtractorPro
Extreme Picture Finder
Fimap
FlashGet
FyberSpider
GT::WWW
GermCrawler
GetRight
Getintent
HTMLparser
Harvest
Hloader
IlseBot
InternetSeer
Joomla
Jorgee
Kenjin Spider
Keybot Translation-Search-Machine
Lanshanbot
LinkextractorPro
Majestic-SEO
Masscan
MauiBot
MegaIndex.ru
Microsoft Data Access
Moblie Safari
Morfeus Fucking Scanner
Nessus
NetSpider
Netvibes
Nuclei
Octopus
OpenVAS
OrangeSpider
OutclicksBot
Papa Foto
Petalbot
PictureFinder
Psbot
Pu_iN
QueryN Metasearch
RSSingBot
RankingBot2
RebelMouse
RedesScrapy
Rogerbot
SEOkicks-Robot
SeoSiteCheckup
Siphon
Sqlmap
Sucuri
SuperBot
Telesphorep
Titan
URLy.Warning
UnisterBot
Vagabondo
VeriCiteCrawler
VidibleScraper
WBSearchBot
WWW::Mechanize
Web Collage
Web Pix
Web Sauger
WebCopier
Webalta
YoudaoBot
ZmEu
arquivo-web-crawler
autoemailspider
check1.exe
crawler.feedback
dataforseobot
gopher
heritrix
instabid
internetVista monitor
ips-agent
plumanalytics
polaris version
ripz
satoristudio.net
x09Mozilla