nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-24 22:05:17 +00:00

100 lines
1.1 KiB
Text

ADmantX
AdsTxtCrawlerTP
AiHitBot
Ankit
Atomseobot
Attach
BDCbot
Battleztar Bazinga
Boardreader
Brandprotect
BuiltBotTough
CATExplorador
CensysInspect
DataCha0s
Demon
Devil
Dragonfly
Ebingbong
Ecxi
EroCrawler
Exabot
Extractor
FHscan
FlashGet
G-i-g-a-b-o-t
Gigabot
Grabber
HTTrack
Havij
Humanlinks
HybridBot
InterGET
InternetSeer
Jorgee
Keybot Translation-Search-Machine
Leap
LeechFTP
Lightspeedsystems
LinkextractorPro
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
Meanpathbot
MegaIndex.ru
Nameprotect
NetLyzer
Netcraft
NextGenSearchBot
OpenLinkProfiler
Openvas
Page Analyzer
PleaseCrawl
Proximic
QueryN Metasearch
Rankivabot
RealDownload
Rogerbot
SEOstats
Scanbot
SeobilityBot
SiteLockSpider
SocialRankIOBot
Sosospider
Spinn3r
Sucker
Surfbot
Suzuran
Thumbor
Titan
Trendiction
True_Robot
Turingos
VCI
WeSEE
Web Fuck
Web Sauger
WebGo IS
WebLeacher
WebStripper
WebmasterWorldForumBot
Webshag
Whacker
Xaldon WebSpider
Xaldon_WebSpider
Zitebot
backlink-check
check1.exe
coccocbot
cognitiveseo
domainsproject.org
mediawords
plumanalytics
seocompany.store
seoscanners
sogouspider
sp_auditbot
tAkeOut
trendiction.de
x09Mozilla