nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-27 22:05:00 +00:00

100 lines
1.1 KiB
Text

AIBOT
AdsTxtCrawlerTP
AhrefsBot
AiHitBot
Anarchy
Anarchy99
Atomseobot
AwarioSmartBot
BBBike
BDCbot
BackDoorBot
Badass
Bandit
BlackWidow
Brandwatch
Copyscape
Curious
CyotekWebCopy
Devil
DigitalPebble
DomainCrawler
Dragonfly
EMail Wolf
Express WebPictures
EyeNetIE
FHscan
FyberSpider
Getintent
Heritrix
HybridBot
IRLbot
Image Sucker
IndeedBot
Iskanie
Jorgee
Keyword Density
LibWeb
LieBaoFast
Linkbot
LinkpadBot
MJ12bot
Mr.4x3
NICErsPRO
Needle
NetMechanic
Nimbostratus
Nutch
OpenLinkProfiler
OpenVAS
OutclicksBot
PageScorer
Pavuk
Pi-Monster
Picscout
Picsearch
PictureFinder
PyCurl
RankingBot
Recorder
Ripper
SISTRIX
ScoutJet
SearchmetricsBot
Shodan
SiteSucker
Snake
Sociscraper
T0PHackTeam
VCI
VelenPublicWebCrawler
WASALive-Bot
WWW::Mechanize
Web Auto
Web Collage
Web Fetch
Web Fuck
Web Sucker
WebCollage
WebImageCollector
WebZIP
WebsiteExtractor
WebsiteQuester
Webster
Wonderbot
Wprecon
Xaldon_WebSpider
Zermelo
Zitebot
dataforseo.com
gopher
instabid
internetVista monitor
linkdexbot
magpie-crawler
netEstate NE Crawler
polaris version
scalaj-http
sp_auditbot
x22Mozilla
xpymep1.exe