nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-06-05 22:04:55 +00:00

100 lines
1.1 KiB
Text

80legs
AIBOT
ALittle Client
Aboundex
AdsTxtCrawlerTP
Alligator
Anthill
BBBike
BDFetch
BlackWidow
Blackboard
Brandwatch
BuiltBotTough
Bullseye
CheTeam
ChinaClaw
Cloud mapping
Cogentbot
Crawling at Home Project
Curious
DSearch
DatabaseDriverMysqli
DigitalPebble
DomCopBot
DomainStatsBot
EMail Siphon
EMail Wolf
ExtractorPro
EyeNetIE
Freeuploader
Grabber
HMView
HonoluluBot
IndeedBot
InterGET
InternetSeer
JOC Web Spider
Keyword Density
Kinza
Kozmosbot
Larbin
MIIxpc
MJ12bot
Metauri
Moblie Safari
MolokaiBot
Navroad
Net Vampire
Ninja
Offline Explorer
OpenLinkProfiler
PageScorer
Pavuk
PeoplePal
Picscout
Picsearch
Pixray
ProPowerBot
Psbot
RankingBot2
SMTBot
Scanbot
ScrepyBot
SeobilityBot
Siteimprove
SmartDownload
Spinn3r
Sqworm
Suzuran
Telesphorep
Trendiction
Twice
VB Project
VeriCiteCrawler
Voil
WASALive-Bot
Web Collage
Web Pix
Web Sauger
WebImageCollector
WebmasterWorldForumBot
WebsiteExtractor
Wonderbot
Wotbox
Zeus
Zitebot
ZmEu
ZoomBot
ZoominfoBot
archive.org_bot
cognitiveseo
magpie-crawler
mediawords
pcBrowser
probe-image-size
s1z.ru
seocompany.store
sitechecker.pro
sp_auditbot
tAkeOut