nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-14 10:07:36 +00:00

100 lines
1.1 KiB
Text

01h4x.com
360Spider
AhrefsBot
Alligator
AlphaBot
Anarchie
Anthill
Asterias
BDCbot
BLEXBot
Backlink-Ceck
Barkrowler
CODE87
Chlooe
Cocolyzebot
Crawling at Home Project
Curious
DataCha0s
DigitalPebble
Disco
DittoSpyder
ECCP/1.0
Gotit
Haansoft
Hloader
IRLbot
Intelliseek
Kozmosbot
LNSpiderguy
LeechGet
Lipperhey
MSFrontPage
Majestic SEO
Majestic-SEO
Mass Downloader
Masscan
MegaIndex.ru
Metauri
MicroMessenger
Moblie Safari
MolokaiBot
Mozlila
Offline Explorer
Openfind
OrangeBot
OutfoxBot
PageThing.com
Petalbot
Picscout
Pimonster
Pu_iN
QueryN Metasearch
Quick-Crawler
Rainbot
Reaper
RepoMonkey
ScoutJet
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Site Sucker
Sogou web spider
Sosospider
SpaceBison
Spammen
SputnikBot
Surfbot
Titan
Toata
TurnitinBot
TwengaBot
VelenPublicWebCrawler
Voltron
WWW-Collector-E
Web Enhancer
Web Pix
WebFuck
WebStripper
Website Quester
Who.is Bot
Wotbox
Xenu
cah.io.community
clark-crawler
coccocbot
demandbase-bot
evc-batch
facebookscraper
ips-agent
iubenda-radar
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
oBot
seostar
tAkeOut
xpymep1.exe
zauba.io