nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-19 10:07:54 +00:00

100 lines
1.1 KiB
Text

360Spider
ASPSeek
AhrefsBot
Aipbot
Anarchy
Anthill
BBBike
Bandit
Blackboard
Buck
Bytespider
Cegbfeieh
CheeseBot
ChinaClaw
Citoid
Cliqzbot
Cocolyzebot
Collector
CopyRightCheck
Crawling at Home Project
CrunchBot
Deusu
Discoverybot
EMail Siphon
FlashGet
Freeuploader
Gotit
GrabNet
Humanlinks
JamesBOT
Joomla
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
Lanshanbot
LieBaoFast
LinkextractorPro
Litemage_walker
MSFrontPage
Majestic-SEO
Meanpathbot
Mister PiX
Moblie Safari
Navroad
Offline Navigator
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
Papa Foto
Pimonster
Pockey
Proximic
PxBroker
QueryN Metasearch
RankurBot
Ripper
SalesIntelligent
ScoutJet
ScreenerBot
SenutoBot
SeobilityBot
SiteCheckerBotCrawler
Snake
Sottopop
SputnikBot
SuperHTTP
Szukacz
Toata
Trendiction
Turnitin
TwengaBot
URLy Warning
Voil
WISENutbot
WeSEE
WebGo IS
WebsiteExtractor
Webster
Who.is Bot
Wotbox
Xaldon WebSpider
Zermelo
ZoominfoBot
adscanner
arquivo-web-crawler
autoemailspider
backlink-check
clark-crawler
evc-batch
ips-agent
lwp-trivial
meanpathbot
netEstate NE Crawler
s1z.ru
scan.lol
tAkeOut
webmeup-crawler
webprosbot
x09Mozilla