nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-18 22:05:08 +00:00

100 lines
1 KiB
Text

01h4x.com
AhrefsBot
Aipbot
Anarchie
Aspiegel
Bigfoot
Bolt
Brandwatch
BuiltBotTough
CSHttp
Cegbfeieh
CheTeam
CherryPicker
Cliqzbot
Collector
CrazyWebCrawler
CyotekWebCopy
DatabaseDriverMysqli
Devil
Disco
Discobot
DnyzBot
DomainSigmaCrawler
EasyDL
FlashGet
Foobot
GoZilla
Grabber
Haansoft
IDBot
Image Fetch
InfoNaviRobot
JustView
Jyxobot
Keyword Density
Lanshanbot
LexiBot
Lipperhey
Magnet
Mr.4x3
NICErsPRO
Name Intelligence
Navroad
NetAnts
Nibbler
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openfind
Openvas
Pandalytics
Panscient
Pimonster
Pixray
Pockey
RankingBot2
RankurBot
Recorder
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
ScanAlert
Scrapy
Searchestate
SiteLockSpider
SmartDownload
Spinn3r
SurveyBot
Suzuran
Titan
Toata
Turingos
TwengaBot
VB Project
Vacuum
WeSEE
WebBandit
WebEnhancer
Webster
Whack
Xaldon_WebSpider
Zade
ZoominfoBot
archive.org_bot
check1.exe
crawler.feedback
dataforseo.com
page scorer
seobility
seocompany.store
seoscanners
sitechecker.pro
sogouspider
spyfu
trendiction.com
voyagerx.com
webmeup-crawler