nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-19 22:04:46 +00:00

100 lines
1.1 KiB
Text

80legs
AiHitBot
Aipbot
AllSubmitter
Anarchy
BDCbot
BDFetch
BackStreet
Badass
BatchFTP
Battleztar Bazinga
CATExplorador
CazoodleBot
Cloud mapping
Cogentbot
DSearch
Dirbuster
Discoverybot
DomainAppender
Download Wonder
Drip
EMail Wolf
Ecxi
EirGrabber
Exabot
Ezooms
FemtosearchBot
Fimap
GalaxyBot
Gigabot
Gotit
GrapeshotCrawler
HMView
HybridBot
IRLbot
ImagesiftBot
InfoNaviRobot
JennyBot
JikeSpider
LWP::Simple
Lftp
LieBaoFast
LinkScan
LinkpadBot
LinqiaRSSBot
MQQBrowser
Mag-Net
MarkWatch
Mediatoolkitbot
Net Vampire
Netvibes
Niki-bot
Offline Explorer
OpenLinkProfiler
Pi-Monster
PictureFinder
QueryN Metasearch
RankActive
ReGet
RealDownload
RepoMonkey
SalesIntelligent
Seekport
Semrush
SiteExplorer
SiteSnagger
SocialRankIOBot
Sociscraper
Spanner
SputnikBot
Sucker
Swiftbot
Thumbor
Tracemyfile
UnisterBot
WBSearchBot
WeSEE
Web Pix
WebCopier
WebReaper
WebSauger
WebsiteExtractor
Woobot
Xaldon_WebSpider
Zade
ZumBot
autoemailspider
crawl.sogou.com
dataforseobot
evc-batch
gopher
ips-agent
iubenda-radar
linkfluence
meanpathbot
pcBrowser
polaris version
seocompany.store
serpstatbot
webpros.com