nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-13 10:07:15 +00:00

100 lines
1,016 B
Text

AhrefsBot
Apexoo
Backlink-Ceck
BacklinkCrawler
Bandit
Blackboard
Cegbfeieh
CheeseBot
Citoid
CopyRightCheck
Disco
Discobot
Dispatch
DittoSpyder
Download Wonder
ECCP/1.0
EasyDL
Ebingbong
Ecxi
ExtLinksBot
Extractor
Fimap
Foobot
Fuzz
G-i-g-a-b-o-t
GermCrawler
GetWeb
Gigabot
Haansoft
HonoluluBot
Iblog
IlseBot
JikeSpider
Jorgee
Keyword Density
LWP::Simple
Larbin
Lftp
MJ12bot
MSFrontPage
Mail.RU_Bot
Majestic12
Meanpathbot
MicroMessenger
NPbot
Nameprotect
Net Vampire
NetAnts
NetSpider
Nuclei
OutclicksBot
Panscient
Pi-Monster
PxBroker
RankingBot2
SMTBot
Screaming
Searchestate
SearchmetricsBot
SemrushBot
Sitevigil
Sogou web spider
Spanner
Spbot
Sqlmap
Stripper
Telesphoreo
Telesphorep
Thumbor
Titan
Upflow
VoidEYE
WWW::Mechanize
WallpapersHD
WeSEE
Web Collage
WebCollage
WebFetch
WebReaper
Webshag
Xenu
Zermelo
Zitebot
ZoomBot
ZyBorg
archive.org_bot
gopher
lwp-request
magpie-crawler
page scorer
s1z.ru
seocompany.store
sexsearcher
sp_auditbot
tAkeOut
trendiction.com
webgains-bot
webmeup-crawler
xpymep1.exe
zauba.io