nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-10 22:05:49 +00:00

100 lines
1,005 B
Text

360Spider
ADmantX
ASPSeek
AhrefsBot
Attach
BackWeb
BetaBot
BotALot
Buddy
CazoodleBot
CensysInspect
CheeseBot
Chlooe
Claritybot
Cogentbot
Copyscape
Curious
DomCopBot
DomainSigmaCrawler
EasyDL
EyeNetIE
Ezooms
FlashGet
Fuzz
Fyrebot
GoZilla
GrapeFX
HTMLparser
HTTrack
Harvest
Havij
IlseBot
InternetSeer
Jbrofuzz
JennyBot
Jetty
Leap
LinkScan
Linkbot
LinkpadBot
LinqiaRSSBot
Lipperhey Spider
MIIxpc
MicroMessenger
Microsoft Data Access
Moblie Safari
Morfeus Fucking Scanner
NPbot
Net Vampire
NetMechanic
Netcraft
Nibbler
Nuclei
OpenLinkProfiler
Openvas
OutclicksBot
Picsearch
Pu_iN
QueryN Metasearch
Ripper
RocketCrawler
SBIder
SalesIntelligent
ScanAlert
Scanbot
Scrapy
ScreenerBot
SeoSiteCheckup
Site Sucker
Sosospider
Spanner
Sqlworm
Stripper
Sucker
Suzuran
Telesphoreo
Toata
Trendiction
Turingos
Typhoeus
URLy.Warning
Upflow
Web Fetch
WebAuto
WebEnhancer
WebLeacher
WebsiteQuester
WinHTTrack
Wotbox
Wprecon
ZumBot
check1.exe
crawler4j
evc-batch
seobility
sexsearcher
spyfu
tAkeOut
webmeup-crawler
webprosbot