nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-15 22:05:31 +00:00

100 lines
1.1 KiB
Text

01h4x.com
80legs
ASPSeek
AdsTxtCrawlerTP
Alexibot
Apexoo
Atomseobot
AwarioSmartBot
BackStreet
BacklinkCrawler
BuiltBotTough
Calculon
CheeseBot
Collector
Craftbot
CrunchBot
DIIbot
DataCha0s
Digincore
Firefox/7.0
Flunky
FrontPage
Go!Zilla
Grabber
Haansoft
Harvest
IDBTE4M
IRLbot
Indy Library
Intelliseek
InternetSeer
Iskanie
JikeSpider
Jorgee
Jyxobot
Keyword Density
LNSpiderguy
Likse
MSFrontPage
MTRobot
Magnet
Microsoft Data Access
Morfeus Fucking Scanner
Net Vampire
NetAnts
Nuclei
Nutch
Offline Navigator
OpenVAS
PHPCrawl
Pandalytics
Pimonster
Probethenet
Proximic
Pu_iN
QueryN Metasearch
Reaper
RebelMouse
Rogerbot
SEOlyticsCrawler
Scrapy
Screaming
Semrush
SemrushBot
Shodan
SiteLockSpider
Sitevigil
SocialRankIOBot
Sociscraper
SpaceBison
SputnikBot
Sqlmap
Sucuri
SuperBot
TightTwatBot
Toweyabot
Trendiction
Turingos
TurnitinBot
URLy.Warning
WWW::Mechanize
Web Sucker
WebFetch
WebFuck
WebSauger
WebmasterWorldForumBot
Zitebot
ZoomBot
check1.exe
com.plumanalytics
gopher
iubenda-radar
linkdexbot
pcBrowser
scalaj-http
sysscan
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot