nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-05-04 08:38:53 +00:00

100 lines
1.1 KiB
Text

404enemy
Acunetix
AhrefsBot
Anarchy
Atomseobot
AwarioBot
Brandprotect
Buddy
BuiltBotTough
Bullseye
CSHttp
CazoodleBot
CopyRightCheck
Copyscape
CrunchBot
DSearch
Dirbuster
Dispatch
DomCopBot
Dotbot
EasyDL
Extractor
Firefox/7.0
FlashGet
FyberSpider
G-i-g-a-b-o-t
GermCrawler
Getintent
Gotit
HEADMasterSEO
Haansoft
HybridBot
Image Fetch
Iria
Jbrofuzz
Jorgee
LeechFTP
LexiBot
LieBaoFast
LinqiaRSSBot
Lipperhey
Lipperhey Spider
MSFrontPage
MSIECrawler
Majestic SEO
Msrabot
NPbot
Net Vampire
NetSpider
Octopus
Offline Explorer
Page Analyzer
PageAnalyzer
Picscout
QueryN Metasearch
RankingBot
RankingBot2
Re-re
RebelMouse
SEOstats
ScreenerBot
ScrepyBot
SeekportBot
Siteimprove
SmartDownload
Sottopop
Spbot
Steeler
Telesphoreo
The Intraformant
Thumbor
Tracemyfile
URLy Warning
URLy.Warning
V-BOT
VCI
VeriCiteCrawler
WWW-Mechanize
WebFetch
WebGo IS
WebPix
WebSucker
Webshag
Whatweb
ZyBorg
awario.com
crawl.sogou.com
crawler.feedback
facebookscraper
heritrix
imagesift.com
isitwp.com
lwp-trivial
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
sp_auditbot
webmeup-crawler
xpymep1.exe