nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-03 22:04:52 +00:00

100 lines
1,011 B
Text

360Spider
BackStreet
Backlink-Ceck
Bigfoot
Bitacle
Blackboard
BlowFish
Boardreader
BotALot
Bytespider
CazoodleBot
Cocolyzebot
Cosmos
DIIbot
Digincore
Disco
DomCopBot
Download Wonder
Ecxi
Evil
FHscan
Fimap
Flunky
Foobot
Fyrebot
GetRight
GoZilla
HaosouSpider
HybridBot
IDBot
Indy Library
InfoNaviRobot
Iskanie
JOC Web Spider
JetCar
Jetty
Jorgee
LeechGet
LinkScan
LinqiaScrapeBot
MSFrontPage
Mag-Net
Magnet
Metauri
Minefield
Musobot
Nikto
OpenLinkProfiler
OutfoxBot
PECL::HTTP
Pixray
Quick-Crawler
RSSingBot
RankActive
RankFlex
Re-re
ReGet
RepoMonkey
Rogerbot
ScanAlert
Scrapy
ScrepyBot
Seekport
SemanticJuice
SiteCheckerBotCrawler
Sogou web spider
Spanner
Suzuran
Telesphoreo
Telesphorep
Titan
Toata
Tracemyfile
Twice
VidibleScraper
WWW::Mechanize
WWWOFFLE
Web Pix
WebGo IS
WebStripper
WebSucker
WebWhacker
Webster
Widow
WinHTTrack
Wonderbot
ZumBot
arquivo-web-crawler
cah.io.community
domainsproject.org
imagesift.com
instabid
magpie-crawler
meanpathbot
openai
ripz
seocompany.store
x22Mozilla
xpymep1.exe
zgrab