nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-20 22:05:07 +00:00

100 lines
1.1 KiB
Text

404checker
Abonti
Aboundexbot
AhrefsBot
AllSubmitter
Anthill
BackDoorBot
Brandprotect
BuiltBotTough
Calculon
Cliqzbot
Crawling at Home Project
CyotekWebCopy
DBLBot
Discoverybot
Dotbot
ECCP/1.0
Express WebPictures
ExtractorPro
FDM
Flunky
Fyrebot
G-i-g-a-b-o-t
Genieo
Go!Zilla
GoZilla
GrabNet
HaosouSpider
HonoluluBot
Humanlinks
Indy Library
InfoNaviRobot
Intelliseek
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Lanshanbot
Leap
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
MFC_Tear_Sample
MJ12bot
MQQBrowser
MTRobot
Metauri
MolokaiBot
Msrabot
Nikto
NimbleCrawler
Offline Explorer
OnCrawl
Openvas
Page Analyzer
Pockey
QueryN Metasearch
Reaper
Recorder
RedesScrapy
SEOkicks-Robot
ScreenerBot
SearchmetricsBot
SentiBot
Seomoz
SmartDownload
Snoopy
SpaceBison
Spammen
SpankBot
SuperBot
Suzuran
TightTwatBot
Toata
TurnitinBot
URLy Warning
Upflow
VCI
WWW::Mechanize
WebGo IS
WebStripper
WebWhacker
WebmasterWorldForumBot
Webshag
Whacker
Whatweb
Wotbox
Zade
Zauba
Zitebot
adscanner
check1.exe
clark-crawler
crawler.feedback
gopher
internetVista monitor
page scorer
spyfu
sysscan
xpymep1.exe