nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-22 10:09:11 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
AhrefsBot
AllSubmitter
Alligator
AlphaBot
Anarchy
Anarchy99
Ankit
Apexoo
AwarioSmartBot
BDCbot
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Black Hole
Blow
Boardreader
BotALot
Brandprotect
Buddy
BuiltBotTough
CODE87
Calculon
CazoodleBot
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cogentbot
Crawling at Home Project
Curious
DTS Agent
DataCha0s
DatabaseDriverMysqli
Devil
DittoSpyder
DnyzBot
DomCopBot
Download Wonder
Drip
EMail Siphon
EroCrawler
ExtLinksBot
ExtractorPro
EyeNetIE
Ezooms
FDM
FemtosearchBot
Fimap
Foobot
Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler
Gigabot
GoZilla
HTTP::Lite
HybridBot
IDBot
IRLbot
Iblog
Image Fetch
Indy Library
InfoNaviRobot
Intelliseek
JOC Web Spider
JamesBOT
JennyBot
Jetty
JikeSpider
Jorgee
LNSpiderguy
LWP::Simple
Larbin
LeechFTP
LibWeb
Libwhisker
LieBaoFast
Likse
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
MIDown tool
MIIxpc
MQQBrowser
Mag-Net
Majestic SEO
MarkMonitor
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Musobot
Name Intelligence
Nameprotect
Nessus
NetAnts
NetLyzer
NetSpider
Nettrack
NextGenSearchBot
Nikto
Ninja
Offline Explorer
OpenVAS
Openvas
PECL::HTTP
PHPCrawl
Page Analyzer
PageScorer
Papa Foto
Petalbot
Pi-Monster
Picsearch
PictureFinder
Piepmatz
Pockey
Probethenet
Psbot
PxBroker
RSSingBot
RankActive
RankingBot
RedesScrapy
RepoMonkey
RocketCrawler
SEOkicks-Robot
Screaming
Searchestate
SemrushBot
SeoSiteCheckup
Seomoz
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
SlySearch
SmartDownload
Snake
Sociscraper
Sottopop
SpaceBison
Spammen
SpankBot
Spbot
Sqworm
Sucuri
Surfbot
SurveyBot
Suzuran
T8Abot
Teleport
The Intraformant
Titan
Tracemyfile
True_Robot
Turingos
URLy Warning
UnisterBot
Upflow
V-BOT
Vagabondo
VeriCiteCrawler
Virusdie
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
WallpapersHD
WeSEE
Web Enhancer
Web Fuck
Web Pix
Web Sauger
WebAuto
WebBandit
WebCollage
WebCopier
WebFetch
WebFuck
WebImageCollector
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Webster
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot
Zade
Zermelo
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
ZyBorg
archive.org_bot
arquivo.pt
backlink-check
cah.io.community
check1.exe
crawler.feedback
dataforseo.com
eCatch
evc-batch
facebookscraper
instabid
ips-agent
isitwp.com
lwp-trivial
muhstik-scan
netEstate NE Crawler
polaris version
probe-image-size
scan.lol
seobility
seoscanners
sp_auditbot
trendiction.de
ubermetrics-technologies.com
webpros.com
x22Mozilla