nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-12 10:09:25 +00:00

250 lines
2.7 KiB
Text

360Spider
404enemy
80legs
AIBOT
Acunetix
AhrefsBot
AlphaBot
Anarchy99
Asterias
Attach
BBBike
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga
Bitacle
Black Hole
Blackboard
Blow
Brandwatch
Buck
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
Calculon
Claritybot
Cloud mapping
Cogentbot
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
CyotekWebCopy
DatabaseDriverMysqli
Devil
Digincore
DigitalPebble
Dirbuster
Discobot
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Drip
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
ExtLinksBot
Ezooms
FDM
FyberSpider
GalaxyBot
GermCrawler
GetWeb
GoZilla
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTrack
Haansoft
Hloader
HonoluluBot
Id-search
Image Fetch
Image Sucker
InfoNaviRobot
Intelliseek
InterGET
Iria
Iskanie
IstellaBot
JennyBot
Jetty
Joomla
JustView
Jyxobot
Keyword Density
LNSpiderguy
Larbin
LibWeb
Lightspeedsystems
Likse
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MFC_Tear_Sample
MIIxpc
MSIECrawler
Majestic-SEO
Masscan
MauiBot
MeanPath Bot
Metauri
Microsoft Data Access
Microsoft URL Control
Minefield
Mojeek
Mojolicious
Mr.4x3
Musobot
Name Intelligence
Nameprotect
Nessus
NetAnts
NetMechanic
Netcraft
Nettrack
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OutfoxBot
PECL::HTTP
PageAnalyzer
PageThing.com
Pandalytics
Panscient
Pavuk
Petalbot
Pi-Monster
ProPowerBot
ProWebWalker
Psbot
Pump
Re-re
ReGet
RebelMouse
RocketCrawler
Rogerbot
SBIder
SEOlyticsCrawler
SEOprofiler
SalesIntelligent
ScanAlert
ScoutJet
Searchestate
Semrush
SentiBot
Siphon
SiteSucker
Sitebeam
SmartDownload
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
Spammen
SpankBot
Spanner
Sqlworm
Sucuri
SurveyBot
Suzuran
TeleportPro
Telesphorep
TheNomad
Toweyabot
Trendiction
Trendictionbot
TurnitinBot
UnisterBot
V-BOT
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Auto
Web Enhancer
Web Pix
Web Sucker
WebAuto
WebCollage
WebFetch
WebLeacher
WebPix
WebStripper
WebWhacker
WebZIP
Website Quester
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
Woobot
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
archive.org_bot
arquivo-web-crawler
cah.io.community
cognitiveseo
crawl.sogou.com
crawler4j
demandbase-bot
ips-agent
isitwp.com
linkdexbot
lwp-request
magpie-crawler
mediawords
netEstate NE Crawler
pcBrowser
polaris version
s1z.ru
scalaj-http
scan.lol
seobility
seocompany.store
seoscanners
serpstatbot
sitechecker.pro
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
zauba.io
zgrab