nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-17 10:13:09 +00:00

250 lines
2.7 KiB
Text

404checker
AIBOT
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
Anarchie
Anarchy99
Ankit
Asterias
Atomseobot
Attach
BBBike
BDCbot
BLEXBot
BackDoorBot
Bandit
Bitacle
Boardreader
BotALot
Brandprotect
Brandwatch
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Chlooe
Citoid
Claritybot
Collector
Copyscape
Crawling at Home Project
CrazyWebCrawler
Crescent
Custo
DBLBot
DIIbot
DatabaseDriverMysqli
Demon
Devil
Digincore
DigitalPebble
Discoverybot
Dispatch
DnBCrawler-Analytics
DnyzBot
Domains Project
Dragonfly
ECCP/1.0
Express WebPictures
Extreme Picture Finder
Ezooms
FDM
FHscan
Firefox/7.0
FlashGet
Freeuploader
Fyrebot
GT::WWW
GalaxyBot
Genieo
GetRight
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
Haansoft
Havij
Humanlinks
IDBTE4M
IDBot
Iblog
IlseBot
InfoTekies
InterGET
JennyBot
Jetty
Kenjin Spider
Keyword Density
Kozmosbot
LWP::Simple
Lanshanbot
Larbin
Lightspeedsystems
Linkbot
LinqiaMetadataDownloaderBot
Lipperhey
Magnet
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
NearSite
Needle
Nessus
NetMechanic
Nettrack
NextGenSearchBot
Nibbler
Nuclei
Offline Navigator
Openfind
OrangeBot
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
Pandalytics
Pavuk
Petalbot
Picscout
Pockey
ProWebWalker
Probethenet
Psbot
Quick-Crawler
RankActive
RankActiveLinkBot
Rankivabot
Re-re
ReGet
Reaper
RocketCrawler
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
SMTBot
ScanAlert
Screaming
Searchestate
SearchmetricsBot
Seekport
SeobilityBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitebeam
Snake
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Spammen
SpankBot
Spinn3r
Sqworm
Steeler
SurveyBot
Suzuran
Szukacz
T0PHackTeam
T8Abot
Telesphoreo
TightTwatBot
Toata
Toweyabot
Trendictionbot
True_Robot
URLy Warning
URLy.Warning
Upflow
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
VidibleScraper
WASALive-Bot
WBSearchBot
WEBDAV
WWW-Collector-E
WallpapersHD
Web Auto
Web Pix
Web Sucker
WebAuto
WebCollage
WebCopier
WebFetch
WebImageCollector
WebPix
WebReaper
WebStripper
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Whatweb
Who.is Bot
WiseGuys Robot
Xaldon_WebSpider
Zauba
Zermelo
Zeus
ZoomBot
ZumBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
clark-crawler
crawl.sogou.com
crawler.feedback
crawler4j
evc-batch
facebookscraper
heritrix
ips-agent
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
ripz
satoristudio.net
scalaj-http
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sysscan
trendiction.com
webpros.com
xpymep1.exe
zgrab