nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-25 10:09:41 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ADmantX
AIBOT
ALittle Client
AfD-Verbotsverfahren
AhrefsBot
Anarchie
Anthill
Apexoo
Aspiegel
BBBike
BDFetch
BackStreet
BackWeb
Backlink-Ceck
Badass
Bitacle
Blackboard
Blow
Boardreader
BotALot
Buddy
Bullseye
BuzzSumo
CODE87
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Collector
Copier
CopyRightCheck
Cosmos
CrazyWebCrawler
Custo
DTS Agent
DatabaseDriverMysqli
Deusu
Devil
DigitalPebble
Dirbuster
Discoverybot
DnBCrawler-Analytics
DomCopBot
DomainAppender
Drip
EMail Wolf
Evil
Ezooms
Fimap
Firefox/7.0
Flunky
Foobot
FrontPage
GalaxyBot
Genieo
GermCrawler
Go!Zilla
GrabNet
Grabber
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
HaosouSpider
Harvest
HonoluluBot
HybridBot
IDBot
Iblog
Image Fetch
Indy Library
Iskanie
IstellaBot
Jetty
JustView
Kenjin Spider
Kinza
Kozmosbot
LWP::Simple
Lanshanbot
LeechGet
LexiBot
LibWeb
Libwhisker
Likse
LinkpadBot
Lipperhey
Litemage_walker
Lmspider
MFC_Tear_Sample
MIDown tool
MJ12bot
Magnet
Majestic12
MarkMonitor
Masscan
MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NICErsPRO
Nameprotect
Netcraft
Netvibes
NextGenSearchBot
Nibbler
Ninja
Nmap
Not
Nuclei
Offline Navigator
OpenVAS
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Pandalytics
Papa Foto
Pavuk
Picsearch
PictureFinder
Piepmatz
Pixray
Probethenet
Psbot
Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
Rankivabot
RankurBot
Recorder
SEOkicks-Robot
SISTRIX
SalesIntelligent
Scrapy
ScreenerBot
Searchestate
Seekport
Semrush
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
SiteExplorer
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snapbot
Snoopy
Sosospider
SpaceBison
Spammen
Spanner
Spinn3r
SputnikBot
Sqlworm
Stripper
Sucker
Sucuri
SuperBot
Surfbot
Szukacz
T8Abot
Teleport
Telesoft
Telesphorep
The Intraformant
TheNomad
Thumbor
Toata
Toweyabot
Tracemyfile
Trendiction
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy Warning
UnisterBot
Upflow
V-BOT
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
Voltron
WEBDAV
WWW-Mechanize
Web Enhancer
Web Sauger
Web Sucker
WebBandit
WebGo IS
WebImageCollector
WebSucker
WebZIP
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wotbox
Xaldon_WebSpider
Xenu
Zeus
Zitebot
ZoomBot
ZoominfoBot
ZumBot
adscanner
archive.org_bot
backlink-check
clark-crawler
com.plumanalytics
dataforseo.com
domainsproject.org
eCatch
mediawords
oBot
page scorer
plumanalytics
seobility
seostar
serpstatbot
sysscan
trendiction.de
ubermetrics-technologies.com
webgains-bot
x22Mozilla
zauba.io