nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-11 22:07:19 +00:00

250 lines
2.5 KiB
Text

ASPSeek
Aboundex
AfD-Verbotsverfahren
AiHitBot
Alligator
Anarchie
Anarchy99
Apexoo
Aspiegel
Asterias
Attach
AwarioSmartBot
BLEXBot
Barkrowler
BetaBot
Bitacle
Black Hole
BlackWidow
Blackboard
BlowFish
Boardreader
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
Calculon
CensysInspect
Chlooe
Cliqzbot
Cogentbot
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
CrunchBot
Curious
Custo
DIIbot
DSearch
DTS Agent
Deusu
Devil
DigitalPebble
Discobot
DnyzBot
DomCopBot
DomainCrawler
Drip
EasyDL
Ebingbong
Exabot
ExtLinksBot
ExtractorPro
Ezooms
Fimap
Flunky
Freeuploader
FyberSpider
GT::WWW
Genieo
Getintent
Gigabot
Grabber
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
Haansoft
Heritrix
HonoluluBot
Humanlinks
HybridBot
IlseBot
InternetSeer
JOC Web Spider
JetCar
JikeSpider
Jorgee
Keyword Density
Kinza
Kozmosbot
LWP::Simple
Lanshanbot
LeechFTP
LeechGet
LibWeb
Likse
LinkScan
LinkpadBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MTRobot
Mag-Net
Magnet
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Meanpathbot
Mediatoolkitbot
MicroMessenger
Minefield
Moblie Safari
Mr.4x3
NPbot
Navroad
Needle
Nessus
Net Vampire
NetAnts
NetSpider
NetZIP
Netcraft
Netvibes
NextGenSearchBot
Nimbostratus
Nutch
Octopus
Offline Navigator
OpenVAS
OrangeBot
PECL::HTTP
PageThing.com
Papa Foto
PeoplePal
Picscout
Picsearch
Piepmatz
ProPowerBot
Pump
PxBroker
PyCurl
RSSingBot
RankActive
RankFlex
RankingBot
RankingBot2
ReGet
Recorder
RedesScrapy
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
Semrush
SentiBot
Siphon
SiteCheckerBotCrawler
Snake
Sosospider
Sottopop
Spammen
Spanner
Spbot
Spinn3r
Sqlmap
Sqworm
Stripper
Sucker
Sucuri
Surfbot
SurveyBot
Swiftbot
Szukacz
TeleportPro
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turnitin
TurnitinBot
UnisterBot
Upflow
VB Project
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers
Web Auto
Web Enhancer
Web Fuck
WebBandit
WebCollage
WebCopier
WebFuck
WebPix
WebReaper
WebWhacker
WebZIP
Website Quester
Webster
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
ZyBorg
adscanner
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
crawler4j
domainsproject.org
gopher
isitwp.com
linkdexbot
lwp-request
oBot
page scorer
plumanalytics
ripz
satoristudio.net
scalaj-http
seocompany.store
seostar
serpstatbot
siteripz
sp_auditbot
spyfu
trendiction.com
webgains-bot
webmeup-crawler
webprosbot
x22Mozilla