nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-29 10:09:13 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
ALittle Client
Aboundex
AfD-Verbotsverfahren
AiHitBot
Alexibot
Alligator
AlphaBot
Ankit
Aspiegel
AwarioSmartBot
BDFetch
BLEXBot
BackStreet
BacklinkCrawler
Battleztar Bazinga
BlowFish
Boardreader
Brandwatch
Buddy
Bullseye
BunnySlippers
BuzzSumo
CCBot
Calculon
CazoodleBot
CheTeam
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
Collector
Copier
CopyRightCheck
Craftbot
CrazyWebCrawler
Crescent
DBLBot
DIIbot
DSearch
DTS Agent
DigitalPebble
Discobot
DittoSpyder
DnBCrawler-Analytics
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
ECCP/1.0
EMail Siphon
EasyDL
EirGrabber
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
FemtosearchBot
Fimap
FlashGet
Freeuploader
FrontPage
G-i-g-a-b-o-t
Genieo
Gigabot
Go!Zilla
Gotit
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
Haansoft
Heritrix
Humanlinks
HybridBot
IRLbot
Iblog
Id-search
InfoNaviRobot
InternetSeer
Iskanie
JennyBot
JetCar
JikeSpider
Joomla
Kinza
LNSpiderguy
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Lightspeedsystems
LinkScan
Linkbot
LinksManager
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
MIDown tool
MJ12bot
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mata Hari
MeanPath Bot
Meanpathbot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Net Vampire
NetZIP
Netvibes
Nikto
Not
Octopus
Offline Navigator
OpenLinkProfiler
Openfind
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Pi-Monster
Picscout
Picsearch
Pockey
ProPowerBot
Probethenet
PyCurl
RSSingBot
RankActiveLinkBot
RankFlex
ReGet
RebelMouse
Ripper
Rogerbot
SEOkicks
SMTBot
SalesIntelligent
ScreenerBot
Searchestate
Seekport
SemanticJuice
SiteLockSpider
Sitebeam
Sitevigil
SlySearch
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spanner
Spbot
SputnikBot
Sqlmap
Steeler
Stripper
Sucker
SuperBot
Surfbot
SurveyBot
Swiftbot
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Trendictionbot
TurnitinBot
TwengaBot
URLy Warning
V-BOT
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WASALive-Bot
WEBDAV
WPScan
Wallpapers
WeSEE
Web Collage
Web Fuck
WebAuto
WebBandit
WebCollage
WebFuck
WebGo IS
WebStripper
Webalta
Webshag
Website Quester
WebsiteQuester
Whacker
Widow
Wonderbot
Woobot
Wprecon
Zermelo
ZmEu
arquivo-web-crawler
arquivo.pt
check1.exe
coccocbot-web
cognitiveseo
crawler4j
domainsproject.org
gopher
instabid
internetVista monitor
ips-agent
lwp-request
lwp-trivial
magpie-crawler
mediawords
netEstate NE Crawler
page scorer
polaris version
probe-image-size
ripz
s1z.ru
seocompany.store
serpstatbot
sexsearcher
sogouspider
webprosbot
x22Mozilla
zauba.io