nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-22 10:09:17 +00:00

250 lines
2.6 KiB
Text

ALittle Client
Aboundex
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
Anarchie
Anarchy99
Apexoo
Attach
AwarioRssBot
BBBike
BDCbot
BackStreet
BacklinkCrawler
Battleztar Bazinga
BetaBot
BlackWidow
Blackboard
Blow
BlowFish
Brandprotect
Brandwatch
Buck
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CSHttp
CheeseBot
CherryPicker
Cliqzbot
Cocolyzebot
CopyRightCheck
Crescent
Custo
Digincore
DigitalPebble
Disco
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainSigmaCrawler
Domains Project
Download Wonder
Dragonfly
EMail Siphon
EroCrawler
Evil
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Firefox/7.0
FlashGet
Freeuploader
FyberSpider
Fyrebot
GT::WWW
GermCrawler
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrabNet
HMView
HTMLparser
Haansoft
Id-search
Indy Library
InfoTekies
Iria
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
Kenjin Spider
Kinza
Kozmosbot
Lanshanbot
Larbin
Leap
LeechFTP
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinqiaScrapeBot
Lmspider
Ltx71
MQQBrowser
MTRobot
Mag-Net
Majestic12
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Needle
Net Vampire
NetLyzer
NetMechanic
Netcraft
Netvibes
Nikto
NimbleCrawler
Nmap
Nuclei
Nutch
Octopus
Offline Explorer
OpenVAS
Openfind
Openvas
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
Pi-Monster
PictureFinder
Pimonster
ProPowerBot
Psbot
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankingBot
Re-re
RealDownload
Reaper
RebelMouse
RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks-Robot
SISTRIX
SalesIntelligent
Scanbot
ScoutJet
ScrepyBot
SentiBot
SeoSiteCheckup
Siphon
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove
Sitevigil
SlySearch
SmartDownload
Sociscraper
Spammen
SpankBot
Spbot
Stripper
Sucker
Telesphoreo
TightTwatBot
Tracemyfile
Trendictionbot
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
URLy Warning
UnisterBot
V-BOT
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Enhancer
Web Pix
WebAuto
WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebSucker
Webalta
Webshag
WebsiteQuester
Whack
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Wotbox
Xaldon WebSpider
YoudaoBot
Zauba
ZoomBot
ZoominfoBot
archive.org_bot
arquivo.pt
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
dataforseo.com
evc-batch
facebookscraper
gopher
heritrix
instabid
ips-agent
mediawords
muhstik-scan
oBot
page scorer
seobility
seocompany.store
sp_auditbot
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zauba.io