nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-13 22:07:24 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
AIBOT
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Alligator
AlphaBot
Anarchie
Anarchy
Attach
BBBike
BLEXBot
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Blackboard
Blow
Brandwatch
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CSHttp
Calculon
CazoodleBot
CensysInspect
CherryPicker
ChinaClaw
Cliqzbot
Cogentbot
Copier
Crawling at Home Project
Crescent
CyotekWebCopy
DatabaseDriverMysqli
Dirbuster
Discobot
Domains Project
Dotbot
Download Wonder
EMail Siphon
Evil
Extractor
ExtractorPro
FDM
FlashGet
Flunky
Foobot
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
Getintent
Gotit
GrabNet
GridBot
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Humanlinks
IDBot
IRLbot
Id-search
IlseBot
Image Sucker
InfoNaviRobot
Intelliseek
InternetSeer
Iria
JOC Web Spider
JamesBOT
JennyBot
Jyxobot
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
LibWeb
Lightspeedsystems
Likse
LinkScan
LinksManager
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Majestic12
MarkWatch
Mata Hari
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Minefield
Mister PiX
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Mr.4x3
Msrabot
NICErsPRO
Name Intelligence
Net Vampire
NetAnts
NetLyzer
NetZIP
Nettrack
Ninja
Nmap
Nuclei
Offline Navigator
OpenLinkProfiler
Openfind
OrangeBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageThing.com
Papa Foto
PeoplePal
Pi-Monster
PictureFinder
Piepmatz
Pixray
ProWebWalker
Psbot
PxBroker
Quick-Crawler
RankActiveLinkBot
RankFlex
Re-re
RebelMouse
RedesScrapy
Rogerbot
SEOlyticsCrawler
SEOprofiler
SEOstats
ScoutJet
Screaming
ScrepyBot
Searchestate
Seekport
SemanticJuice
Semrush
SeobilityBot
Seomoz
Siphon
SiteSnagger
Siteimprove
Snapbot
SocialRankIOBot
Sociscraper
Spammen
Spanner
Sqworm
Steeler
SuperBot
SurveyBot
Suzuran
T0PHackTeam
Teleport
TeleportPro
Telesphoreo
Thumbor
Turnitin
TwengaBot
Typhoeus
URLy.Warning
Upflow
VCI
Vacuum
Voltron
WBSearchBot
WPScan
WWW-Mechanize
Wallpapers/3.0
WeSEE
Web Fuck
WebBandit
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebPix
WebStripper
WebSucker
WebZIP
Webalta
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Who.is Bot
Widow
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zauba
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
archive.org_bot
arquivo.pt
autoemailspider
coccocbot
cognitiveseo
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
evc-batch
gopher
heritrix
internetVista monitor
isitwp.com
linkdexbot
lwp-trivial
magpie-crawler
mediawords
netEstate NE Crawler
page scorer
probe-image-size
s1z.ru
scalaj-http
seobility
sitechecker.pro
spyfu
tAkeOut
ubermetrics-technologies.com
x22Mozilla