nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-19 10:09:49 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
AfD-Verbotsverfahren
AhrefsBot
Anarchie
Anarchy
Apexoo
Atomseobot
AwarioRssBot
AwarioSmartBot
BBBike
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
BetaBot
Bitacle
Blackboard
BlowFish
Boardreader
BotALot
Brandprotect
Brandwatch
Buck
Buddy
BuiltBotTough
BunnySlippers
CCBot
Calculon
CensysInspect
CheTeam
Chlooe
Claritybot
Cliqzbot
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
Curious
DataCha0s
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Disco
DnBCrawler-Analytics
DnyzBot
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
Ebingbong
Ecxi
EyeNetIE
FemtosearchBot
Fimap
Foobot
Freeuploader
FrontPage
GalaxyBot
Genieo
GermCrawler
GetRight
Gigabot
Go!Zilla
Grabber
Grafula
HMView
Harvest
Heritrix
HonoluluBot
IDBTE4M
IRLbot
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
Intelliseek
Iria
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Joomla
Jorgee
Jyxobot
Keyword Density
LNSpiderguy
LeechGet
LexiBot
Libwhisker
Linkbot
Linkdexbot
LinkpadBot
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Mass Downloader
MauiBot
Mb2345Browser
Meanpathbot
Microsoft URL Control
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Needle
Nessus
Net Vampire
NetAnts
NetSpider
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Not
Nuclei
Octopus
Offline Navigator
OnCrawl
OpenVAS
Openfind
OrangeBot
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
PageThing.com
Pandalytics
Pi-Monster
Pimonster
Pixray
PleaseCrawl
Pockey
ProWebWalker
QueryN Metasearch
RankActiveLinkBot
Reaper
SISTRIX
ScrepyBot
Seekport
SemanticJuice
Semrush
SemrushBot
SeobilityBot
Seomoz
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
Snapbot
Snoopy
Sociscraper
Sogou web spider
Sottopop
Sqlworm
Sucker
Sucuri
Surfbot
Szukacz
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
V-BOT
VB Project
VCI
Vacuum
VeriCiteCrawler
VidibleScraper
VoidEYE
WBSearchBot
WISENutbot
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Sauger
WebAuto
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebmasterWorldForumBot
WebsiteExtractor
Widow
Wonderbot
Xenu
Zade
Zauba
Zermelo
Zitebot
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
backlink-check
cah.io.community
clark-crawler
cognitiveseo
demandbase-bot
domainsproject.org
magpie-crawler
meanpathbot
muhstik-scan
pcBrowser
scalaj-http
scan.lol
seobility
seoscanners
siteripz
trendiction.com
trendiction.de
webpros.com
webprosbot
xpymep1.exe
zauba.io
zgrab