nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-05 13:32:38 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
404enemy
AIBOT
Abonti
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Alligator
Apexoo
AwarioRssBot
BBBike
BDCbot
BDFetch
BackDoorBot
BackStreet
BackWeb
Barkrowler
Battleztar Bazinga
Bitacle
BlackWidow
Blow
BlowFish
Bolt
Buck
Buddy
BuzzSumo
CCBot
CazoodleBot
CheTeam
CheeseBot
CherryPicker
Chlooe
Claritybot
Cloud mapping
Collector
Copier
Copyscape
Cosmos
Curious
Custo
CyotekWebCopy
DBLBot
Demon
Digincore
DittoSpyder
DnyzBot
DomCopBot
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
Ebingbong
Ecxi
ExtLinksBot
Extreme Picture Finder
Ezooms
FHscan
Fimap
Firefox/7.0
Fuzz
FyberSpider
Fyrebot
GT::WWW
Genieo
GetWeb
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
HEADMasterSEO
HTTrack
Harvest
Havij
Hloader
Id-search
IlseBot
Image Fetch
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
Iskanie
IstellaBot
JennyBot
Jetty
JikeSpider
Joomla
Kenjin Spider
Kozmosbot
LNSpiderguy
LeechFTP
LexiBot
LieBaoFast
Likse
LinkScan
Lipperhey
Lipperhey Spider
Lmspider
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
MauiBot
Meanpathbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Morfeus Fucking Scanner
Mozlila
Msrabot
NICErsPRO
NPbot
NearSite
Net Vampire
NetAnts
NetMechanic
Netcraft
Netvibes
Ninja
Nuclei
OPPO A33
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
Page Analyzer
PageThing.com
Pandalytics
Papa Foto
Petalbot
Picsearch
Pixray
PleaseCrawl
Pu_iN
Pump
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
ReGet
RealDownload
RebelMouse
Recorder
RepoMonkey
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOstats
ScanAlert
Scanbot
Scrapy
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Siphon
SiteCheckerBotCrawler
SiteExplorer
SmartDownload
Snake
Snapbot
Sogou web spider
Sottopop
SpaceBison
Spammen
Spanner
Stripper
SuperBot
SuperHTTP
Surfbot
Szukacz
T8Abot
Teleport
Telesphorep
Thumbor
TightTwatBot
Trendiction
Trendictionbot
Turingos
Turnitin
Twice
URLy Warning
URLy.Warning
V-BOT
VCI
Vagabondo
VidibleScraper
Voltron
WISENutbot
Wallpapers/3.0
Web Pix
Web Sauger
WebCollage
WebCopier
WebFuck
WebLeacher
WebWhacker
WebZIP
Webalta
Webster
Whacker
Whatweb
Who.is Bot
Woobot
Wotbox
Xaldon_WebSpider
Xenu
Zauba
Zermelo
Zeus
ZmEu
backlink-check
crawler4j
demandbase-bot
eCatch
evc-batch
facebookscraper
gopher
heritrix
ips-agent
mediawords
page scorer
plumanalytics
ripz
scan.lol
serpstatbot
siteripz
sp_auditbot
spyfu
voyagerx.com
zauba.io
zgrab