nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-27 10:09:28 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
Aboundex
AfD-Verbotsverfahren
AiHitBot
Aipbot
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BDFetch
Backlink-Ceck
BacklinkCrawler
Bandit
Battleztar Bazinga
BetaBot
BlackWidow
BlowFish
BuiltBotTough
BuiltWith
CATExplorador
CSHttp
CensysInspect
CheeseBot
CherryPicker
Claritybot
Cliqzbot
Cocolyzebot
Copier
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Custo
DTS Agent
Demon
Digincore
DigitalPebble
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
Drip
EMail Siphon
EasyDL
EroCrawler
Extractor
FHscan
Firefox/7.0
FlashGet
Foobot
GalaxyBot
GermCrawler
GetRight
Getintent
Gotit
GrabNet
Grafula
GrapeshotCrawler
HMView
Haansoft
Heritrix
HybridBot
IDBTE4M
IDBot
Iblog
IlseBot
IndeedBot
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
JetCar
Jetty
JikeSpider
Joomla
Kozmosbot
LWP::Simple
Leap
LeechFTP
LeechGet
Lftp
LibWeb
Lightspeedsystems
LinkWalker
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Ltx71
MSFrontPage
MTRobot
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
MeanPath Bot
Minefield
Mister PiX
Mojeek
Mojolicious
Mozlila
Mr.4x3
Musobot
NPbot
Nameprotect
Net Vampire
Nettrack
Netvibes
NextGenSearchBot
Nikto
Ninja
Nutch
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OutfoxBot
POE-Component-Client-HTTP
Papa Foto
PeoplePal
PictureFinder
PleaseCrawl
ProPowerBot
ProWebWalker
Pump
PyCurl
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
ReGet
RealDownload
Reaper
RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
ScanAlert
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Seekport
SemrushBot
SeobilityBot
Seomoz
SiteCheckerBotCrawler
Sitebeam
Snapbot
Sogou web spider
Sosospider
SpaceBison
Spanner
Spbot
Spinn3r
Sqlworm
Sqworm
Steeler
Sucker
Suzuran
Swiftbot
Szukacz
T8Abot
Telesoft
Telesphorep
Thumbor
Titan
Toweyabot
Trendictionbot
TurnitinBot
Upflow
V-BOT
VCI
Vagabondo
VeriCiteCrawler
VoidEYE
Voil
WBSearchBot
WEBDAV
WPScan
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Sucker
WebAuto
WebFetch
WebReaper
WebStripper
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
Whack
WinHTTrack
Wonderbot
Xaldon WebSpider
Xenu
Zade
Zeus
Zitebot
ZmEu
ZumBot
archive.org_bot
arquivo.pt
cah.io.community
clark-crawler
crawl.sogou.com
demandbase-bot
evc-batch
facebookscraper
instabid
isitwp.com
lwp-request
mediawords
netEstate NE Crawler
ripz
seoscanners
serpstatbot
sitechecker.pro
siteripz
sp_auditbot
spyfu
tAkeOut
webgains-bot