nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-17 10:09:31 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ASPSeek
AfD-Verbotsverfahren
Aipbot
Alexibot
Alligator
Anarchy
Anarchy99
Apexoo
Attach
AwarioRssBot
BackStreet
Backlink-Ceck
Badass
Bandit
Barkrowler
BatchFTP
Black Hole
Bolt
BuiltBotTough
BuiltWith
Bullseye
CATExplorador
CCBot
CODE87
CSHttp
Calculon
CazoodleBot
CensysInspect
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
CopyRightCheck
Cosmos
Crawling at Home Project
Crescent
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
Digincore
Disco
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainStatsBot
Dotbot
EMail Siphon
Ecxi
EirGrabber
Exabot
Extractor
EyeNetIE
Ezooms
FemtosearchBot
Foobot
FrontPage
FyberSpider
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
Go-Ahead-Got-It
Grabber
GrapeFX
GridBot
HTMLparser
HTTP::Lite
HTTrack
Havij
Humanlinks
IDBot
IRLbot
Image Fetch
InterGET
InternetSeer
Iria
IstellaBot
JamesBOT
JennyBot
Joomla
Jorgee
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Lanshanbot
LibWeb
Libwhisker
Likse
LinkScan
Linkbot
LinkextractorPro
LinkpadBot
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MQQBrowser
MSIECrawler
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
Masscan
Mata Hari
Metauri
Microsoft URL Control
Minefield
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NICErsPRO
Name Intelligence
Navroad
NetAnts
NetMechanic
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nibbler
Ninja
Octopus
Offline Explorer
Openfind
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
Page Analyzer
Papa Foto
Pi-Monster
PictureFinder
Pixray
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
RankingBot2
ReGet
RealDownload
Reaper
RebelMouse
Recorder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
ScanAlert
Scanbot
SearchmetricsBot
Seekport
SemanticJuice
Semrush
Seomoz
Shodan
Siphon
Site Sucker
SiteLockSpider
SiteSucker
Sitevigil
SmartDownload
Snapbot
Sosospider
Spanner
Sqlworm
Sqworm
Stripper
Sucker
Sucuri
SuperHTTP
Surfbot
T0PHackTeam
T8Abot
Teleport
Thumbor
TightTwatBot
Tracemyfile
Turingos
URLy Warning
V-BOT
VB Project
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WWWOFFLE
Wallpapers
Web Fuck
Web Pix
Web Sucker
WebCopier
WebFetch
WebFuck
WebReaper
WebSauger
WebSucker
WebmasterWorldForumBot
Webshag
Whack
Whacker
Widow
WinHTTrack
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zade
ZmEu
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
heritrix
internetVista monitor
lwp-trivial
magpie-crawler
meanpathbot
mediawords
oBot
page scorer
pcBrowser
polaris version
seocompany.store
seoscanners
serpstatbot
siteripz
trendiction.com
trendiction.de
webmeup-crawler
zauba.io
zgrab