nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-09 22:07:25 +00:00

250 lines
2.6 KiB
Text

360Spider
AIBOT
AfD-Verbotsverfahren
AiHitBot
Aipbot
AllSubmitter
Anarchie
Anarchy
Apexoo
Aspiegel
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BacklinkCrawler
Bandit
Barkrowler
Bitacle
Black Hole
BlackWidow
Blow
Brandwatch
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CCBot
CODE87
CSHttp
Cegbfeieh
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
Custo
DBLBot
DatabaseDriverMysqli
Deusu
Devil
Digincore
Dirbuster
Discobot
Dispatch
DittoSpyder
DomainAppender
Dotbot
Dragonfly
EMail Siphon
EirGrabber
EroCrawler
Evil
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
FHscan
FemtosearchBot
Firefox/7.0
Foobot
Freeuploader
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GetRight
Gigabot
Go!Zilla
Go-Ahead-Got-It
Gotit
HTMLparser
HTTP::Lite
HTTrack
Humanlinks
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
Image Fetch
IndeedBot
InfoTekies
Iria
JOC Web Spider
JamesBOT
JetCar
Jorgee
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
Leap
Lightspeedsystems
LinkScan
LinkpadBot
LinksManager
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MQQBrowser
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic12
MarkWatch
Masscan
Mata Hari
MauiBot
Mb2345Browser
MicroMessenger
Mojeek
Mojolicious
Mr.4x3
Msrabot
NPbot
Name Intelligence
Navroad
Needle
NetAnts
NetMechanic
NetZIP
Netvibes
Not
Nuclei
Nutch
OnCrawl
Openfind
OrangeBot
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Panscient
Pi-Monster
Picscout
Pimonster
PleaseCrawl
Probethenet
Quick-Crawler
RankingBot2
Re-re
RocketCrawler
SEOkicks-Robot
SMTBot
ScanAlert
Searchestate
SemanticJuice
Semrush
SemrushBot
SeoSiteCheckup
Seomoz
Siphon
SiteExplorer
SiteSnagger
Siteimprove
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
SpaceBison
Spanner
Spbot
SputnikBot
Sqlworm
Sqworm
Steeler
SuperBot
Surfbot
TeleportPro
Toata
Toweyabot
Tracemyfile
Trendictionbot
Typhoeus
URLy.Warning
VB Project
Vacuum
VeriCiteCrawler
Voltron
WEBDAV
WISENutbot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fuck
WebAuto
WebCollage
WebFetch
WebFuck
WebReaper
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Whack
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox
Xenu
YoudaoBot
Zade
Zermelo
ZyBorg
check1.exe
crawler4j
evc-batch
facebookscraper
heritrix
internetVista monitor
isitwp.com
iubenda-radar
lwp-request
mediawords
muhstik-scan
oBot
polaris version
ripz
seocompany.store
seoscanners
seostar
sexsearcher
siteripz
sogouspider
sp_auditbot
trendiction.com
trendiction.de
x09Mozilla
xpymep1.exe
zgrab