nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-14 10:09:43 +00:00

250 lines
2.6 KiB
Text

404checker
80legs
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
AlphaBot
Anarchie
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
Badass
Bandit
Barkrowler
Battleztar Bazinga
Bigfoot
Black Hole
BlackWidow
Blackboard
Brandwatch
Buck
Buddy
BuiltWith
BunnySlippers
CCBot
CODE87
CazoodleBot
CheTeam
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Collector
Cosmos
Curious
Custo
DIIbot
Devil
DigitalPebble
Dirbuster
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainStatsBot
Domains Project
Dotbot
EasyDL
Ebingbong
Evil
ExtLinksBot
ExtractorPro
Ezooms
FHscan
Fimap
Fuzz
GetRight
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
GrapeshotCrawler
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Heritrix
IDBTE4M
IDBot
Image Fetch
IndeedBot
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JetCar
JikeSpider
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LeechGet
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
MIIxpc
MSIECrawler
Mag-Net
Majestic12
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
Mister PiX
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Navroad
Nessus
NetLyzer
NetMechanic
Nettrack
Netvibes
Nibbler
Niki-bot
Nimbostratus
Offline Navigator
OpenVAS
Openfind
OrangeSpider
Page Analyzer
PageAnalyzer
PageThing.com
Pandalytics
Panscient
Papa Foto
Pavuk
Petalbot
Picsearch
PictureFinder
Pimonster
Pixray
Pockey
ProPowerBot
Psbot
Pu_iN
Pump
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
ReGet
Reaper
RebelMouse
RedesScrapy
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
Scanbot
ScreenerBot
SemanticJuice
SemrushBot
Shodan
Siphon
SiteExplorer
SiteLockSpider
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Spammen
SpankBot
Sqlmap
Sqlworm
Stripper
SuperHTTP
Swiftbot
Szukacz
Telesphorep
Titan
Tracemyfile
Trendictionbot
Turingos
Turnitin
Typhoeus
VCI
Voil
WEBDAV
WWW-Collector-E
Wallpapers
WallpapersHD
WeSEE
Web Fuck
Web Sucker
WebAuto
WebBandit
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebSauger
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Website Quester
Whack
Whatweb
Wonderbot
Woobot
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
Zermelo
ZmEu
ZoomBot
ZumBot
backlink-check
cah.io.community
coccocbot
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
eCatch
heritrix
instabid
internetVista monitor
iubenda-radar
lwp-trivial
meanpathbot
muhstik-scan
polaris version
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seobility
seoscanners
seostar
sp_auditbot
tAkeOut
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla