nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-14 10:09:19 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AlphaBot
Anarchy99
Apexoo
Asterias
BBBike
BDFetch
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
Barkrowler
Battleztar Bazinga
Bitacle
BlowFish
Boardreader
BotALot
Buck
Bullseye
BuzzSumo
CCBot
CSHttp
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Copyscape
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DBLBot
DTS Agent
Digincore
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DnyzBot
DomainCrawler
Domains Project
Dotbot
ECCP/1.0
Exabot
FDM
FHscan
FlashGet
Flunky
Foobot
Freeuploader
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GermCrawler
Getintent
Gigabot
Go!Zilla
Gotit
Grafula
HTTrack
Haansoft
HaosouSpider
Havij
Humanlinks
Iblog
IlseBot
InfoTekies
InterGET
InternetSeer
Iskanie
Jbrofuzz
JetCar
Jorgee
JustView
Kenjin Spider
Keyword Density
Kinza
LNSpiderguy
Lanshanbot
Larbin
Leap
LibWeb
Libwhisker
Lightspeedsystems
LinksManager
Lipperhey
MFC_Tear_Sample
MIIxpc
MJ12bot
Magnet
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mb2345Browser
Mediatoolkitbot
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Musobot
Name Intelligence
Needle
Nessus
NetSpider
Nettrack
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Nmap
Nuclei
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Panscient
Pavuk
Pi-Monster
Piepmatz
Pimonster
Pockey
ProPowerBot
Probethenet
Psbot
RankFlex
RankurBot
Reaper
RedesScrapy
SEOkicks-Robot
SISTRIX
SMTBot
ScoutJet
Scrapy
ScrepyBot
SearchmetricsBot
SemanticJuice
Semrush
Shodan
SiteExplorer
SiteSnagger
Sitebeam
Snapbot
Snoopy
SocialRankIOBot
Sottopop
Spammen
SpankBot
Spanner
Spbot
Sucuri
SuperBot
SuperHTTP
Surfbot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Telesoft
Telesphoreo
TheNomad
Thumbor
Toweyabot
True_Robot
TwengaBot
Typhoeus
URLy Warning
Upflow
V-BOT
VB Project
Vacuum
VeriCiteCrawler
Virusdie
Voltron
WASALive-Bot
WBSearchBot
WWW-Mechanize
WWW::Mechanize
Wallpapers
Web Collage
WebCopier
WebFetch
WebSucker
WebmasterWorldForumBot
WebsiteExtractor
Webster
Whacker
Wonderbot
Wprecon
Xaldon WebSpider
Zade
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
check1.exe
clark-crawler
cognitiveseo
crawl.sogou.com
eCatch
ips-agent
isitwp.com
lwp-request
magpie-crawler
meanpathbot
polaris version
satoristudio.net
scalaj-http
seocompany.store
sp_auditbot
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com
x22Mozilla
xpymep1.exe
zgrab