nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-03 09:39:51 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ASPSeek
Aboundex
Acunetix
AfD-Verbotsverfahren
Aipbot
AllSubmitter
AlphaBot
Apexoo
BDCbot
Bandit
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
BlackWidow
BlowFish
Bullseye
BuzzSumo
CCBot
CODE87
CazoodleBot
CensysInspect
Collector
Copier
CopyRightCheck
Curious
DBLBot
DSearch
Digincore
DigitalPebble
Dirbuster
Discobot
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainCrawler
ECCP/1.0
EasyDL
Evil
Exabot
ExtractorPro
FHscan
FemtosearchBot
Fimap
Fuzz
FyberSpider
Fyrebot
GalaxyBot
Genieo
GermCrawler
GetWeb
GrabNet
Grabber
Grafula
GrapeFX
HEADMasterSEO
HTMLparser
HTTP::Lite
HaosouSpider
Havij
Heritrix
HybridBot
IDBTE4M
Id-search
IlseBot
Image Sucker
IndeedBot
InfoTekies
InterGET
Internet Ninja
Iria
IstellaBot
JamesBOT
JennyBot
Jetty
JikeSpider
Joomla
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
Larbin
LeechFTP
LibWeb
LinkWalker
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MIIxpc
MJ12bot
MQQBrowser
MarkMonitor
Mb2345Browser
MeanPath Bot
Metauri
MicroMessenger
Microsoft Data Access
Mojeek
Mojolicious
MolokaiBot
Mozlila
Musobot
NICErsPRO
NPbot
Name Intelligence
NearSite
Needle
Nessus
Net Vampire
NetAnts
NetMechanic
NetZIP
Nettrack
Netvibes
Niki-bot
NimbleCrawler
Nmap
Octopus
OnCrawl
OpenVAS
Openvas
OrangeBot
OrangeSpider
Page Analyzer
Pandalytics
PeoplePal
Pi-Monster
PictureFinder
Piepmatz
ProWebWalker
Psbot
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
RealDownload
Reaper
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SMTBot
Scrapy
Screaming
Seekport
SemrushBot
SeoSiteCheckup
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
Siteimprove
SmartDownload
Sociscraper
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spammen
Spanner
SputnikBot
Sqlworm
SuperBot
SuperHTTP
SurveyBot
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
Telesphorep
Thumbor
Toweyabot
Tracemyfile
Trendictionbot
TwengaBot
Twice
URLy Warning
Upflow
VB Project
VCI
VoidEYE
Voltron
WASALive-Bot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Collage
Web Fetch
Web Sucker
WebAuto
WebReaper
WebStripper
Webalta
WebmasterWorldForumBot
Website Quester
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xenu
ZoominfoBot
ZyBorg
archive.org_bot
backlink-check
cah.io.community
check1.exe
clark-crawler
cognitiveseo
dataforseo.com
domainsproject.org
evc-batch
facebookscraper
internetVista monitor
ips-agent
isitwp.com
lwp-trivial
magpie-crawler
netEstate NE Crawler
ripz
s1z.ru
scan.lol
seoscanners
sitechecker.pro
siteripz
trendiction.com
voyagerx.com
webprosbot
zgrab