nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-29 10:09:52 +00:00

250 lines
2.6 KiB
Text

404enemy
80legs
ALittle Client
ASPSeek
Abonti
AfD-Verbotsverfahren
Anarchie
Anarchy99
Apexoo
Asterias
AwarioSmartBot
BDFetch
BacklinkCrawler
Badass
BetaBot
Bigfoot
Bitacle
BlackWidow
Boardreader
Brandwatch
BuzzSumo
Calculon
Cegbfeieh
CensysInspect
CheeseBot
ChinaClaw
Citoid
Claritybot
Cliqzbot
Collector
Copier
Copyscape
Crescent
CyotekWebCopy
DTS Agent
DigitalPebble
Disco
DittoSpyder
DnBCrawler-Analytics
DomainAppender
DomainSigmaCrawler
DomainStatsBot
EMail Siphon
EMail Wolf
EroCrawler
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
Fimap
Freeuploader
GalaxyBot
GetRight
Getintent
Go!Zilla
GrapeFX
HTTP::Lite
HTTrack
Haansoft
Hloader
Humanlinks
HybridBot
IDBTE4M
Iblog
IlseBot
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JamesBOT
Jetty
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
LibWeb
Likse
LinkWalker
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MIIxpc
MJ12bot
MTRobot
Mail.RU_Bot
Majestic12
MarkMonitor
Mass Downloader
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Mojolicious
Mozlila
Mr.4x3
Navroad
NearSite
Needle
Nessus
NetLyzer
NetZIP
Nettrack
NextGenSearchBot
Nikto
Nimbostratus
Ninja
Nmap
Not
Nuclei
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PeoplePal
Petalbot
Pi-Monster
Picscout
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
Psbot
PxBroker
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot2
Rankivabot
Re-re
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SMTBot
ScanAlert
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Sitebeam
SmartDownload
Snake
Snapbot
Snoopy
Sogou web spider
SpaceBison
Spammen
SpankBot
Spanner
Sqlworm
SuperBot
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
TeleportPro
Telesphoreo
TheNomad
Titan
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
URLy Warning
UnisterBot
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
WEBDAV
WISENutbot
WallpapersHD
Web Collage
WebAuto
WebFuck
WebGo IS
WebLeacher
WebPix
WebReaper
WebStripper
WebWhacker
WebsiteQuester
Webster
Whacker
Whatweb
Who.is Bot
Widow
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zeus
Zitebot
ZoomBot
ZumBot
archive.org_bot
arquivo.pt
autoemailspider
cah.io.community
coccocbot
crawler.feedback
crawler4j
dataforseo.com
evc-batch
facebookscraper
instabid
ips-agent
isitwp.com
lwp-request
oBot
plumanalytics
satoristudio.net
scan.lol
seoscanners
seostar
sitechecker.pro
siteripz
spyfu
sysscan
trendiction.de
ubermetrics-technologies.com
webgains-bot
webpros.com
x09Mozilla
zgrab