nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-11 10:09:30 +00:00

250 lines
2.5 KiB
Text

360Spider
404enemy
80legs
ASPSeek
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AlphaBot
Anarchie
Apexoo
Aspiegel
Atomseobot
AwarioRssBot
BBBike
BackWeb
BacklinkCrawler
Barkrowler
BetaBot
Blow
BlowFish
Boardreader
BotALot
Bullseye
CCBot
CSHttp
Cegbfeieh
CheTeam
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
DBLBot
DTS Agent
Demon
DnyzBot
DomainAppender
DomainSigmaCrawler
Dotbot
Download Wonder
ECCP/1.0
Ecxi
Evil
Extractor
ExtractorPro
EyeNetIE
FrontPage
FyberSpider
GalaxyBot
Genieo
GetWeb
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grafula
GrapeFX
Haansoft
Harvest
Hloader
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
InfoTekies
Internet Ninja
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Jetty
JustView
Keyword Density
Kinza
Lanshanbot
Leap
LeechFTP
Lftp
LibWeb
LieBaoFast
LinkScan
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Ltx71
MIDown tool
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
Mail.RU_Bot
Masscan
Mata Hari
Meanpathbot
MicroMessenger
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NPbot
Nameprotect
NearSite
Needle
NetMechanic
NetSpider
NetZIP
NimbleCrawler
Nimbostratus
Not
Octopus
Offline Explorer
OnCrawl
OpenVAS
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
PeoplePal
Pi-Monster
Pockey
Psbot
PxBroker
PyCurl
RSSingBot
Rankivabot
Re-re
Recorder
RepoMonkey
RocketCrawler
Scrapy
ScreenerBot
Searchestate
SemrushBot
SeoSiteCheckup
Seomoz
Siphon
Site Sucker
SiteExplorer
Siteimprove
Sogou web spider
Sosospider
Spammen
Spanner
Sqlmap
Sqworm
Steeler
SuperBot
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesoft
The Intraformant
TheNomad
Titan
Toweyabot
Trendiction
Turingos
TwengaBot
UnisterBot
Upflow
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Sucker
WebAuto
WebCollage
WebCopier
WebGo IS
WebReaper
WebStripper
WebWhacker
WebZIP
Website Quester
WebsiteExtractor
Whack
Who.is Bot
Widow
Wonderbot
Wotbox
Xenu
YoudaoBot
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
adscanner
autoemailspider
backlink-check
check1.exe
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawler4j
eCatch
instabid
ips-agent
iubenda-radar
magpie-crawler
netEstate NE Crawler
oBot
probe-image-size
satoristudio.net
scan.lol
seocompany.store
seoscanners
serpstatbot
sogouspider
sp_auditbot
spyfu
webgains-bot
webmeup-crawler