nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-16 22:07:00 +00:00

250 lines
2.5 KiB
Text

360Spider
80legs
ASPSeek
Abonti
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Anarchy
Aspiegel
Attach
BBBike
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
Badass
Barkrowler
Battleztar Bazinga
BetaBot
Bitacle
BlackWidow
Blackboard
Blow
BotALot
Buck
Bullseye
BunnySlippers
CATExplorador
CODE87
CSHttp
Calculon
CensysInspect
CherryPicker
ChinaClaw
Chlooe
Cloud mapping
Cogentbot
Collector
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
DIIbot
DTS Agent
Digincore
Dispatch
DittoSpyder
EMail Wolf
Ecxi
EirGrabber
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
Ezooms
FDM
FHscan
FemtosearchBot
FlashGet
Flunky
Fuzz
Genieo
GermCrawler
GetRight
Getintent
Gigabot
Go!Zilla
Gotit
GrabNet
HTMLparser
Haansoft
Harvest
Heritrix
HonoluluBot
IDBTE4M
IRLbot
Id-search
Image Fetch
Iria
Iskanie
JamesBOT
JikeSpider
Joomla
Jorgee
Kenjin Spider
Keybot Translation-Search-Machine
Lanshanbot
Larbin
Libwhisker
Likse
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Magnet
Majestic SEO
MarkWatch
Masscan
MauiBot
Mediatoolkitbot
MicroMessenger
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NearSite
Needle
Nessus
NetAnts
NetLyzer
NetSpider
NetZIP
Nikto
Ninja
Nuclei
Octopus
OpenVAS
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Pavuk
Petalbot
Pi-Monster
Picscout
Picsearch
Piepmatz
Pixray
Probethenet
Psbot
Pu_iN
QueryN Metasearch
RSSingBot
RankFlex
Rankivabot
ReGet
RealDownload
Reaper
Recorder
Ripper
SEOkicks
SEOlyticsCrawler
SEOprofiler
Scanbot
ScoutJet
Scrapy
Screaming
Searchestate
SemanticJuice
Semrush
SentiBot
SeoSiteCheckup
Seomoz
Shodan
Siphon
Site Sucker
SiteLockSpider
Sitevigil
SlySearch
Snapbot
Sociscraper
Sottopop
SpaceBison
SputnikBot
Sqlworm
Sqworm
Stripper
Sucker
Sucuri
SuperHTTP
SurveyBot
Szukacz
Teleport
Telesoft
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Toata
True_Robot
Twice
URLy.Warning
Vacuum
Vagabondo
Virusdie
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fetch
Web Fuck
WebCollage
WebFetch
WebFuck
WebGo IS
WebLeacher
WebPix
WebmasterWorldForumBot
WebsiteExtractor
Whack
Widow
WiseGuys Robot
Wonderbot
Zade
Zermelo
Zeus
ZmEu
check1.exe
crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
evc-batch
heritrix
linkdexbot
mediawords
oBot
page scorer
pcBrowser
polaris version
scan.lol
seobility
seoscanners
seostar
sitechecker.pro
sogouspider
sp_auditbot
spyfu
tAkeOut
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webprosbot