nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-05 22:07:08 +00:00

250 lines
2.7 KiB
Text

360Spider
ASPSeek
Aboundex
AfD-Verbotsverfahren
Aipbot
AllSubmitter
Anarchie
Anarchy
Ankit
Anthill
Apexoo
AwarioRssBot
BBBike
BDFetch
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
BatchFTP
Blow
BlowFish
Boardreader
Buck
Buddy
BuiltBotTough
BuzzSumo
CensysInspect
CheeseBot
CherryPicker
Claritybot
Cloud mapping
Collector
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
DBLBot
Demon
Deusu
Devil
DigitalPebble
Dirbuster
Disco
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainSigmaCrawler
EMail Siphon
EroCrawler
Express WebPictures
Extractor
Extreme Picture Finder
FHscan
FemtosearchBot
Foobot
FrontPage
Fuzz
FyberSpider
GT::WWW
GalaxyBot
GetRight
Getintent
Go!Zilla
Grabber
Grafula
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
Haansoft
HaosouSpider
Harvest
HybridBot
Iblog
IlseBot
IndeedBot
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
Iskanie
JennyBot
JustView
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
Larbin
Lftp
Likse
LinkWalker
Linkbot
LinqiaMetadataDownloaderBot
MSIECrawler
MTRobot
MarkWatch
Mass Downloader
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
MicroMessenger
Minefield
Mister PiX
Mojeek
Mr.4x3
Musobot
NPbot
NetAnts
Niki-bot
Not
Nutch
Octopus
OnCrawl
OrangeSpider
OutfoxBot
PageAnalyzer
PageGrabber
PageThing.com
Panscient
Papa Foto
Petalbot
Pi-Monster
Picscout
Piepmatz
Pockey
ProWebWalker
Probethenet
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Screaming
Seekport
SeobilityBot
Seomoz
Shodan
SiteCheckerBotCrawler
Sitebeam
Siteimprove
Sitevigil
SlySearch
Sogou web spider
Sosospider
Sottopop
Sqlmap
Stripper
SuperHTTP
Suzuran
Szukacz
T8Abot
Teleport
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toata
Toweyabot
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
VelenPublicWebCrawler
VoidEYE
Voil
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Pix
Web Sucker
WebFetch
WebFuck
WebLeacher
WebWhacker
WebZIP
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Whack
Whacker
Whatweb
Who.is Bot
Widow
Wonderbot
Wotbox
Zauba
Zermelo
ZumBot
ZyBorg
archive.org_bot
autoemailspider
check1.exe
cognitiveseo
crawler4j
dataforseo.com
domainsproject.org
evc-batch
facebookscraper
heritrix
internetVista monitor
iubenda-radar
linkdexbot
lwp-request
mediawords
muhstik-scan
oBot
pcBrowser
plumanalytics
polaris version
satoristudio.net
scalaj-http
seoscanners
seostar
sitechecker.pro
sp_auditbot
tAkeOut
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
x09Mozilla
xpymep1.exe