nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-20 22:07:12 +00:00

250 lines
2.6 KiB
Text

ADmantX
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Alexibot
AllSubmitter
AlphaBot
BDFetch
BLEXBot
BackWeb
BacklinkCrawler
Badass
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Black Hole
BlackWidow
Blackboard
BlowFish
BotALot
Brandprotect
Brandwatch
Buck
BuiltWith
CATExplorador
CCBot
CSHttp
CazoodleBot
CensysInspect
Cocolyzebot
CopyRightCheck
Copyscape
Crawling at Home Project
Crescent
CrunchBot
Custo
CyotekWebCopy
DIIbot
DataCha0s
DatabaseDriverMysqli
DomCopBot
DomainCrawler
DomainSigmaCrawler
Domains Project
Download Wonder
Dragonfly
EasyDL
Express WebPictures
ExtractorPro
EyeNetIE
FDM
FHscan
Fimap
Flunky
Foobot
Freeuploader
GT::WWW
Genieo
GermCrawler
GetRight
Gigabot
GoZilla
GrabNet
Grabber
Grafula
HEADMasterSEO
HMView
HTMLparser
HaosouSpider
Heritrix
HonoluluBot
HybridBot
IDBTE4M
Iblog
IlseBot
Image Fetch
InfoTekies
Internet Ninja
InternetSeer
Iria
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
JetCar
Jetty
Joomla
JustView
Kenjin Spider
Lanshanbot
Leap
LeechFTP
LeechGet
Libwhisker
Lightspeedsystems
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
MIIxpc
MQQBrowser
Majestic SEO
Majestic12
MarkMonitor
Mass Downloader
Mata Hari
MeanPath Bot
Microsoft Data Access
Moblie Safari
Musobot
NICErsPRO
NPbot
NearSite
NetAnts
NetMechanic
NetZIP
Netcraft
Netvibes
Nibbler
Nmap
Not
Nutch
Octopus
Offline Explorer
OnCrawl
OpenVAS
Openvas
OrangeBot
OrangeSpider
POE-Component-Client-HTTP
Page Analyzer
Panscient
Petalbot
PictureFinder
Pimonster
Pixray
PleaseCrawl
ProWebWalker
QueryN Metasearch
RSSingBot
Rankivabot
Re-re
ReGet
Reaper
Ripper
Rogerbot
SEOlyticsCrawler
SEOprofiler
SMTBot
ScanAlert
Scrapy
ScreenerBot
Searchestate
Seekport
Semrush
SemrushBot
SeobilityBot
Siphon
SiteSucker
Sitebeam
Snake
Snoopy
Sosospider
SpaceBison
SpankBot
Spanner
Spbot
Spinn3r
Sqlworm
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Swiftbot
Szukacz
T8Abot
Telesphoreo
Telesphorep
Toata
True_Robot
Turingos
TurnitinBot
Vagabondo
VeriCiteCrawler
VoidEYE
Voil
WASALive-Bot
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebFetch
WebSauger
WebStripper
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Whacker
Whatweb
Widow
Wonderbot
Woobot
Wprecon
Xaldon_WebSpider
Zauba
ZmEu
ZoominfoBot
ZyBorg
backlink-check
check1.exe
coccocbot
crawler.feedback
crawler4j
demandbase-bot
facebookscraper
gopher
heritrix
internetVista monitor
isitwp.com
iubenda-radar
magpie-crawler
page scorer
plumanalytics
ripz
satoristudio.net
seocompany.store
seoscanners
sitechecker.pro
siteripz
sogouspider
spyfu
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com