nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-09 22:07:39 +00:00

250 lines
2.6 KiB
Text

AiHitBot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Asterias
Attach
BackStreet
BackWeb
Backlink-Ceck
Bandit
Black Hole
Blackboard
BlowFish
Boardreader
Buck
BuiltBotTough
BunnySlippers
CATExplorador
CCBot
CSHttp
CheTeam
ChinaClaw
Claritybot
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Copyscape
Craftbot
Crawling at Home Project
Crescent
CrunchBot
Curious
Custo
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
Disco
Discoverybot
DittoSpyder
DomainStatsBot
Download Wonder
Dragonfly
Drip
EMail Wolf
EasyDL
Ebingbong
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
Fimap
Freeuploader
FyberSpider
GT::WWW
Genieo
GermCrawler
GrabNet
Grabber
Grafula
GrapeshotCrawler
HMView
HTMLparser
HTTrack
Haansoft
Harvest
Hloader
Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot
Image Fetch
Indy Library
Internet Ninja
InternetSeer
Iria
JennyBot
JetCar
Jetty
JikeSpider
JustView
Kenjin Spider
Kozmosbot
Lanshanbot
Larbin
Leap
LeechFTP
Libwhisker
LieBaoFast
Likse
LinkScan
LinksManager
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler
Magnet
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mb2345Browser
MegaIndex.ru
Minefield
Moblie Safari
Mojeek
Mr.4x3
Musobot
NPbot
Nameprotect
NearSite
NetLyzer
Netvibes
NextGenSearchBot
Niki-bot
Ninja
Octopus
OpenLinkProfiler
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
PageScorer
PageThing.com
Pandalytics
Panscient
Petalbot
Pixray
PleaseCrawl
Pockey
Pump
PxBroker
QueryN Metasearch
Rankivabot
ReGet
RealDownload
Reaper
RebelMouse
Rogerbot
SBIder
SEOstats
ScanAlert
Scanbot
Scrapy
ScrepyBot
Searchestate
Semrush
SentiBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SlySearch
SmartDownload
Sociscraper
Sogou web spider
Spammen
Spanner
SputnikBot
Steeler
Stripper
Sucuri
SuperHTTP
Swiftbot
T0PHackTeam
Telesphoreo
Telesphorep
The Intraformant
Thumbor
Toweyabot
Trendictionbot
Turingos
Turnitin
Twice
UnisterBot
VeriCiteCrawler
VidibleScraper
Voil
WEBDAV
WPScan
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Enhancer
Web Fetch
Web Pix
Web Sauger
WebAuto
WebBandit
WebCollage
WebEnhancer
WebFetch
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
YoudaoBot
ZmEu
ZoomBot
ZyBorg
check1.exe
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
facebookscraper
heritrix
iubenda-radar
linkdexbot
magpie-crawler
oBot
ripz
scalaj-http
seoscanners
seostar
serpstatbot
siteripz
sogouspider
spyfu
sysscan
tAkeOut
x22Mozilla
zauba.io
zgrab