nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-30 22:07:14 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
AllSubmitter
AlphaBot
Anarchy99
Ankit
Asterias
BLEXBot
BackStreet
BacklinkCrawler
Badass
Battleztar Bazinga
Black Hole
Blow
Bolt
Brandprotect
Brandwatch
BuiltWith
CCBot
CODE87
CSHttp
CensysInspect
CheeseBot
Chlooe
Citoid
Cloud mapping
Cocolyzebot
Cogentbot
CopyRightCheck
Cosmos
Crescent
CrunchBot
Custo
DSearch
Disco
Dispatch
DittoSpyder
DomainStatsBot
Domains Project
Dotbot
Download Wonder
EasyDL
Ebingbong
EirGrabber
EroCrawler
Extractor
Extreme Picture Finder
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FrontPage
FyberSpider
GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeFX
GridBot
Haansoft
HaosouSpider
Harvest
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
IDBot
Iblog
Id-search
IlseBot
Image Fetch
IndeedBot
InfoNaviRobot
InterGET
Iria
Iskanie
JamesBOT
Jetty
Jorgee
JustView
Jyxobot
Kozmosbot
LeechFTP
LexiBot
Lightspeedsystems
Likse
LinksManager
LinqiaRSSBot
Lipperhey Spider
Ltx71
MIDown tool
MJ12bot
MSIECrawler
MTRobot
Majestic12
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Minefield
Mister PiX
Mojeek
Mojolicious
MolokaiBot
Mozlila
Name Intelligence
Navroad
Needle
Nessus
Net Vampire
NetLyzer
NextGenSearchBot
Nibbler
Nikto
Ninja
Nuclei
Nutch
Offline Explorer
OnCrawl
OpenLinkProfiler
OrangeBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Pandalytics
Panscient
Pi-Monster
Picsearch
Pockey
ProWebWalker
PxBroker
PyCurl
RSSingBot
RankFlex
Reaper
RedesScrapy
RocketCrawler
SEOlyticsCrawler
SEOprofiler
SalesIntelligent
ScoutJet
Scrapy
Screaming
Searchestate
Semrush
SemrushBot
SeoSiteCheckup
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Siteimprove
Sitevigil
Snapbot
SocialRankIOBot
Sogou web spider
SpankBot
Spinn3r
Sqworm
SuperBot
SurveyBot
Suzuran
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
TheNomad
TightTwatBot
Tracemyfile
Trendiction
Turnitin
TurnitinBot
Upflow
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WWW::Mechanize
WWWOFFLE
Web Collage
Web Fuck
WebCopier
WebEnhancer
WebFetch
WebFuck
WebReaper
WebSauger
WebWhacker
WebZIP
Webalta
Webshag
Website Quester
WebsiteQuester
Webster
Whacker
WinHTTrack
Woobot
Zauba
Zermelo
Zeus
ZoomBot
archive.org_bot
arquivo.pt
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
eCatch
facebookscraper
gopher
heritrix
internetVista monitor
ips-agent
isitwp.com
linkdexbot
lwp-request
page scorer
pcBrowser
probe-image-size
ripz
s1z.ru
scalaj-http
seostar
serpstatbot
spyfu
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webprosbot
x09Mozilla