nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-05 22:07:13 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
AIBOT
ALittle Client
ASPSeek
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator
AlphaBot
Anarchy99
Anthill
Aspiegel
Asterias
Attach
BBBike
BackStreet
Backlink-Ceck
Barkrowler
BlowFish
Bolt
BotALot
Brandwatch
BuiltWith
CheTeam
CheeseBot
ChinaClaw
Chlooe
Citoid
Cocolyzebot
Craftbot
CrazyWebCrawler
Curious
Custo
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Digincore
Disco
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainStatsBot
Download Wonder
EasyDL
Ecxi
EirGrabber
ExtLinksBot
Extractor
EyeNetIE
FDM
Fimap
Flunky
Foobot
FrontPage
FyberSpider
Fyrebot
GetRight
Gigabot
GoZilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Heritrix
Hloader
HybridBot
IRLbot
Iblog
IlseBot
Image Fetch
IndeedBot
InterGET
Jbrofuzz
JetCar
Jetty
Keyword Density
Kozmosbot
LNSpiderguy
LeechFTP
LibWeb
Lightspeedsystems
Likse
LinkScan
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MSFrontPage
MSIECrawler
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Mass Downloader
Masscan
Mata Hari
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mojeek
Mr.4x3
Musobot
NICErsPRO
NPbot
Nameprotect
Needle
Net Vampire
NetAnts
NetMechanic
NetSpider
NetZIP
Netcraft
Nettrack
NimbleCrawler
Nutch
Offline Explorer
Openvas
OrangeSpider
PageGrabber
PageScorer
Panscient
Petalbot
Picscout
Piepmatz
Pu_iN
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankingBot
Re-re
ReGet
Reaper
RedesScrapy
Rogerbot
SBIder
SEOkicks
SEOstats
SMTBot
SalesIntelligent
Scanbot
SearchmetricsBot
SemanticJuice
SemrushBot
SeoSiteCheckup
Shodan
Site Sucker
SiteSnagger
SmartDownload
SocialRankIOBot
Sogou web spider
Sosospider
Spbot
Steeler
Stripper
Sucker
SuperBot
Surfbot
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Toata
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Virusdie
VoidEYE
Voil
Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebGo IS
WebLeacher
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Whacker
WiseGuys Robot
Wonderbot
Wotbox
Xaldon WebSpider
Zeus
Zitebot
ZoominfoBot
ZyBorg
adscanner
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
cah.io.community
check1.exe
com.plumanalytics
dataforseo.com
eCatch
evc-batch
heritrix
ips-agent
lwp-request
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
plumanalytics
ripz
scalaj-http
seobility
seocompany.store
sexsearcher
trendiction.com
webgains-bot
webmeup-crawler
webprosbot
zauba.io