nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-15 10:09:06 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
AIBOT
ALittle Client
Abonti
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Anthill
Atomseobot
BDCbot
BDFetch
BackWeb
BacklinkCrawler
Bandit
Bigfoot
Blackboard
Boardreader
Bolt
Bullseye
BunnySlippers
Chlooe
CopyRightCheck
Copyscape
Crawling at Home Project
CrunchBot
Curious
Custo
DBLBot
DIIbot
Demon
Deusu
Digincore
DigitalPebble
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainStatsBot
Download Wonder
EMail Wolf
EasyDL
Ecxi
EroCrawler
Exabot
Express WebPictures
EyeNetIE
Fimap
Foobot
Freeuploader
FrontPage
FyberSpider
GT::WWW
GermCrawler
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
GrapeFX
HEADMasterSEO
HTMLparser
HTTrack
Heritrix
Humanlinks
IRLbot
IlseBot
IndeedBot
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
Iria
Iskanie
IstellaBot
JennyBot
JetCar
Jetty
JikeSpider
Jorgee
Kenjin Spider
LNSpiderguy
Leap
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MIDown tool
MTRobot
Mag-Net
Majestic SEO
Majestic12
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Mister PiX
MolokaiBot
NICErsPRO
NPbot
Name Intelligence
Navroad
NearSite
NetMechanic
NetZIP
Netcraft
NextGenSearchBot
Nikto
Nimbostratus
Not
Nuclei
Nutch
Offline Navigator
Openfind
Openvas
OrangeSpider
PageScorer
Pandalytics
PeoplePal
Petalbot
Pi-Monster
PictureFinder
Piepmatz
Pixray
ProPowerBot
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Re-re
Reaper
RedesScrapy
Ripper
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOprofiler
SMTBot
Scanbot
ScreenerBot
Searchestate
SearchmetricsBot
SemanticJuice
SentiBot
Seomoz
Shodan
SiteSucker
Siteimprove
SlySearch
SmartDownload
Snoopy
Sogou web spider
Sosospider
Spammen
Spinn3r
SputnikBot
Sqlmap
Sqworm
Stripper
SuperBot
Surfbot
Suzuran
Szukacz
TeleportPro
Telesoft
Telesphoreo
Telesphorep
TheNomad
Thumbor
Trendiction
Turingos
TurnitinBot
TwengaBot
UnisterBot
Upflow
V-BOT
Vagabondo
Voil
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
Wallpapers/3.0
WeSEE
Web Auto
Web Pix
Web Sauger
Web Sucker
WebCollage
WebFuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
Webshag
Whack
Who.is Bot
Wprecon
Zade
Zauba
Zermelo
Zitebot
ZumBot
ZyBorg
arquivo-web-crawler
cah.io.community
cognitiveseo
crawl.sogou.com
demandbase-bot
eCatch
heritrix
instabid
lwp-trivial
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
plumanalytics
satoristudio.net
seobility
seocompany.store
serpstatbot
siteripz
sysscan
webgains-bot
webmeup-crawler
x09Mozilla
xpymep1.exe
zauba.io
zgrab