nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-11 10:09:18 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404checker
ASPSeek
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
AllSubmitter
Alligator
Anarchy
Anarchy99
Aspiegel
AwarioRssBot
BacklinkCrawler
Bigfoot
Black Hole
BlowFish
Boardreader
Buck
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CODE87
Calculon
CazoodleBot
Cegbfeieh
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Craftbot
CyotekWebCopy
DTS Agent
DatabaseDriverMysqli
Deusu
Disco
DomainCrawler
Domains Project
Download Wonder
Dragonfly
Drip
Ebingbong
Ecxi
EirGrabber
Evil
Extractor
ExtractorPro
Ezooms
FDM
FemtosearchBot
Firefox/7.0
Freeuploader
FrontPage
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
GrapeFX
HEADMasterSEO
HTMLparser
Harvest
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
Iblog
Id-search
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
Jbrofuzz
Jetty
Joomla
Jorgee
Kinza
LWP::Simple
Leap
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinksManager
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
MJ12bot
Mail.RU_Bot
Majestic12
MarkWatch
Mata Hari
MeanPath Bot
Metauri
Minefield
Mojolicious
MolokaiBot
Mr.4x3
Name Intelligence
Navroad
NearSite
NetLyzer
NetSpider
Nikto
Nimbostratus
Nuclei
Octopus
Offline Navigator
OpenLinkProfiler
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com
Pandalytics
Papa Foto
Pi-Monster
Pimonster
Pixray
PleaseCrawl
ProWebWalker
Probethenet
Psbot
Pu_iN
QueryN Metasearch
RSSingBot
RankActiveLinkBot
Rankivabot
RankurBot
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
SBIder
SEOkicks-Robot
SISTRIX
SalesIntelligent
ScanAlert
Scrapy
ScrepyBot
Searchestate
Seekport
SemrushBot
SeoSiteCheckup
Shodan
SlySearch
Snoopy
SocialRankIOBot
Sogou web spider
Sottopop
Spammen
Spbot
Sqlworm
Steeler
Sucker
SuperBot
Surfbot
T8Abot
TeleportPro
Telesoft
Telesphoreo
Telesphorep
Thumbor
Titan
Toweyabot
Trendiction
Trendictionbot
Typhoeus
URLy Warning
URLy.Warning
Upflow
Vacuum
VoidEYE
Voltron
WASALive-Bot
WEBDAV
Wallpapers/3.0
WallpapersHD
Web Enhancer
Web Pix
Web Sauger
WebBandit
WebImageCollector
WebPix
WebReaper
WebStripper
WebSucker
WebWhacker
WebZIP
Website Quester
WebsiteExtractor
Whack
Whacker
Whatweb
Who.is Bot
WiseGuys Robot
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Zeus
ZmEu
ZoomBot
ZoominfoBot
arquivo.pt
autoemailspider
coccocbot
cognitiveseo
com.plumanalytics
crawl.sogou.com
demandbase-bot
eCatch
magpie-crawler
mediawords
netEstate NE Crawler
page scorer
polaris version
ripz
s1z.ru
satoristudio.net
scalaj-http
seobility
spyfu
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
x09Mozilla
zauba.io
zgrab