nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-08 22:07:02 +00:00

250 lines
2.6 KiB
Text

404enemy
AIBOT
ASPSeek
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Anarchy
Ankit
Anthill
Apexoo
Aspiegel
AwarioRssBot
AwarioSmartBot
BDFetch
BackStreet
BacklinkCrawler
Bandit
BatchFTP
Bigfoot
Bitacle
Blow
Boardreader
Bolt
BotALot
Brandwatch
Buck
BuiltBotTough
Bullseye
Calculon
CensysInspect
CheTeam
CherryPicker
Citoid
Claritybot
Cloud mapping
Cogentbot
Collector
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
CrunchBot
Curious
Custo
CyotekWebCopy
DTS Agent
DatabaseDriverMysqli
Deusu
DigitalPebble
Discobot
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
Dotbot
Download Wonder
Drip
EMail Siphon
EasyDL
Ebingbong
EirGrabber
Express WebPictures
Extractor
Ezooms
FHscan
Fimap
Firefox/7.0
Foobot
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GetWeb
Gotit
GrabNet
GridBot
HMView
HaosouSpider
Heritrix
Humanlinks
HybridBot
IDBTE4M
IRLbot
Iblog
IlseBot
IndeedBot
Indy Library
InfoTekies
Internet Ninja
InternetSeer
JOC Web Spider
JamesBOT
Jetty
Joomla
LNSpiderguy
LWP::Simple
LeechFTP
LeechGet
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
LinkWalker
LinqiaRSSBot
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Masscan
Mata Hari
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Musobot
Navroad
Needle
NetAnts
NetLyzer
Nettrack
Netvibes
Nikto
Nimbostratus
Ninja
OpenLinkProfiler
OpenVAS
OrangeBot
OutclicksBot
POE-Component-Client-HTTP
PageGrabber
PageThing.com
Pandalytics
Panscient
PeoplePal
Picsearch
PictureFinder
Pimonster
PleaseCrawl
Pu_iN
RankingBot
RankurBot
Re-re
ReGet
RealDownload
RebelMouse
Recorder
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
Scrapy
SemrushBot
SeobilityBot
Seomoz
Shodan
Siphon
SiteCheckerBotCrawler
Sitevigil
SlySearch
SmartDownload
Sociscraper
Sogou web spider
SpankBot
Sqworm
SuperHTTP
Suzuran
TightTwatBot
Titan
Toweyabot
True_Robot
Turingos
Turnitin
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
Vacuum
Virusdie
Voltron
WBSearchBot
WEBDAV
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCopier
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebLeacher
WebReaper
WebSucker
Webalta
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Xaldon WebSpider
Xaldon_WebSpider
Zermelo
Zeus
ZmEu
ZoominfoBot
ZyBorg
adscanner
clark-crawler
crawl.sogou.com
dataforseo.com
facebookscraper
heritrix
internetVista monitor
ips-agent
linkdexbot
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
pcBrowser
probe-image-size
satoristudio.net
seobility
seoscanners
serpstatbot
siteripz
sysscan
trendiction.com
webgains-bot