nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-12 10:09:31 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ALittle Client
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
AlphaBot
Anarchy
Ankit
Asterias
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackStreet
Bandit
BatchFTP
Battleztar Bazinga
Black Hole
BlackWidow
BlowFish
Boardreader
Brandwatch
Buck
Buddy
BuzzSumo
CATExplorador
CCBot
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Chlooe
Citoid
Cloud mapping
Copier
CrunchBot
DSearch
Digincore
DigitalPebble
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Dragonfly
Drip
EMail Siphon
Ecxi
EirGrabber
ExtLinksBot
Extreme Picture Finder
FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
FrontPage
FyberSpider
G-i-g-a-b-o-t
GermCrawler
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
Grafula
HMView
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Havij
Hloader
HonoluluBot
Humanlinks
HybridBot
Iblog
Image Fetch
Image Sucker
InfoNaviRobot
InfoTekies
Intelliseek
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
Jorgee
Kenjin Spider
Keybot Translation-Search-Machine
LWP::Simple
Lanshanbot
Leap
LexiBot
Lftp
LinkWalker
Linkbot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MQQBrowser
Mag-Net
Magnet
MarkWatch
Mass Downloader
Masscan
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Moblie Safari
MolokaiBot
NPbot
NetZIP
Niki-bot
Nimbostratus
Ninja
Not
Octopus
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeSpider
PECL::HTTP
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
Papa Foto
PeoplePal
Petalbot
PictureFinder
ProWebWalker
Psbot
Pu_iN
PyCurl
RSSingBot
RankActive
Rankivabot
RankurBot
ReGet
RealDownload
RepoMonkey
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
SMTBot
ScanAlert
Scanbot
ScoutJet
ScreenerBot
ScrepyBot
SearchmetricsBot
Seekport
SeobilityBot
Seomoz
Snapbot
SpaceBison
Spanner
Spbot
Sqlworm
Sqworm
Steeler
SuperBot
Surfbot
TeleportPro
Telesoft
Trendiction
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Twice
URLy Warning
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WBSearchBot
WPScan
WWW::Mechanize
Wallpapers
Web Auto
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebCollage
WebCopier
WebEnhancer
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteQuester
Webster
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Zeus
ZumBot
ZyBorg
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
com.plumanalytics
crawl.sogou.com
demandbase-bot
gopher
heritrix
internetVista monitor
ips-agent
iubenda-radar
linkdexbot
meanpathbot
netEstate NE Crawler
pcBrowser
polaris version
s1z.ru
scan.lol
seobility
seostar
sogouspider
sp_auditbot
trendiction.com
trendiction.de
ubermetrics-technologies.com
webgains-bot
x22Mozilla
zauba.io