nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-16 10:09:14 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
AIBOT
ALittle Client
Aipbot
AllSubmitter
Alligator
Anarchy99
Anthill
Apexoo
Aspiegel
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BLEXBot
Backlink-Ceck
Bandit
Barkrowler
Battleztar Bazinga
Bigfoot
Black Hole
BlackWidow
Blackboard
Bolt
BotALot
Brandprotect
Buck
BuiltBotTough
BunnySlippers
CCBot
CODE87
Calculon
CazoodleBot
CensysInspect
CheTeam
ChinaClaw
Cliqzbot
Cogentbot
Copier
CopyRightCheck
Cosmos
Curious
DSearch
DataCha0s
Digincore
DigitalPebble
Dirbuster
Discobot
Dispatch
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
Dragonfly
EMail Siphon
EMail Wolf
EirGrabber
EroCrawler
Extreme Picture Finder
EyeNetIE
Firefox/7.0
FlashGet
Flunky
Freeuploader
G-i-g-a-b-o-t
GetRight
Go!Zilla
Grabber
GridBot
HTTP::Lite
HonoluluBot
IDBTE4M
IDBot
Id-search
Image Sucker
InfoNaviRobot
InterGET
Internet Ninja
Iria
Jetty
JikeSpider
Joomla
JustView
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
LieBaoFast
LinkScan
LinkextractorPro
LinkpadBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MTRobot
Mail.RU_Bot
MauiBot
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Mojolicious
Mozlila
Msrabot
Musobot
NPbot
Nameprotect
Net Vampire
Nettrack
Nibbler
Niki-bot
Nikto
Ninja
Not
Nutch
Offline Explorer
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
Pavuk
Pi-Monster
ProPowerBot
ProWebWalker
Pu_iN
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankingBot
Rankivabot
RankurBot
Re-re
ReGet
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
ScanAlert
Seekport
SemanticJuice
Semrush
Seomoz
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Sitevigil
SlySearch
Snoopy
SpaceBison
Spammen
Spbot
Sqlmap
Stripper
Sucuri
Surfbot
Szukacz
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphorep
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
Twice
Typhoeus
URLy.Warning
Upflow
VB Project
VCI
Voil
Voltron
WEBDAV
WWW-Collector-E
WWW::Mechanize
Wallpapers
WeSEE
Web Auto
Web Enhancer
Web Pix
Web Sucker
WebCollage
WebImageCollector
WebSauger
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Whack
Whacker
WinHTTrack
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zermelo
Zitebot
ZoomBot
ZoominfoBot
ZumBot
arquivo-web-crawler
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
demandbase-bot
domainsproject.org
eCatch
facebookscraper
internetVista monitor
ips-agent
isitwp.com
polaris version
ripz
s1z.ru
scalaj-http
scan.lol
seocompany.store
seostar
sexsearcher
sogouspider
spyfu
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webprosbot
zgrab