nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-08 22:07:24 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AIBOT
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy
Asterias
AwarioRssBot
AwarioSmartBot
BLEXBot
Backlink-Ceck
BacklinkCrawler
Badass
BatchFTP
Bitacle
Black Hole
Blackboard
Blow
Buck
BuiltWith
CSHttp
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Cocolyzebot
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
Deusu
DigitalPebble
Disco
Discobot
Dispatch
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Domains Project
Drip
ECCP/1.0
EirGrabber
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
FDM
FHscan
FemtosearchBot
Firefox/7.0
Flunky
G-i-g-a-b-o-t
Genieo
GetRight
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
HTTrack
HaosouSpider
Heritrix
HonoluluBot
HybridBot
IRLbot
Image Fetch
InfoTekies
InterGET
Internet Ninja
InternetSeer
JOC Web Spider
Jbrofuzz
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Leap
LexiBot
Lightspeedsystems
LinkextractorPro
MIDown tool
MJ12bot
MQQBrowser
MSIECrawler
Magnet
Majestic SEO
Majestic12
MarkWatch
Mass Downloader
Mata Hari
MeanPath Bot
Microsoft URL Control
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
NPbot
Name Intelligence
Navroad
Net Vampire
NetAnts
Netcraft
Nettrack
Netvibes
Nibbler
Nikto
Nimbostratus
Not
Nutch
Octopus
Offline Explorer
OpenVAS
Openfind
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
PageThing.com
Pandalytics
PeoplePal
Petalbot
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
Pockey
Pu_iN
Pump
Quick-Crawler
RankFlex
RankingBot2
ReGet
RealDownload
Reaper
Recorder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
Scanbot
Scrapy
Screaming
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Seomoz
SiteCheckerBotCrawler
SiteSnagger
SmartDownload
Snake
Snapbot
Snoopy
Sociscraper
Sogou web spider
Sosospider
Spammen
Spbot
Sqworm
Steeler
Stripper
Sucker
Swiftbot
T0PHackTeam
T8Abot
Telesphorep
The Intraformant
Toata
Toweyabot
True_Robot
Turnitin
TwengaBot
Typhoeus
Upflow
V-BOT
Vagabondo
Virusdie
Voltron
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Fuck
WebCollage
WebCopier
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
WebSucker
WebWhacker
Whack
Whatweb
Widow
WiseGuys Robot
Woobot
Wotbox
Wprecon
Xaldon WebSpider
Zermelo
ZoomBot
arquivo.pt
autoemailspider
backlink-check
crawl.sogou.com
crawler4j
demandbase-bot
eCatch
gopher
heritrix
ips-agent
iubenda-radar
linkdexbot
lwp-request
meanpathbot
oBot
page scorer
plumanalytics
seostar
sysscan
tAkeOut
trendiction.de
webgains-bot
webmeup-crawler
xpymep1.exe
zauba.io