nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-02 22:07:27 +00:00

250 lines
2.6 KiB
Text

404enemy
ADmantX
AIBOT
ASPSeek
Aboundexbot
Acunetix
AiHitBot
Alexibot
Alligator
Anarchie
Anarchy
Anthill
Asterias
Atomseobot
BBBike
BDCbot
BLEXBot
BackWeb
Backlink-Ceck
Barkrowler
Battleztar Bazinga
Bitacle
Black Hole
Blow
BlowFish
Bolt
BuzzSumo
Cegbfeieh
Chlooe
Citoid
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Collector
Copyscape
Crawling at Home Project
Custo
DIIbot
Demon
Devil
DigitalPebble
Dirbuster
Disco
DnyzBot
DomCopBot
DomainCrawler
Dotbot
EMail Wolf
Ebingbong
EroCrawler
Exabot
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Ezooms
Flunky
Freeuploader
FrontPage
Genieo
Go!Zilla
GrabNet
Grabber
GrapeFX
GridBot
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
Havij
HybridBot
IDBot
Iblog
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
InterGET
InternetSeer
Iria
JamesBOT
Jbrofuzz
JennyBot
Kenjin Spider
Keybot Translation-Search-Machine
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
Leap
LeechFTP
LibWeb
Lightspeedsystems
LinkWalker
LinkpadBot
LinqiaRSSBot
Lipperhey
Litemage_walker
MIDown tool
MQQBrowser
MSIECrawler
MTRobot
Mag-Net
Majestic SEO
MarkWatch
Mata Hari
MauiBot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mojeek
MolokaiBot
Musobot
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
Needle
Net Vampire
NetAnts
Netcraft
Netvibes
Nibbler
NimbleCrawler
Nimbostratus
Octopus
Openfind
OutclicksBot
PHPCrawl
PageScorer
PageThing.com
Pandalytics
Petalbot
Pimonster
Pockey
ProPowerBot
ProWebWalker
Probethenet
Psbot
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot
Re-re
RebelMouse
RedesScrapy
RepoMonkey
SEOkicks
SEOlyticsCrawler
SEOprofiler
Scanbot
ScoutJet
ScreenerBot
ScrepyBot
Searchestate
SemanticJuice
Semrush
Seomoz
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Snoopy
Sociscraper
Sogou web spider
SpaceBison
SpankBot
Spanner
Spbot
SputnikBot
Sqworm
Stripper
Sucuri
SuperBot
Surfbot
T0PHackTeam
TeleportPro
Telesphorep
TheNomad
Titan
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
Typhoeus
URLy Warning
V-BOT
VB Project
Vacuum
Virusdie
Voltron
WBSearchBot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Enhancer
Web Pix
WebEnhancer
WebSucker
WebWhacker
Webshag
Website Quester
WinHTTrack
WiseGuys Robot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zermelo
Zeus
Zitebot
ZmEu
ZyBorg
arquivo-web-crawler
arquivo.pt
check1.exe
coccocbot
crawler.feedback
eCatch
facebookscraper
gopher
iubenda-radar
linkdexbot
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
plumanalytics
scan.lol
seocompany.store
serpstatbot
sexsearcher
siteripz
tAkeOut
trendiction.com
trendiction.de
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zauba.io