nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-02 22:07:09 +00:00

250 lines
2.6 KiB
Text

404checker
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Alexibot
AlphaBot
Anarchie
Anarchy
Apexoo
Attach
AwarioRssBot
BBBike
BLEXBot
BackDoorBot
Backlink-Ceck
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Blackboard
Boardreader
Bolt
Buck
Buddy
Bullseye
BunnySlippers
BuzzSumo
CCBot
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Copier
Cosmos
Crescent
CrunchBot
Curious
DIIbot
DataCha0s
Demon
Dirbuster
Discobot
Discoverybot
DittoSpyder
DomainAppender
DomainCrawler
Dotbot
EMail Wolf
EroCrawler
Express WebPictures
Ezooms
FDM
FemtosearchBot
Fimap
FlashGet
Flunky
Foobot
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
GetWeb
Go!Zilla
GoZilla
GrabNet
Grafula
GrapeshotCrawler
HTMLparser
HTTrack
HaosouSpider
HonoluluBot
Humanlinks
HybridBot
IRLbot
Iblog
Id-search
InterGET
Iskanie
IstellaBot
Jbrofuzz
JetCar
Jetty
JustView
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LexiBot
LibWeb
Libwhisker
Likse
LinkextractorPro
LinksManager
Lipperhey
Litemage_walker
MIIxpc
MJ12bot
Magnet
Majestic SEO
Majestic12
MarkMonitor
Mass Downloader
Masscan
Mb2345Browser
Metauri
Mojeek
MolokaiBot
Msrabot
NPbot
Name Intelligence
Navroad
Needle
Nessus
NetSpider
Netcraft
Nettrack
Nibbler
NimbleCrawler
Nimbostratus
Nutch
Offline Explorer
OnCrawl
OpenVAS
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Pandalytics
Panscient
Papa Foto
Petalbot
Picsearch
PictureFinder
Piepmatz
ProWebWalker
Probethenet
Pu_iN
Pump
QueryN Metasearch
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
RebelMouse
RepoMonkey
SEOkicks-Robot
SEOprofiler
SISTRIX
Screaming
ScreenerBot
ScrepyBot
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Siteimprove
SlySearch
SmartDownload
Snake
Sogou web spider
Sosospider
Sottopop
Spammen
SputnikBot
Sqlworm
Sqworm
Steeler
Suzuran
Teleport
Telesphoreo
The Intraformant
Toweyabot
Trendiction
Trendictionbot
Turnitin
TwengaBot
Twice
URLy.Warning
VB Project
Voltron
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Web Auto
Web Fetch
Web Fuck
WebFetch
WebFuck
WebGo IS
WebReaper
WebSucker
WebmasterWorldForumBot
Whack
WinHTTrack
Woobot
Xaldon WebSpider
Xaldon_WebSpider
Zeus
Zitebot
ZmEu
ZumBot
ZyBorg
arquivo-web-crawler
check1.exe
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
gopher
ips-agent
iubenda-radar
lwp-trivial
mediawords
probe-image-size
s1z.ru
seobility
seostar
sexsearcher
spyfu
tAkeOut
trendiction.com
trendiction.de
webgains-bot
webpros.com
xpymep1.exe