nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-14 10:09:34 +00:00

250 lines
2.6 KiB
Text

404checker
80legs
ASPSeek
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alligator
AlphaBot
Anarchy99
Ankit
Aspiegel
Asterias
Atomseobot
BBBike
BDFetch
BLEXBot
BackDoorBot
BacklinkCrawler
Bandit
BatchFTP
Battleztar Bazinga
Bitacle
BlackWidow
Blackboard
Blow
Bolt
BotALot
Brandwatch
Bullseye
BunnySlippers
Calculon
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Copyscape
Cosmos
Curious
Custo
DBLBot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
DigitalPebble
Disco
Dispatch
DnyzBot
DomCopBot
Domains Project
Dotbot
Download Wonder
Drip
ECCP/1.0
Ebingbong
Ecxi
Express WebPictures
Ezooms
FemtosearchBot
Firefox/7.0
FlashGet
GetRight
Gotit
GrapeFX
GrapeshotCrawler
GridBot
HTTP::Lite
HTTrack
HaosouSpider
IDBTE4M
IDBot
Image Fetch
Image Sucker
IndeedBot
InterGET
JamesBOT
Jbrofuzz
JennyBot
Jetty
Jorgee
JustView
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LeechGet
Likse
LinkWalker
Linkbot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MJ12bot
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Majestic SEO
MauiBot
MeanPath Bot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mozlila
Musobot
NICErsPRO
NPbot
Navroad
Needle
NetZIP
Nettrack
NextGenSearchBot
NimbleCrawler
Ninja
Nmap
Not
Offline Explorer
Offline Navigator
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
Pandalytics
Panscient
Papa Foto
Pavuk
PeoplePal
Picsearch
PictureFinder
Piepmatz
Pu_iN
Pump
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
ReGet
RebelMouse
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SEOlyticsCrawler
SISTRIX
SMTBot
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Sitebeam
Sociscraper
Sogou web spider
Sosospider
Sottopop
Spanner
Spbot
Spinn3r
Sqlmap
Sucuri
SuperHTTP
Szukacz
Teleport
TeleportPro
Thumbor
TightTwatBot
Tracemyfile
Trendictionbot
Turnitin
Twice
V-BOT
VB Project
VidibleScraper
VoidEYE
Voil
WBSearchBot
WEBDAV
WWW-Mechanize
Wallpapers/3.0
Web Auto
Web Collage
Web Enhancer
Web Sucker
WebAuto
WebCopier
WebFetch
WebFuck
WebGo IS
WebReaper
WebStripper
Webalta
WebmasterWorldForumBot
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zeus
ZoomBot
adscanner
archive.org_bot
autoemailspider
backlink-check
cah.io.community
demandbase-bot
evc-batch
gopher
iubenda-radar
lwp-trivial
magpie-crawler
mediawords
page scorer
probe-image-size
ripz
scan.lol
seoscanners
sp_auditbot
spyfu
trendiction.com
trendiction.de
voyagerx.com
webgains-bot
webpros.com
zgrab