nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-21 10:09:33 +00:00

250 lines
2.5 KiB
Text

360Spider
80legs
Abonti
Aboundexbot
Acunetix
AiHitBot
Aipbot
Anarchy
Ankit
Apexoo
Aspiegel
AwarioSmartBot
BBBike
BDCbot
BDFetch
BLEXBot
BacklinkCrawler
Barkrowler
Battleztar Bazinga
Bitacle
Black Hole
BlackWidow
BlowFish
BuiltBotTough
BuzzSumo
CCBot
CODE87
CSHttp
Calculon
CensysInspect
CherryPicker
Chlooe
Citoid
Claritybot
Cloud mapping
Collector
Copier
Copyscape
Crawling at Home Project
CrazyWebCrawler
CrunchBot
DSearch
DTS Agent
Disco
Discobot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
Dragonfly
EMail Wolf
EasyDL
Ecxi
Evil
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
Fimap
Firefox/7.0
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
GalaxyBot
GetWeb
Gigabot
GoZilla
GrapeshotCrawler
HEADMasterSEO
HMView
Haansoft
Havij
Heritrix
IRLbot
Iblog
Id-search
IlseBot
Image Fetch
InfoNaviRobot
Intelliseek
Iria
Iskanie
IstellaBot
JOC Web Spider
Kozmosbot
LWP::Simple
Lanshanbot
Leap
LeechFTP
Lftp
Libwhisker
LinksManager
Lipperhey Spider
Lmspider
Ltx71
MSFrontPage
Mag-Net
Magnet
Majestic-SEO
MarkMonitor
MarkWatch
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Minefield
MolokaiBot
Mozlila
Msrabot
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
Needle
Net Vampire
NetSpider
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Nmap
Not
Openvas
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageThing.com
Pavuk
Picscout
PictureFinder
Pixray
ProWebWalker
Psbot
Pu_iN
Pump
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankurBot
RealDownload
RebelMouse
Recorder
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks
SISTRIX
ScanAlert
Scanbot
ScoutJet
Searchestate
Seekport
SemanticJuice
Seomoz
Siphon
SiteLockSpider
Sitevigil
SlySearch
Snapbot
Sosospider
SpaceBison
Spanner
SputnikBot
Sqlmap
Sqworm
Stripper
Sucuri
Surfbot
SurveyBot
Szukacz
TeleportPro
Tracemyfile
Trendictionbot
Turnitin
TwengaBot
Upflow
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
VoidEYE
Voltron
WBSearchBot
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Collage
Web Enhancer
Web Sauger
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebFetch
WebStripper
WebWhacker
Webshag
WebsiteExtractor
Whack
Whatweb
Who.is Bot
WiseGuys Robot
Wonderbot
Wotbox
Xaldon_WebSpider
Xenu
Zauba
Zitebot
ZmEu
ZoomBot
ZumBot
arquivo-web-crawler
backlink-check
cognitiveseo
crawler4j
demandbase-bot
eCatch
gopher
instabid
isitwp.com
linkdexbot
meanpathbot
oBot
plumanalytics
probe-image-size
ripz
seocompany.store
seoscanners
seostar
sitechecker.pro
sogouspider
spyfu
trendiction.de
voyagerx.com
webgains-bot
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe