nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-29 10:09:10 +00:00

250 lines
2.5 KiB
Text

404checker
404enemy
80legs
AIBOT
AiHitBot
Aipbot
Anarchy
Anarchy99
Apexoo
Attach
AwarioRssBot
BBBike
BDCbot
BDFetch
BLEXBot
BackDoorBot
Badass
Battleztar Bazinga
Bigfoot
Blackboard
BlowFish
Boardreader
Bolt
BotALot
Brandwatch
Buck
Buddy
BuiltWith
BunnySlippers
BuzzSumo
CSHttp
Calculon
CazoodleBot
CheTeam
Cocolyzebot
Collector
CopyRightCheck
Craftbot
CrazyWebCrawler
Crescent
CyotekWebCopy
DBLBot
DIIbot
DataCha0s
Deusu
Devil
DigitalPebble
Discobot
Dispatch
DomCopBot
Drip
EroCrawler
Extreme Picture Finder
FDM
Fimap
FlashGet
FyberSpider
GT::WWW
GalaxyBot
GermCrawler
GetRight
GetWeb
Gigabot
GoZilla
Gotit
Grabber
HTMLparser
HTTP::Lite
Haansoft
Harvest
Havij
Heritrix
Hloader
Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot
Id-search
InfoNaviRobot
InfoTekies
Intelliseek
Internet Ninja
JOC Web Spider
JetCar
Jorgee
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Lanshanbot
Leap
LeechGet
LexiBot
Libwhisker
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSFrontPage
Magnet
Majestic-SEO
Majestic12
MarkWatch
Masscan
MegaIndex.ru
Microsoft URL Control
Minefield
Mister PiX
MolokaiBot
Mr.4x3
NPbot
Name Intelligence
Nameprotect
NetSpider
Nettrack
Netvibes
Nibbler
Nimbostratus
OnCrawl
Openvas
PECL::HTTP
Page Analyzer
PageAnalyzer
PageScorer
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picscout
Piepmatz
ProPowerBot
ProWebWalker
Pu_iN
PyCurl
QueryN Metasearch
RankingBot
RankurBot
Re-re
ReGet
Recorder
Ripper
SEOkicks
SISTRIX
SMTBot
ScanAlert
ScoutJet
Searchestate
SemanticJuice
Shodan
Site Sucker
SiteExplorer
SiteSnagger
Sitebeam
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snake
SocialRankIOBot
Spammen
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
Stripper
Surfbot
SurveyBot
Szukacz
T8Abot
Teleport
Telesphorep
Toweyabot
Trendiction
Trendictionbot
True_Robot
Turnitin
Typhoeus
URLy.Warning
UnisterBot
V-BOT
VCI
Voil
Voltron
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WeSEE
Web Auto
Web Sauger
Web Sucker
WebCopier
WebEnhancer
WebLeacher
WebPix
WebSauger
WebStripper
WebWhacker
Webster
Whack
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
Xenu
Zauba
ZoominfoBot
adscanner
arquivo.pt
check1.exe
clark-crawler
cognitiveseo
crawl.sogou.com
crawler.feedback
facebookscraper
heritrix
instabid
isitwp.com
oBot
probe-image-size
ripz
s1z.ru
satoristudio.net
seoscanners
seostar
sogouspider
spyfu
sysscan
ubermetrics-technologies.com
webgains-bot
webprosbot
x09Mozilla
zauba.io
zgrab