nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-20 22:05:04 +00:00

100 lines
1 KiB
Text

ADmantX
Aipbot
Alligator
AlphaBot
Anarchie
Ankit
Aspiegel
Atomseobot
BacklinkCrawler
Battleztar Bazinga
Buck
BuiltBotTough
Bytespider
CheTeam
Cloud mapping
Custo
CyotekWebCopy
DSearch
Digincore
DigitalPebble
Disco
DomainStatsBot
Drip
EroCrawler
Ezooms
Gigabot
Gotit
GrapeFX
GrapeshotCrawler
Haansoft
Heritrix
Iblog
IlseBot
Internet Ninja
Jetty
Jorgee
LinqiaRSSBot
MFC_Tear_Sample
MTRobot
Majestic12
Mata Hari
Moblie Safari
NPbot
Netvibes
Nutch
Octopus
PageAnalyzer
Panscient
Pavuk
PictureFinder
Proximic
RankActive
RankFlex
RankingBot2
Rankivabot
RealDownload
Recorder
Ripper
RocketCrawler
SEOkicks
Scanbot
Searchestate
SemrushBot
SenutoBot
Seomoz
Site Sucker
Sociscraper
Sogou web spider
SpaceBison
SpankBot
Spbot
Sucker
Swiftbot
Szukacz
Toata
Tracemyfile
TwengaBot
Vagabondo
VeriCiteCrawler
WASALive-Bot
WWWOFFLE
WallpapersHD
Web Auto
Web Sucker
WebFuck
WebSauger
WebZIP
Wonderbot
Xaldon WebSpider
crawler.feedback
demandbase-bot
gopher
internetVista monitor
muhstik-scan
ripz
s1z.ru
sp_auditbot
webgains-bot
xpymep1.exe
zauba.io