nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-04-26 10:07:26 +00:00

100 lines
1 KiB
Text

360Spider
404enemy
AIBOT
Abonti
Anarchy99
Bigfoot
Bitacle
Boardreader
Buck
ChinaClaw
Curious
Custo
DBLBot
DIIbot
DSearch
DTS Agent
Deusu
Discoverybot
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender
Exabot
EyeNetIE
FDM
Firefox/7.0
Gotit
Grabber
GrapeFX
HTTrack
Hloader
IndeedBot
Internet Ninja
Jorgee
Keyword Density
Lanshanbot
LeechGet
LibWeb
LinkScan
Linkbot
Lipperhey
MFC_Tear_Sample
MSFrontPage
MSIECrawler
Minefield
Mister PiX
Mojeek
NearSite
Nessus
NimbleCrawler
Nmap
Octopus
OnCrawl
OutclicksBot
PageThing.com
PictureFinder
ProWebWalker
QueryN Metasearch
RankFlex
Reaper
RepoMonkey
Rogerbot
SEOkicks-Robot
SalesIntelligent
ScanAlert
Scanbot
SearchmetricsBot
SemanticJuice
Seomoz
SmartDownload
Snake
Snoopy
Spammen
SuperBot
Teleport
Toweyabot
Trendiction
VoidEYE
Wallpapers/3.0
Web Pix
Web Sauger
WebBandit
WebCollage
WebLeacher
WebReaper
WebSauger
WebWhacker
WebZIP
Website Quester
WebsiteQuester
Xaldon_WebSpider
Zermelo
arquivo.pt
cognitiveseo
demandbase-bot
domainsproject.org
ips-agent
plumanalytics
sitechecker.pro
sogouspider