nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-01 10:07:18 +00:00

100 lines
1.1 KiB
Text

Aboundexbot
Alexibot
Ankit
Apexoo
AwarioSmartBot
Battleztar Bazinga
Blow
BuiltWith
CODE87
CSHttp
Collector
CopyRightCheck
Crawling at Home Project
Crescent
Custo
Demon
Disco
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Dotbot
ECCP/1.0
EroCrawler
GetRight
Go!Zilla
HMView
Humanlinks
IDBTE4M
InfoTekies
InterGET
Jetty
Larbin
LibWeb
Lightspeedsystems
LinkpadBot
Lipperhey
MFC_Tear_Sample
MSIECrawler
Mb2345Browser
MicroMessenger
Msrabot
Musobot
Net Vampire
Netvibes
NextGenSearchBot
Openvas
Pimonster
Probethenet
Psbot
PxBroker
Quick-Crawler
RankingBot
RankurBot
Re-re
ReGet
Recorder
SMTBot
SalesIntelligent
Scanbot
Scrapy
Seekport
SeekportBot
Shodan
SiteLockSpider
Sottopop
SpankBot
Spbot
Sucuri
SurveyBot
Szukacz
T0PHackTeam
T8Abot
True_Robot
TurnitinBot
URLy Warning
UnisterBot
WASALive-Bot
WWW-Mechanize
Web Enhancer
WebFuck
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Xenu
YoudaoBot
Zitebot
archive.org_bot
arquivo.pt
dataforseobot
instabid
isitwp.com
lwp-trivial
muhstik-scan
netEstate NE Crawler
satoristudio.net
seocompany.store
sexsearcher
webgains-bot