nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-19 10:07:22 +00:00

100 lines
1.2 KiB
Text

Alexibot
Apexoo
Atomseobot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Badass
Battleztar Bazinga
BlackWidow
Blackboard
Brandprotect
ChinaClaw
Cogentbot
Copier
CrunchBot
Domains Project
Drip
Ebingbong
Ecxi
ExtractorPro
Extreme Picture Finder
Firefox/7.0
Freeuploader
Genieo
Getintent
Go!Zilla
GrapeFX
GrapeshotCrawler
Harvest
Havij
Hloader
IDBTE4M
Information Security Team InfraSec Scanner
Internet Ninja
Iskanie
IstellaBot
JikeSpider
Kozmosbot
Lanshanbot
Likse
LinqiaMetadataDownloaderBot
Litemage_walker
MSFrontPage
Mb2345Browser
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
NPbot
Name Intelligence
Netvibes
OpenLinkProfiler
OrangeBot
OutclicksBot
POE-Component-Client-HTTP
Pandalytics
RankActiveLinkBot
SMTBot
SalesIntelligent
ScanAlert
Scrapy
SentiBot
Shodan
Snoopy
Sogou web spider
Sosospider
Spbot
Spider_Bot/3.0
Suzuran
TurnitinBot
TwengaBot
Upflow
VCI
VelenPublicWebCrawler
WPScan
Web Fetch
Web Pix
Web Sucker
WebGo IS
WebImageCollector
WebSucker
WebWhacker
Webalta
WebsiteQuester
Who.is Bot
Xaldon WebSpider
Zade
Zeus
ZoomBot
archive.org_bot
arquivo-web-crawler
autoemailspider
cognitiveseo
crawl.sogou.com
heritrix
isitwp.com
meanpathbot
muhstik-scan
s1z.ru
seocompany.store
sitechecker.pro