nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-08 10:07:11 +00:00

100 lines
1.1 KiB
Text

404checker
80legs
AiHitBot
AllSubmitter
BDFetch
BackStreet
Brandprotect
CSHttp
CensysInspect
Cogentbot
Disco
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
Dragonfly
Ebingbong
EirGrabber
EroCrawler
FDM
FlashGet
Foobot
GrapeFX
GrapeshotCrawler
Havij
Heritrix
Hloader
HonoluluBot
IDBTE4M
InfoNaviRobot
Jbrofuzz
Jyxobot
Libwhisker
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
MQQBrowser
Microsoft URL Control
Mozlila
NetAnts
Niki-bot
Nikto
Ninja
PECL::HTTP
PageGrabber
PageThing.com
Panscient
Pi-Monster
Piepmatz
ProWebWalker
RSSingBot
Reaper
RedesScrapy
ScanAlert
Searchestate
Seekport
SenutoBot
SeoSiteCheckup
Seomoz
Sitevigil
Sociscraper
Spinn3r
SputnikBot
Sqlworm
SuperBot
T8Abot
Telesphoreo
Toweyabot
Turnitin
VelenPublicWebCrawler
VidibleScraper
Virusdie
WEBDAV
Wallpapers/3.0
WeSEE
Web Enhancer
Web Fuck
Web Sauger
WebCopier
WebsiteQuester
WinHTTrack
Wonderbot
Woobot
Xaldon WebSpider
ZyBorg
autoemailspider
cah.io.community
check1.exe
facebookscraper
iubenda-radar
lwp-request
openai.com
s1z.ru
satoristudio.net
sitechecker.pro
sp_auditbot
ubermetrics-technologies.com
webmeup-crawler
webpros.com
xpymep1.exe