nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-02-06 10:07:00 +00:00

100 lines
1 KiB
Text

01h4x.com
Aipbot
Alligator
Ankit
Asterias
BLEXBot
BackStreet
Badass
Barkrowler
BetaBot
BlowFish
Bolt
BunnySlippers
Bytespider
CopyRightCheck
Copyscape
CrazyWebCrawler
CrunchBot
DatabaseDriverMysqli
Dirbuster
DnBCrawler-Analytics
Dotbot
EirGrabber
EroCrawler
Freeuploader
GermCrawler
Go!Zilla
Havij
Hloader
IDBot
Iblog
JOC Web Spider
JennyBot
JetCar
Kenjin Spider
Kozmosbot
Leap
LinkextractorPro
LinqiaMetadataDownloaderBot
Ltx71
MJ12bot
Mag-Net
Magnet
Majestic SEO
Mass Downloader
MauiBot
MegaIndex.ru
NPbot
Needle
Nessus
Net Vampire
NetLyzer
Netcraft
Nuclei
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Pavuk
ProWebWalker
RankActiveLinkBot
RankingBot
Re-re
RedesScrapy
ScanAlert
ScreenerBot
SemanticJuice
SemrushBot
SentiBot
Seomoz
Siphon
Sitebeam
Siteimprove
Snake
Sqlmap
Sqlworm
Telesphoreo
TinyTestBot
URLy Warning
Voil
Web Pix
WebEnhancer
Webalta
Whack
Widow
WiseGuys Robot
Woobot
Wotbox
Wprecon
Zitebot
adscanner
cah.io.community
clark-crawler
dataforseobot
mediawords
netEstate NE Crawler
serpstatbot
sexsearcher
webpros.com
x09Mozilla