nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-01-25 22:07:56 +00:00

100 lines
1.1 KiB
Text

Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
Boardreader
Buddy
CazoodleBot
CopyRightCheck
Crawling at Home Project
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainCrawler
EMail Siphon
Express WebPictures
Ezooms
FrontPage
Fuzz
Getintent
Haansoft
InfoTekies
Information Security Team InfraSec Scanner
InterGET
Internet Ninja
InternetSeer
JOC Web Spider
Joomla
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
Lanshanbot
Larbin
LexiBot
Mag-Net
Mail.RU_Bot
Majestic SEO
Microsoft URL Control
Minefield
Mister PiX
Netcraft
Octopus
Offline Navigator
Openfind
PageAnalyzer
Pandalytics
Picsearch
Piepmatz
Pu_iN
Pump
QueryN Metasearch
RedesScrapy
Ripper
RocketCrawler
SEOlyt
SMTBot
ScreenerBot
Searchestate
SemrushBot-FT
Siphon
Sitevigil
SocialRankIOBot
Sottopop
Spammen
Spbot
Spider_Bot/3.0
Swiftbot
T8Abot
Telesoft
Telesphorep
Titan
Tracemyfile
VeriCiteCrawler
WPScan
Wallpapers/3.0
WallpapersHD
WebBandit
WebFuck
WebGo IS
WebSucker
WebZIP
WebsiteQuester
Webster
Xaldon_WebSpider
Zade
crawler.feedback
crawler4j
everyfeed-spider
imagesift.com
lwp-trivial
oBot
openai.com
plumanalytics
spyfu
webmeup-crawler
xpymep1.exe
zauba.io