nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-28 22:04:50 +00:00

100 lines
1.1 KiB
Text

AdsTxtCrawlerTP
BLEXBot
Backlink-Ceck
Barkrowler
Bigfoot
Bitacle
BlackWidow
Blackboard
Blow
BlowFish
BuiltBotTough
Bullseye
Cegbfeieh
Claritybot
Copier
CopyRightCheck
DTS Agent
DatabaseDriverMysqli
Disco
DomCopBot
EMail Wolf
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
FDM
Firefox/7.0
FrontPage
Harvest
HybridBot
Id-search
InfoTekies
InternetSeer
Iria
JOC Web Spider
Keybot Translation-Search-Machine
Kinza
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Lmspider
MIIxpc
MTRobot
Magnet
Moblie Safari
Name Intelligence
Navroad
NetAnts
Nibbler
Ninja
Nmap
Nuclei
Nutch
Offline Navigator
OutclicksBot
PageScorer
Pandalytics
Petalbot
PleaseCrawl
RSSingBot
RankActiveLinkBot
Ripper
RocketCrawler
SISTRIX
SemanticJuice
Siphon
Spammen
Spanner
SurveyBot
Swiftbot
Szukacz
T8Abot
Teleport
The Intraformant
TightTwatBot
Toweyabot
Tracemyfile
VoidEYE
Voltron
WWW-Collector-E
WebEnhancer
WebSucker
Website Quester
WebsiteExtractor
Zauba
Zeus
ZoomBot
arquivo-web-crawler
crawl.sogou.com
crawler4j
gopher
plumanalytics
scan.lol
serpstatbot
sexsearcher
sogouspider
trendiction.com
voyagerx.com
webprosbot
zgrab