nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-28 22:08:12 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
ADmantX
Abonti
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
Alligator
Ankit
Anthill
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BLEXBot
BackDoorBot
Backlink-Ceck
Bandit
Bigfoot
Black Hole
Blow
BotALot
Brandprotect
Buddy
CODE87
CherryPicker
ChinaClaw
Collector
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DataCha0s
Devil
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainSigmaCrawler
Drip
EMail Wolf
Ebingbong
Ecxi
EirGrabber
Evil
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Firefox/7.0
FrontPage
G-i-g-a-b-o-t
Genieo
GetRight
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HaosouSpider
HybridBot
Iblog
IlseBot
IndeedBot
Intelliseek
InterGET
Internet Ninja
Iria
IstellaBot
JOC Web Spider
Jbrofuzz
JetCar
Joomla
Jorgee
Keyword Density
Kinza
LNSpiderguy
LeechFTP
LeechGet
LibWeb
LinkScan
Linkdexbot
LinkextractorPro
Litemage_walker
Lmspider
Ltx71
Mail.RU_Bot
Majestic SEO
Majestic12
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access
Mister PiX
Moblie Safari
Musobot
NICErsPRO
NPbot
Name Intelligence
Navroad
NearSite
NetMechanic
Netcraft
Nettrack
Nibbler
Nimbostratus
Nmap
Nuclei
Offline Explorer
OnCrawl
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
Piepmatz
Pimonster
Pixray
Pockey
ProPowerBot
Probethenet
Pump
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankingBot
RankingBot2
RankurBot
ReGet
RebelMouse
Recorder
Rogerbot
SEOkicks-Robot
SEOprofiler
ScanAlert
Scanbot
ScreenerBot
Searchestate
SentiBot
Seomoz
Shodan
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
Spammen
Spanner
Spbot
Steeler
Stripper
Surfbot
Suzuran
Swiftbot
TeleportPro
Telesoft
Thumbor
Tracemyfile
Trendiction
Trendictionbot
TwengaBot
VB Project
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WBSearchBot
WEBDAV
WISENutbot
WPScan
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Sucker
WebCopier
WebEnhancer
WebFuck
WebPix
WebStripper
WebSucker
WebZIP
Webalta
WebsiteQuester
Who.is Bot
WinHTTrack
WiseGuys Robot
Xaldon WebSpider
YoudaoBot
Zade
Zeus
ZoominfoBot
ZumBot
ZyBorg
arquivo-web-crawler
arquivo.pt
clark-crawler
crawl.sogou.com
crawler4j
demandbase-bot
evc-batch
heritrix
instabid
internetVista monitor
lwp-request
lwp-trivial
muhstik-scan
netEstate NE Crawler
pcBrowser
polaris version
probe-image-size
ripz
scan.lol
seobility
seostar
serpstatbot
sexsearcher
spyfu
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe
zauba.io