nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-03 22:07:17 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Anarchie
Anarchy
Anthill
Apexoo
Atomseobot
Attach
AwarioRssBot
BBBike
BDCbot
BDFetch
BackDoorBot
Backlink-Ceck
Bandit
Battleztar Bazinga
BlowFish
Boardreader
Buck
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
CODE87
Cegbfeieh
CheeseBot
Chlooe
Citoid
Copier
Copyscape
Cosmos
CrunchBot
Curious
Custo
DataCha0s
DatabaseDriverMysqli
Demon
DigitalPebble
DnyzBot
DomainSigmaCrawler
EMail Wolf
Ecxi
Evil
Extractor
EyeNetIE
FHscan
FemtosearchBot
Fimap
Flunky
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
Genieo
GetWeb
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HMView
Haansoft
HonoluluBot
Humanlinks
IDBTE4M
IlseBot
InfoTekies
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iskanie
JennyBot
JetCar
JikeSpider
Joomla
Jorgee
JustView
Jyxobot
Kinza
Kozmosbot
Lanshanbot
Leap
LexiBot
LieBaoFast
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
MIIxpc
MJ12bot
MQQBrowser
Mag-Net
Majestic12
MarkWatch
Mass Downloader
Masscan
MeanPath Bot
MegaIndex.ru
MicroMessenger
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Needle
NetAnts
NetLyzer
NetMechanic
Netvibes
NextGenSearchBot
NimbleCrawler
Nimbostratus
Offline Navigator
OnCrawl
Openfind
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Papa Foto
Pavuk
PeoplePal
Petalbot
PictureFinder
Piepmatz
Pockey
Psbot
Pu_iN
Pump
PyCurl
RSSingBot
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
Recorder
RedesScrapy
SEOkicks-Robot
Scrapy
Semrush
Seomoz
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
Snake
Sociscraper
Sosospider
Spanner
Spinn3r
SputnikBot
Sqworm
Steeler
Sucker
SuperBot
Surfbot
SurveyBot
Swiftbot
Szukacz
TeleportPro
Telesphorep
The Intraformant
TheNomad
Toweyabot
Tracemyfile
Trendiction
Turingos
Turnitin
Vagabondo
VeriCiteCrawler
VoidEYE
WPScan
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Collage
Web Pix
Web Sucker
WebEnhancer
WebFuck
WebLeacher
WebSauger
WebStripper
WebSucker
WebZIP
Webalta
Website Quester
Webster
Whacker
Whatweb
Widow
WiseGuys Robot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zauba
Zermelo
Zeus
Zitebot
ZumBot
adscanner
autoemailspider
cah.io.community
check1.exe
cognitiveseo
crawl.sogou.com
dataforseo.com
evc-batch
gopher
ips-agent
isitwp.com
iubenda-radar
linkdexbot
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
plumanalytics
polaris version
probe-image-size
ripz
satoristudio.net
scan.lol
seocompany.store
seoscanners
serpstatbot
sexsearcher
spyfu
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webprosbot
x22Mozilla
xpymep1.exe