nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-26 22:04:54 +00:00

100 lines
1 KiB
Text

404enemy
Aboundexbot
Acunetix
AdsTxtCrawlerTP
AhrefsBot
Aipbot
Alligator
Anthill
AwarioRssBot
Barkrowler
Bigfoot
Blackboard
Brandwatch
BunnySlippers
Cegbfeieh
ChinaClaw
Citoid
CopyRightCheck
Digincore
DomainStatsBot
FacebookBot
Foobot
GetWeb
GrabNet
HonoluluBot
IndeedBot
InfraSec Scanner
InterGET
IstellaBot
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
Libwhisker
LinkpadBot
MIDown tool
MQQBrowser
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkWatch
Mediatoolkitbot
Metauri
Microsoft URL Control
Mr.4x3
Msrabot
Octopus
OpenVAS
Pavuk
Petalbot
Picsearch
Pimonster
Pixray
Pump
Quick-Crawler
RSSingBot
Rainbot
RankingBot2
Reaper
RebelMouse
SEOprofiler
SalesIntelligent
ScreenerBot
ScrepyBot
Searchestate
SeekportBot
Semrush
SentiBot
Siteimprove
SocialRankIOBot
SpaceBison
SuperHTTP
T8Abot
TinyTestBot
Titan
Toweyabot
Upflow
VCI
WBSearchBot
WWW-Collector-E
WeSEE
Web Auto
Web Sucker
Wprecon
Xaldon WebSpider
Zauba
arquivo.pt
crawler4j
eCatch
evc-batch
isitwp.com
mediawords
muhstik-scan
pcBrowser
serpstatbot
sexsearcher
tAkeOut
voyagerx.com
webprosbot