vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.04.3070 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-04-27 10:09:15 +00:00
parent 53aa61c216
commit c759e86ced
47 changed files with 94341 additions and 94351 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3069 #### Version: V4.2022.04.3070
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3069 #### Version: V4.2022.04.3070
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.04.3069 #### Version: V4.2022.04.3070
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11660
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.04.3069 #### Version: V4.2022.04.3070
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11664
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11664
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11664
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11664
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 1; 10.1.0.95 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 0; 10.1.0.95 0;
127.0.0.1 0; 127.0.0.1 0;

11664
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 1; 10.1.0.95 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 0; 10.1.0.95 0;
127.0.0.1 0; 127.0.0.1 0;

11664
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 1; 10.1.0.95 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 0; 10.1.0.95 0;
127.0.0.1 0; 127.0.0.1 0;

11664
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3069 3070

11664
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11664
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.255.204.190 0; 40.83.164.115 0;

11664
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 1; 10.1.0.95 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 0; 10.1.0.95 0;
127.0.0.1 0; 127.0.0.1 0;

11664
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 1; 10.1.0.95 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 0; 10.1.0.95 0;
127.0.0.1 0; 127.0.0.1 0;

11664
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 1; 10.1.0.95 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 0; 10.1.0.95 0;
127.0.0.1 0; 127.0.0.1 0;

11664
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.255.204.190 0; 40.83.164.115 0;

11664
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.255.204.190 0; 40.83.164.115 0;

11664
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 1; 10.1.0.95 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
80legs DataCha0s
BackStreet Download Wonder
G-i-g-a-b-o-t LinksManager
MIDown tool MSFrontPage
MTRobot MarkMonitor
MicroMessenger NPbot
RankingBot2 NearSite
SputnikBot Ripper
WISENutbot SlySearch
sogouspider WebReaper

310
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404enemy
ADmantX ADmantX
ALittle Client AIBOT
ASPSeek
Abonti
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot Aipbot
Alexibot Alexibot
AllSubmitter Alligator
Anarchy99 Anarchy
Asterias Anthill
Atomseobot Attach
AwarioRssBot
BBBike
BDCbot BDCbot
BacklinkCrawler BackWeb
Barkrowler Badass
Bandit
BatchFTP BatchFTP
Battleztar Bazinga
BetaBot BetaBot
Bigfoot
Bitacle Bitacle
Black Hole
Blow
BlowFish
Boardreader Boardreader
Brandprotect Brandwatch
Buck
BuiltWith BuiltWith
BuzzSumo BunnySlippers
CATExplorador CATExplorador
CCBot CazoodleBot
CODE87 CensysInspect
CSHttp
CherryPicker CherryPicker
ChinaClaw
Citoid Citoid
Cliqzbot Claritybot
Cocolyzebot Cocolyzebot
Cogentbot
Collector Collector
CopyRightCheck Copyscape
Craftbot Crescent
Crawling at Home Project Custo
CrunchBot
Curious
CyotekWebCopy CyotekWebCopy
DIIbot DBLBot
DSearch DatabaseDriverMysqli
Deusu Demon
Digincore Digincore
Dirbuster Dirbuster
Disco Discoverybot
DomainAppender DnBCrawler-Analytics
DomainCrawler
DomainStatsBot
Domains Project Domains Project
Dotbot
Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon
Ebingbong Ebingbong
Evil EroCrawler
Express WebPictures
ExtLinksBot
Extractor Extractor
Extreme Picture Finder FDM
EyeNetIE FHscan
Ezooms FemtosearchBot
Firefox/7.0 Fimap
FlashGet FlashGet
Flunky Flunky
Genieo GT::WWW
GermCrawler GetRight
Go!Zilla GetWeb
Go-Ahead-Got-It Getintent
Gotit Gotit
GrabNet Grabber
Grafula HTMLparser
GrapeshotCrawler
HTTP::Lite
HTTrack HTTrack
Haansoft
HaosouSpider
Heritrix Heritrix
Hloader HybridBot
HonoluluBot
IDBTE4M
IDBot
IRLbot IRLbot
InterGET Iblog
Internet Ninja Id-search
InternetSeer IlseBot
Iria Image Fetch
Image Sucker
IndeedBot
Iskanie
JamesBOT
JennyBot JennyBot
JetCar JetCar
JikeSpider Jetty
JustView JustView
Kenjin Spider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot Kozmosbot
LWP::Simple LexiBot
Lanshanbot LibWeb
LeechFTP Libwhisker
LeechGet
Lftp
LieBaoFast
Lightspeedsystems
Likse
LinkWalker LinkWalker
LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey Lipperhey
Litemage_walker Lipperhey Spider
Lmspider
MFC_Tear_Sample MFC_Tear_Sample
MQQBrowser MTRobot
Mag-Net Mag-Net
Majestic SEO Mail.RU_Bot
Majestic-SEO Majestic-SEO
Majestic12 Majestic12
Mass Downloader MarkMonitor
MarkWatch
Mata Hari Mata Hari
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
Metauri
MicroMessenger MicroMessenger
Microsoft Data Access
Minefield Minefield
Mister PiX Mister PiX
Moblie Safari
Mojeek
Mojolicious Mojolicious
MolokaiBot
Mozlila
Mr.4x3
Msrabot Msrabot
Musobot
NICErsPRO NICErsPRO
Name Intelligence Name Intelligence
Navroad
NearSite
Nessus
Net Vampire Net Vampire
NetZIP NetLyzer
Netcraft NetMechanic
NimbleCrawler NimbleCrawler
Nimbostratus
Ninja Ninja
Nmap Nuclei
OpenVAS OnCrawl
OutfoxBot Openfind
POE-Component-Client-HTTP Openvas
Pandalytics PECL::HTTP
Page Analyzer
PageThing.com
Papa Foto Papa Foto
Pavuk PeoplePal
Petalbot Petalbot
Picscout
Picsearch Picsearch
PictureFinder Probethenet
Pimonster Pu_iN
Psbot Pump
PyCurl
RSSingBot RSSingBot
RankActive
RankActiveLinkBot RankActiveLinkBot
RankFlex RankFlex
RankingBot2
Rankivabot
RankurBot
Re-re Re-re
Reaper ReGet
Recorder Recorder
RedesScrapy
RepoMonkey
RocketCrawler RocketCrawler
Rogerbot Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOstats SEOstats
SMTBot SISTRIX
Scanbot
ScoutJet ScoutJet
Scrapy Screaming
SemanticJuice SeobilityBot
SentiBot Siphon
Shodan Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteLockSpider
SiteSucker SiteSucker
Sitebeam
Siteimprove
SmartDownload SmartDownload
Snapbot Sogou web spider
SocialRankIOBot
Sosospider
Sottopop
SpaceBison SpaceBison
Spammen Spinn3r
Sucker SputnikBot
Sqlmap
Sqlworm
Sqworm
Sucuri Sucuri
SuperBot
SuperHTTP SuperHTTP
SurveyBot Swiftbot
Szukacz Szukacz
T0PHackTeam T0PHackTeam
Telesoft T8Abot
Teleport
TeleportPro
Telesphoreo Telesphoreo
Thumbor Thumbor
Trendiction TightTwatBot
Toweyabot
Trendictionbot
True_Robot True_Robot
URLy Warning TurnitinBot
UnisterBot TwengaBot
Upflow Twice
Vacuum VB Project
Virusdie Vagabondo
VoidEYE
Voil Voil
WASALive-Bot Voltron
WBSearchBot WWWOFFLE
WEBDAV Wallpapers
WISENutbot
WWW-Mechanize
WallpapersHD
WeSEE
Web Collage
Web Sucker
Web Auto Web Auto
WebBandit Web Enhancer
WebCopier Web Fuck
WebGo IS Web Pix
Web Sucker
WebEnhancer
WebFuck
WebImageCollector WebImageCollector
WebStripper WebSauger
WebSucker WebSucker
WebWhacker WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag Webshag
WebsiteExtractor WebsiteExtractor
Webster
Whack Whack
Whacker
Whatweb Whatweb
WinHTTrack
WiseGuys Robot WiseGuys Robot
Xaldon WebSpider Xaldon WebSpider
ZoomBot Xenu
ZoominfoBot Zauba
archive.org_bot
arquivo-web-crawler
arquivo.pt arquivo.pt
backlink-check check1.exe
demandbase-bot clark-crawler
domainsproject.org com.plumanalytics
evc-batch crawler.feedback
crawler4j
facebookscraper
internetVista monitor internetVista monitor
isitwp.com magpie-crawler
linkdexbot meanpathbot
lwp-request mediawords
lwp-trivial
oBot
page scorer
plumanalytics
polaris version
probe-image-size probe-image-size
s1z.ru ripz
scalaj-http scalaj-http
scan.lol seobility
serpstatbot seocompany.store
sexsearcher
sitechecker.pro sitechecker.pro
siteripz
sp_auditbot
sysscan
tAkeOut tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webgains-bot webgains-bot
webpros.com
x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe xpymep1.exe
zauba.io

280
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404enemy
80legs
AIBOT AIBOT
ASPSeek
Abonti Abonti
Aboundex
Aboundexbot Aboundexbot
Acunetix Acunetix
AiHitBot AhrefsBot
Aipbot
Alexibot
AllSubmitter AllSubmitter
AlphaBot AlphaBot
Anarchie Anarchie
Apexoo
Aspiegel Aspiegel
Atomseobot Atomseobot
Attach
AwarioRssBot AwarioRssBot
BDCbot AwarioSmartBot
BackDoorBot BBBike
Backlink-Ceck BackStreet
BacklinkCrawler BackWeb
Bandit BatchFTP
Barkrowler
Battleztar Bazinga Battleztar Bazinga
Bigfoot BetaBot
Bitacle Black Hole
Blackboard Boardreader
BlowFish Brandwatch
Buddy
BuiltWith BuiltWith
Bullseye BunnySlippers
CODE87 CODE87
CSHttp
Calculon Calculon
CheTeam CheeseBot
CherryPicker
Chlooe Chlooe
Citoid
Claritybot Claritybot
Copier Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copyscape
Cosmos Cosmos
Craftbot Craftbot
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CrunchBot CrunchBot
Custo
DSearch
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Deusu Deusu
Digincore Disco
DigitalPebble
Dirbuster
Discoverybot Discoverybot
Dispatch Dispatch
DnBCrawler-Analytics DittoSpyder
DomainCrawler DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder Download Wonder
ECCP/1.0 Dragonfly
EMail Siphon
EasyDL
Ebingbong Ebingbong
EroCrawler EirGrabber
Evil Evil
Exabot
Express WebPictures Express WebPictures
ExtLinksBot ExtLinksBot
Extractor
ExtractorPro
Ezooms Ezooms
FDM
FHscan FHscan
FemtosearchBot
Fimap Fimap
Fuzz FyberSpider
Fyrebot G-i-g-a-b-o-t
GT::WWW GermCrawler
GetWeb GetWeb
Gigabot
GoZilla GoZilla
Gotit
Grafula Grafula
HTMLparser GridBot
HEADMasterSEO
HMView
HTTP::Lite HTTP::Lite
HTTrack HTTrack
Haansoft HaosouSpider
Havij Harvest
HybridBot Heritrix
Image Fetch HonoluluBot
Intelliseek IDBot
InterGET Id-search
IndeedBot
Iria Iria
JennyBot Iskanie
JetCar JOC Web Spider
JamesBOT
Jetty
JikeSpider JikeSpider
Joomla
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
LNSpiderguy
Lanshanbot
LeechGet LeechGet
Lftp LieBaoFast
Likse
LinkScan LinkScan
Linkbot LinkpadBot
LinkextractorPro LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Lmspider LinqiaScrapeBot
Mag-Net MIDown tool
MIIxpc
MTRobot
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO Majestic12
Masscan Mass Downloader
Mata Hari Mata Hari
Meanpathbot MegaIndex.ru
MicroMessenger Metauri
Mister PiX Microsoft Data Access
Mojeek Moblie Safari
Mojolicious Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot Msrabot
Nameprotect NPbot
Needle NearSite
Nessus NetLyzer
Net Vampire NetSpider
NetMechanic NetZIP
Netcraft Netcraft
Nibbler
Nikto Nikto
Nmap NimbleCrawler
Nuclei Not
Nutch Nutch
Offline Explorer Octopus
OpenLinkProfiler
OpenVAS OpenVAS
OrangeBot
OrangeSpider OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
PageGrabber PageGrabber
PageThing.com Pandalytics
Panscient Panscient
Petalbot Pavuk
Pockey Pi-Monster
ProPowerBot Picscout
Picsearch
PictureFinder
Pimonster
Probethenet Probethenet
Psbot
Pump Pump
Quick-Crawler Quick-Crawler
RankingBot Re-re
RankingBot2 Reaper
Rankivabot RedesScrapy
Recorder RepoMonkey
SEOlyticsCrawler SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX SISTRIX
SMTBot Scanbot
ScanAlert
Screaming Screaming
ScrepyBot ScrepyBot
Searchestate Searchestate
Seekport
Semrush Semrush
SemrushBot SentiBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz Shodan
Siphon SiteExplorer
SiteLockSpider
SiteSnagger SiteSnagger
SiteSucker
Sitebeam
Sitevigil Sitevigil
SlySearch
Snake Snake
SocialRankIOBot Snapbot
Sociscraper Snoopy
Sottopop Sogou web spider
SpaceBison Spammen
Sqlmap Spanner
SputnikBot
Sqworm Sqworm
Steeler
SuperBot
SuperHTTP SuperHTTP
Surfbot Surfbot
SurveyBot SurveyBot
Suzuran Suzuran
Swiftbot T0PHackTeam
Szukacz Telesoft
The Intraformant Telesphoreo
TheNomad Turingos
TightTwatBot Typhoeus
Titan Upflow
Toweyabot
Trendictionbot
Twice
URLy.Warning
V-BOT V-BOT
VB Project
Vagabondo Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper VeriCiteCrawler
VoidEYE
Voil Voil
Voltron
WASALive-Bot WASALive-Bot
WBSearchBot
WEBDAV
WPScan WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
Wallpapers Wallpapers
Wallpapers/3.0 WeSEE
Web Auto
Web Collage Web Collage
Web Fetch
Web Fuck Web Fuck
Web Pix Web Pix
Web Sauger
Web Sucker
WebBandit WebBandit
WebCopier WebCollage
WebGo IS WebEnhancer
WebPix WebFuck
WebSauger
WebStripper WebStripper
WebSucker Webshag
WebWhacker Webster
WebZIP
Whack
Whacker Whacker
Whatweb
Widow Widow
WiseGuys Robot WiseGuys Robot
Woobot
Wotbox Wotbox
Wprecon Xaldon WebSpider
YoudaoBot
Zauba
Zermelo
Zeus Zeus
Zitebot Zitebot
ZmEu ZmEu
ZoomBot ZoominfoBot
ZyBorg
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt arquivo.pt
backlink-check
cah.io.community
check1.exe
clark-crawler
com.plumanalytics com.plumanalytics
crawl.sogou.com crawler.feedback
evc-batch facebookscraper
instabid instabid
internetVista monitor internetVista monitor
ips-agent
isitwp.com
linkdexbot linkdexbot
magpie-crawler magpie-crawler
meanpathbot
mediawords mediawords
oBot
page scorer page scorer
pcBrowser pcBrowser
scalaj-http scalaj-http
seocompany.store scan.lol
seobility
seoscanners seoscanners
serpstatbot
sitechecker.pro
siteripz siteripz
sogouspider
sysscan
tAkeOut
voyagerx.com voyagerx.com
webpros.com webpros.com
webprosbot x09Mozilla
xpymep1.exe x22Mozilla
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
bif-ru.info iopeninghours.co.uk
compliance-nelson.top polska-poezja.com
eas-seo.com pp-budpostach.com.ua
jwcialislrt.com razamicroelectronics.com
locationdesaison.com sa-rewards.co.za
longadventure.com symbaloo.com
replicaclub.ru topdownloads.ru
sky-mine.ru tramadolandtizanidine.blogspot.com
tuberkulezanet.ru tupper-posuda.ru
viddyoze.com weekes.biz.tc

898
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
000free.us 00author.com
007angels.com 08800.top
01apple.com 11235813.webzdarma.cz
03p.info 1pamm.ru
101flag.ru
12masterov.com
1adult.com
1flag.co.za
1hwy.com
1kinobig.ru
2345.com
2ads.co.uk
2kata.ru 2kata.ru
300richmond.co.nz 3xforum.ro
45en.ru 51unlim.ru
4senses.co 5tey7463.weebly.com
51.la 7a2rnuey1tw9ar.ru
7wind.ru aaa38852e886ac4af1a3cff9b47cab6272.com
8gold.com
8kisses.eu
91abcw.com
DomainStatsBot
aarbur.com aarbur.com
academiacsmendoza.org acads.net
acmebtn.ml accessoires-mode.in
ad-words.ru adbetclickin.pink
adconscious.com adssafeprotected.com
addblueoff.com.ua adzpower.com
addray.pro alessandraleone.com
adimmix.com alfa-medosmotr.ru
adtiger.tk algarveglobal.com
agapovdg.ru all-number.com
agroeconom.kz all4invest.ru
alevinefesleri.com allboard.xobor.de
all-streaming-media.com alldownload.pw
allornamenti.com alldubai.biz
allproblog.com allkrim.com
alyeskaresort.com amigobulls.com
amospalla.es android-systems.ru
ample-awards-today.us android4fun.org
ampower.me animali.deagostinipassion.it
amung.us apartment.ru
analytics-ads.xyz apibatbrowsecom-a.akamaihd.net
anniemation.com apiwebwebgetcom-a.akamaihd.net
apibrowsesmartne-a.akamaihd.net appfastplay.com
apioutoboxnet-a.akamaihd.net appfixing.space
apiwoodensealcom-a.akamaihd.net appsaurus.com
appmsr.org arate.ru
apps-analytics.net arendatora.ru
arcadepages.com
architecturebest.com
arius.tech
arkkivoltti.net
arraty.altervista.org
asacopaco.tk
ascat.porn ascat.porn
asrv-a.akamaihd.net asmxsatadriverin.aircus.com
asrv-a.akamoihd.net astrochicks.com
atmovs.com atmovs.com
auto-zapchasti.org
autochoixspinelli.com
autogrep.ru autogrep.ru
aviapanda.ru avitocars.ru
aviav.co avkzarabotok.info
avramstroy.ru azadnegar.com
azartmix.com balla-boo.se
azazaporn.com banan.tv
babyguns.ru basedecor.ru
baditri.com bcmp.org
battleforupdating.site beclean-nn.ru
becuo.com begalka.xyz
bet-prognoz.com beget.tech
beta.hotkeys.com bensbargains.net
betune.onlinewebshop.net bestdooz.com
binomo.kz besthoro.ru
bizru.info bestwebsitesawards.com
bjgugu.net.ua betshuckclean.com
bloke.com beztuberkuleza.ru
bluesalt.co bget.ru
bmsco.co bingo8888.com
bolitgorlo.net bioscorp.ru
bosefux.esy.es bjanshee.ru
bpro1.top bloggers.nl
brakehawk.com bobba.dzaba.com
brus.city bombla.org
bouda.kvalitne.cz
brandimensions.com
briomotor.co
browserprotecter.com
bscodecs.com
btc4u.ru
btvn.ru btvn.ru
bumble.cheapwebsitehoster.com buketeg.xyz
burger-imperia.com bumskontakte.org
buy-meds24.com buqayy0.livejournal.com
buynorxx.com bus-offer.com
buypanicdisorderpill.com buypillsorderonline.com
calc-for-credit.ru buytizanidineonline.blogspot.com
calvet.altervista.org buzzzg.men
cam-kontakte.org bwlx.prepedu.cn
canacopegdl.com cablecar.us
candelluxsklep.pl canoncdriverq3.pen.io
candy-glam-hp.com canvas.gloverid.site
candypeople.se cartierlove2u.xyz
cartierbracelet.xyz
cartierlovestore.com cartierlovestore.com
centre-indigo.org.ua cb.iphantom.com
cezartabac.ro cdncash.com
chastnoeporno.com cdnnetwok.xyz
chee-by.biz cellfun.mobi
children-learningreading.info cenokos.ru
chinacheapelitejerseys.com ceotrk.com
cleanallspyware.com cheapbelstaff.online
cleanpcnow.com cibpenonptib.flu.cc
clickprotects.com cigarpass.com
clicksor.com cinemaenergy-hd.ru
clmforexeu.com cl.s7.exct.net
club-lukojl.ru clicksotrk.com
clubfashionista.com cocolyze.com
cntravelre.com cocyq.inwtrade.com
cobaltpro.ru compliance-alex.top
coinsspb.com compliance-andrew.top
community.allhiphop.com compliance-don.xyz
compiko.info compliance-irvin.top
concordexoticrentals.com compliance-jane.top
connectingsingles.com compliance-julia.top
consorzioilmosaico.org conboy.us
contentsexpress.com cookie-law-enforcement-ff.xyz
contextualyield.com coolingoods.com
copyrightclaims.org credit-online.ws
coslab.club creditmoney.com.ua
countercrazy.com crystalslot.com
crackguru.tk culad.com
customcatchcan.com culmimg.pw
customerguru.in dailyfinancefix.com
daooda.com dailystrength.org
darkages.info darkbooks.org
darmebel.com.ua
dataloading.net dataloading.net
ddlmega.net delta-line.men
deluxedumps.com den-noch24.ru
dfiles.me detki-opt.ru
digitalfaq.com deutschland123.de
dimfour.com digital-video-processing.com
dnepropetrovsk.mistr-x.org directrev.com
docs4all.com diusyawiga.tk
documentbase.net divatraffic.com
domainsphoto.com djihispano.com
downloader12.ru dogclothing.store
dogoimage.com
domainanalyzing.xyz
dosug-lux.ru
downloadme.life
doxyporno.com doxyporno.com
draniki.org draniki.org
driving.kiev.ua dtnlyss.com
drugspowerstore.com
dvervmoskvu.ru
e-buyeasy.com e-buyeasy.com
e-poker-2005.com earl-brown.info
ecommerce-seo.org
editors.choice6912650.hulfingtonpost.com editors.choice6912650.hulfingtonpost.com
electronicadirect.com eduinfosite.com
elektir.ru elektrischeziga.livejournal.com
elektrozigaretten1.tumblr.com elektrozigarette2.webs.com
elite-sex-finders.com elexies.info
elkacentr.ru elmifarhangi.com
eluxer.net elvel.com.ua
enginebay.ru erotik0049.com
eredijovon.com es5.com
ero-advertising.com esfchat.tk
escortplius.com etm-consult.de
euromasterclass.ru
event-tracking.com
everytalk.tv
excitacao.com
executehosting.com
expdom.com expdom.com
expertblog.info expertnaya-ocenka.ru
ezigarettekaufen.myblog.de extremepornos.net
ezigarettenkaufen1.pagina.gr f07.de
ezigaretteshop2.mywapblog.com facebook-mobile.xyz
f-loaded.de falcon-images.blogspot.com
f012.de favoritemoney.ru
falcoware.com
fantasticpixcool.com
fatfasts-4tmz.com
fbdownloader.com fbdownloader.com
fellowshipoftheminds.com fertilitetsradgivningen.se
ferieboligkbh.dk fickenprivat.info
fickblock18.com fillmewithhappiness.com
filefilter.weebly.com film-one.ru
filmi-onlain.info
findsexguide.com
fireads.men fireads.men
fiuxy.com firesub.pl
fm-upgrade.ru fordsonmajbor.cf
forum.tvmir.org forexunion.net
foxjuegos.com formularz-konkurs.tk
foxweber.com free-share-buttons.top
free-social-buttons.xyz free411games.com
freelifetimefuckbook.com freeseedsonline.com
freewareseek.com freshdz.com
freshmac.space game-mmorpg.net
freza-sverlo.ru gameprimary.com
frighteningremain.cf gamesprite.me
fuckmill.com gdcentre.ru
fun-mobi.pl gilsonchiro.xyz
g33.org girlspicsa.com
gallerylisting.com glicol.kz
gamedayhouse.com golaya.pw
gameplexcity.com gomusix.com
gamerextra.com gonextmedia.com
games.kolossale.ru gorodservis.ru
gateway.zscalerone.net
geilehausfrauen.net
getmiro.com
gettpromos.com
ghostvisitor.com
gk-atlant.info
goodprotein.ru
gosmeb.ru
gourcy.altervista.org
groupmoney.ru
growboxbl.ru growboxbl.ru
gwebtools.com.br guigyverpo.cf
hasshe.com guitar-master.org
hdfreeporno.net
hdwalls.xyz hdwalls.xyz
hermesreplica.win heatpower.ru
hitcpm.com hetmanship.xyz
honyaku.yahoofs.jp hol.es
hostcritique.com hop.clickbank.net
hotblog.top
hothot.ru hothot.ru
houdom.net hotkeys.com
hydropump.su house.sieraddns.com
id-forex.com hreade.com
idegenvezeto.eu huhn.altervista.org
iflycapetown.co.za iblogpress.xyz
ihc2015.info iloveitaly.ru
ikearugs.xyz images-free.net
imgarit.pw images.gyffu.com
in-tandem.co imagui.eu
indiakino.net impresagaia.it
int.search.mywebsearch.com innodgfdriverhm.aircus.com
investsuccess.org innoslicon.com
investzalog.ru insomniagamingfestival.com
iomoio.net intellekt21.ru
iptool.xyz ip-guide.com
iqoption-bin.com ipornox.xxx
iqoption.pro itrevolution.cf
iqs.biz.ua ivanstroi.ru
isitwp.com izhevsk.xrus.org
j-times.ru japan-bearings.ru
jbl-charge.info javidol.site
jeremyeaton.co javstock.com
jerseychinabizwholesale.com jimmychoosale.online
jillepille.com journalhome.com
jobmarket.com.ua jrpmakati.com
jovencitas.gratis jwcialislrt.com
jus0wil.pp.ua jyvopys.com
kaidalibor.de kanimage.com
karusel-market.ru karachev-city.ru
kerei.ru karting196.ru
khafre.us keywordspay.com
kidskunst.info
kiinomaniak.pl
kinobest.pl
kinoplen.ru
kiskinhouse.com kiskinhouse.com
kmgamex.cf kladrus.ru
komputernaya-pomosh-moscow.ru kliksaya.com
konkursowo-24.pl kostenloser-sex.com
kursy-ege.ru kountrylife.com
la-fa.ru kozhniebolezni.com
lacasamorett.com krasnodar.ru
landoftracking.com kunstaktien.info
laudit.ru kurwa.win
leadn.pl kustanay.kz
kwzf.net
lacloop.info
lampokrat.ws
lankarns.com
larose.jb2c.me
law-check-two.xyz
leadwayau.com leadwayau.com
leftofcentrist.com lego4x4.ru
lerporn.info liky.co.ua
letslowbefast.today liveshoppersmac.com
light.ifmo.ru
linkbolic.com
localflirtbuddies.com
lockerz.com lockerz.com
locustdesign.co longadventure.com
lombardfinder.ru
love-baby.cz
ltvperf.com ltvperf.com
lyngdalhudterapi.no luciddiagnostics.in
lyrster.com luckyday.world
lulea-auktionsverk.se
mac-shield.com
macfix.life macfix.life
macnewtech.com marketland.ml
mazda-roadsters.com marsgatan.com
mbiologi.ru
mebel-vstroika.ru
medispainstitute.com.au medispainstitute.com.au
meet-flirt-dating.com metalonly.info
menstennisforums.com mil-stak.com
merryhouse.co.uk minet.club
metallosajding.ru mini-modus.ru
mhi-systems.ru mobilemedia.md
missis.top mojpregled.com
mlf.hordo.win mojpreskumanie.com
monclerjacketsoutlet.pw monclerboots.xyz
music.utrolive.ru most-kerch.org
mrvideospornogratis.xxx
msk-diplomat.com
mug-na-chas-moscow.ru
multgo.ru
musezone.ru
mustwineblog.com
muz-baza.net muz-baza.net
mwtpludn.review muz-shoes.ru
my-aladin.com
myanyone.net
mybinaryoptionsrobot.com
mydeathspace.com
myindospace.com myindospace.com
mylovelibrabry.com myperiod.club
myonlinepayday.co napalm51.nut.cc
myplaycity.com naturtreenspicerx.pw
na-telefon.biz nerudlogistik.ru
nalogovyy-kodeks.ru
natali-forex.com
negral.pluto.ro
netvouz.com netvouz.com
networkad.net nextbackgroundcheck.gq
nfljerseyscheapbiz.us nibbler.silktide.com
nofreezingmac.work nikkiewart.ru
nosecret.com.ua ningessaybe.me
novosti-hi-tech.ru nonameread45.live
nrv.co.za novatech.vn
obsessionphrases.com nuup.info
okuos.com o333o.com
olympescort.com obiavo.su
omgtnc.com offers.bycontext.com
office2web.com
omsk.xrus.org omsk.xrus.org
onlinebay.ru one-gear.com
oops-cinema.ru online-x.ru
openlibrary.org onlinetvseries.me
optibuymac.com onstrapon.purplesphere.in
orel-reshka.net ops.picscout.com
orion-code-access.net ordernorxx.com
ostrovtaxi.ru oren-cats.ru
ororodnik.goodbb.ru
ostroike.org
otbelivanie-zubov.com
owathemes.com owathemes.com
oynat.info oynat.info
paclitor.com paccohichetoti.ml
pagesense.com painting-planet.com
paleohub.info paleohub.info
palvira.com.ua pammik.ru
parajumpersoutlet.online pandroid.co
parajumpersstore.online paradontozanet.ru
partybunny.ru parfusale.se
patterntrader-en.com pearlisland.ru
perm.xrus.org phpdevops.com
petrovka-online.com piccdata.com
photochki.com picphotos.net
pics-group.com
picswe.com picswe.com
picturesify.com picturesmania.com
pinapchik.com pinapchik.com
pinstake.com pinstake.com
pisanieprac.info pintattoos.com
pizdopletka.club pixell.club
pladform.ru
plohaya-kreditnaya-istoriya.ru plohaya-kreditnaya-istoriya.ru
popander.mobi plugingeorgia.com
popmarker.com pobeiranie.pl
porno-raskazy.ru pogodnyyeavarii.gq
pornokorol.com pornobrazzers.biz
pornosemki.info pornpost.in
pornzone.tv pornstartits.xblog.in
printdirectforless.com porodasobak.net
priscilarodrigues.com.br prchecker.info
privat-girl.net predominant-invent.tk
privatefx-in.ru pregnant.guru
pro-tec.kz printingpeach.com
prizefestival.mobi
prodvigator.ua prodvigator.ua
progonrumarket.ru
prostitutki-kharkova.org
prostitutki-odessa.org
prostitutki-tolyatti.org
proxyradar.com proxyradar.com
pushdata.sendpulse.com psvita.ru
pussyfleet.com pussyfleet.com
py100.ru quickcashlimited.com
qwertty.net rank-checker.online
randki-sex.com ranksays.com
realting-moscow.ru realmonte.net
refudiatethissarah.info redhotfreebies.co.uk
reklama1.ru reining.lovasszovetseg.hu
remmling.de reklamuss.ru
remont-komputerov-notebook.ru
rentalcarnavi.info
rentaremotecomputer.com
responsive-test.net responsive-test.net
resultshub-a.akamaihd.net
retreatia.com retreatia.com
rezeptiblud.ru
rialp.getenjoyment.net rialp.getenjoyment.net
romhacking.ru robertefuller.com
rootandroid.org rockma.se
ros-ctm.ru roleforum.ru
s1z.ru ru-dety.ru
sakhboard.ru rucrypt.com
sanidumps.com rustic-quiver.win
sbornik-zakonov.ru s.lollypopgaming.com
scanner-josh.top sa-live.com
scottbywater.com samo-soznanie.ru
sdi-pme.com satoristudio.net
seansonline24.pl sbtdesign.co.uk
secretscook.ru scanner-olga.top
seo-tools-optimizing.com scopich.com
seozoom.it seasaltwithfood.com
servingnotice.com selectads.men
serviporno.com semp.net
sexspornotub.com seo-prof1.xyz
seojokes.net
serw.clicksor.com
sex-sex-sex5.com
sex-znakomstva.online
sexystrippe.info sexystrippe.info
sfj-ror.no shakhtar-doneck.ru
sharebutton.org
sharpchallenge.com sharpchallenge.com
shivafurnishings.com shijian.ac.cn
shlyahten.ru shikiso.info
shoesonlinebuy.cn shisha-swag.de
shopfishing.com.ua shopfishing.com.ua
shtaketniki.ru shoppytoolmac.com
sigmund-freud.co.uk sibdevice.ru
sim-service.net silktide.com
simon3.ru similardeals.net
site-analyzer.com simplepooltips.com
site-speed-checker.site site-speed-checker.site
site5.com sitevaluation.org
sledstvie-veli.net skincrate.net
slomm.ru social-vestnik.ru
smadihome.com soft-program.com
smailik.org soochi.co
smichovbike.cz souvenirua.com
snts.shell-pmr.ru spacash.com
soc-proof.su spb.ru
social-s-hhh.xyz spinnerco.ca
softonicads.com staff.prairiesouth.ca
spammen.de stairliftsarea.com
spasswelt.net strag-invest.ru
spin2016.cf
spravka-medosmotr.ru
strana-krasoty.ru
strana-solnca.ru strana-solnca.ru
strv.se stretchmate.net
stuff-about-money.com stroyhelp-dv.ru
stroyplus.ru
success-seo.com
sucsesofinspiration.com sucsesofinspiration.com
suhanpacktech.com suggest-keywords.com
superkanpo.com summerlinhomes411.info
supervesti.ru surcentro.com
swagbucks.com tabletkinaodchudzanie.com.pl
swsociety.se
tacbibirfa.tk
tackletarts.co
tagil.zrus.org tagil.zrus.org
taximytishi.ru tam-gde-more.ru
teesdaleflyballclub.co.uk tanieaukcje.com.pl
teguh.info tattooha.com
terrafootwear.us tattooreligion.ru
testbotprocessor44.com td-33.ru
themestotal.com tds-advert005.info
thewomenlife.com techart24.com
threecolumnblogger.com tecspb.ru
timhost.ru tedxrj.com
titan-ads.life tehngr.ru
tizanidineandhydrocodone.blogspot.com thedownloadfromwarez.blogspot.com
tizanidineinteractions.blogspot.com thefds.net
tizanidineusedfor.blogspot.com themeforest.net
top-karkas.ru time-japan.ru
totu.us tizanidinefibromyalgia.blogspot.com
traffictrade.life tizanidinehcl4mgtablet.blogspot.com
trustaffs.com tk-assortiment.ru
trustedmaccleaner.com topanasex.com
tupper-posuda.ru torontoplumbinggroup.com
uchebavchehii.ru tpu.ru
unrealcommander.org tradedeals.biz
uptime-as.net traffic-club.info
urldelivery.com trafficgenius.xyz
usswrite.com tt-ipd.info
v-doc.co tuberkulezanet.ru
vadimkravtcov.ru tuberkuleznik.ru
vbtracker.net umaseh.com
vedomstvo.net unpredictable.ga
vellings.info uptimechecker.com
urlopener.com
usadacha.net
uvozdeckych.info
v24s.net
v720hd.ru
valueclick.com
ventelnos.com ventelnos.com
video-camer.com video--production.com
video-woman.com villakohlanta.nu
vip-file.com vipromoffers.com
virtualbb.com viteonlusarezzo.it
vsdshnik.com viven.host.sk
vzlom-na-zakaz.com vk-mus.ru
wallpapersdesk.info vkgaleria.com
warezaccess.com vut.com.ru
warning.or.kr vzlomfb.com
waycash.net w7s.ru
wcb.su wareseeker.com
webpromotion.ae we-are-gamers.com
website-datenbank.de webix.biz
website-speed-check.site webs.com
website-speed-up.site website-speed-up.site
westermarkanjou.se website-stealer.nufaq.com
westsextube.com websiteexplorer.info
while.cheapwebsitehoster.com websites-reviews.com
wma-x.com westen-v.life
wnoz.de westvilletowingservices.co.za
workle.website wfb.hatedriveapart.com
wpthemedetector.co.uk wnhjavlhezp.gq
writingservices17.blogspot.ru wordpresscore.com
x-diesel.info world-mmo.com
xblog.in wrona.it
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai wrz0iuebwhp5fg.freeddns.com
xn--90acenikpebbdd4f6d.xn--p1ai ww1943.ru
xn--b1agm2d.net www.pinnacle-bets.com
x-mix.info
xchangetrak.com
xclicks.net
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--80aeahghtf8ac5i.xn--p1ai
xn--e1afanlbnfckd7c3d.xn--p1ai xn--e1afanlbnfckd7c3d.xn--p1ai
yellocloud.be xtubeporno.net
yhit.press yachts-cruise.info
youandcredit.ru yginekologa.com
youradulthosting.com yopoint.in
yousense.info you-shall-not-pass.is74.ru
ypmuseum.ru yourporn.com
yur-p.ru yugo-star.ru
za-fun-offer.com za-music.mymobiplanet.com
zaidia.xhost.ro zapatosenventa.info
zeroredirect7.com zarabiaj-dzis.pl
znakomstva-moskva77.ru zarabotat-na-sajte.ru
zvezdagedon.ru zrelaya.pw
zygophyceous.womanstars.site

478
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1008.su 101billion.com
1kinobig.ru 101lesbian.xyz
4replicawatch.net 1qingdao.com
4ureyesonly.com 2x2fan.ru
4webmasters.com 4kepics.com
5elementov.ru 5ws.dating-app.ru
6hopping.com aad1f4acb0a373420d9b0c4202d38d94fa.com
aac52006ec82a24e08b665f4db2b5013f7.com abusora.com
aaronabel.com accessoires-mode.in
abcdefh.xyz adcash.com
adman.se aktivator-windows10.blogspot.com
adssafeprotected.com alkoravto.ru
advancedsoftwaresupport.com alltheviews.com
afslankpillen2017nl.eu alveris.ru
aghanyna.com anapa-inns.ru
ahhjf.com anaseracresar.tk
alldubai.biz angry-fermi-7633.arukascloud.io
amateurgalls.com animebox.com.ua
amt-k.ru apartmentbay.ru
animalrank.com appleid-verification.com
anmysite.com appsaurus.com
apibatbrowsecom-a.akamaihd.net aproposde.com
apioutoboxnet-a.akamaihd.net autogrep.ru
apptester.tk b00kmarks.com
asdfg.pro b2b-lounge.com
atlasvkusov.ru bashtime.ru
avtoarenda.by bestempresas.es
banan.tv bestkfiledxd.cf
bannerads.de besttorrentknifta.weebly.com
bestplacetobuyeriacta.jw.lt bif-ru.info
bibys.com bingo8888.com
bio-market.kz bonzibuddi.com
blogos.kz bugof.gq
blogporn.in buketeg.xyz
bookhome.info buyscabiescream.com
braindaily.xyz bvlgaribracelet.xyz
brainzpod.win byme.se
brus-vsem.ru canrioloadm.gq
budpost.com.ua cardsharp1.ru
bum.com.ru catalogs-parts.com
buynorxx.com cdnanalytics.xyz
cartierlove2u.com cheapjerseysfootballshop.com
casinorewards.info chocoslim.pro
cayado.snn.gr christianlouboutinsaleonline.us
cerev.info cleanersoft.com
cheatcode-lita12.rhcloud.com clmforexeu.com
cialischmrx.com cognitiveseo.com
cleansearch.net coolbar.pro
compliance-julianna.top customboxes4less.com
corta.co cyclobenzaprinevstizanidine.blogspot.com
crirussian.ru cyse.tk
cwetochki.ru danashop.ru
dairyindia.in date-withme.com
data.vtc.pw dealighted.com
detmebel.su demenageur.com
dfwu1013.info derevesendeco.com
doctissimo.fr dev-seo.blog
domaineaneblanc.com directrev.com
dominateforex.ml div.as
download-of-the-warez.blogspot.com divci-hry.info
downloadeer.net drillsaw.ru
dvd-famille.com dvr.biz.ua
easync.io earncash.com.ua
educontest.net education-cz.ru
elite-sex-finders.com ekto.ee
electro-prom.com
en.altezza.travel
enbersoft.com
enginebay.ru enginebay.ru
escortplius.com esfchat.tk
essayservicewriting.org
evaashop.ru evaashop.ru
expertnaya-ocenka.ru extlabs.io
expolicenciaslatam.co f1nder.org
ezigarettenkaufen1.pagina.gr failingmarriege.blogspot.com
ezigaretteshop2.vefblog.net farm26.ru
faithe.top fickkontakte.org
fast-wordpress-start.com filefilter.weebly.com
fatfasts-4tmz.com finstroy.net
fbdownloader.com fiuxy.com
feorina.ru flauntyoursite.com
fickenbumsen.net foxydeal.com
fikasound.tk freemags.cc
filerockstar298.weebly.com gallerily.com
forex21.ru gameonasia.com
freenom.link gamingspark.com
fsakhalin.ru
funnymama.com
fyl.com.ru
fym.com.ru
gateway.zscalerone.net gateway.zscalerone.net
gay-file.com ggiaro.com
get-free-social-traffic.com golfresa.lucania.se
getmiro.com greatidea.marketing
gg.zzyjxs.com gungamesz.com
gk-atlant.info haveinc.xyz
global-ics.co.za hdpixion.com
gonextmedia.com hermesbelts.xyz
greenidesign.co himgaws.pw
gsasearchenginerankerhelp.com hollywoodactress.info
guod.me hop.clickbank.net
gz2.bbsoldes.fr house.sieraddns.com
hitsbox.info howmuchdoestizanidinecost.blogspot.com
hiwibyh.bugs3.com hundejo.com
homemature.net invivo.hu
hostingclub.lk iplusbit.blogspot.co.za
hothot.ru iqbazar.ru
houdom.net istizanidineanarcoticdrug.blogspot.com
hscsscotland.com itag.pw
huimin764128.com itsdp3.com
ihtec2019.org ivearchenceinflu.cf
images-graphics-pics.com javxxx18.com
images.gyffu.com jetsli.de
incanto.in.ua kabbalah-red-bracelets.com
iqupdatetmz.win kihi.gdn
isitwp.com kinocccp.net
itronics.ca kinogonew.ru
je7.us lakomka.com.ua
kaliningrad.zrus.org larchik.net
kam-dom.ru limtu.ifmo.ru
keyword-suggestions.com liupis.com
kinogolos.ru
kinohit1.ru
klumba55.ru
kongoultry.net
kosova.de
kountrylife.com
kredit-blog.ru
kredit-pod-zalog-krasnodar.ru
kupiproday.com.ua
kw21.org
kwzf.net
laptoper.net
law-check-eight.xyz
linkbolic.com
live-cam6.info live-cam6.info
liverpool.gsofootball.com loginduepunti.it
liveshoppersmac.com louboutinreplica.pw
lkbennettstore.online lovasszovetseg.hu
lookingglassemb.com lsex.xyz
lottospring.com macrotek.ru
macfix.life mainhp.net
makis.nu makemoneyonline.com
manuscript.su manifestation.betteroffers.review
marmotstore.online manve.info
masserect.com mediaoffers.click
matpre.top megaindex.ru
medicovi.com minecraft-rus.org
megaapteka.ru mnimmigrantrights.net
mirzonru.net mobot.site
misswell.net mojaocena.com
mnogolok.info moscow-clining.ru
mobifunapp.weebly.com mrbojikobi4.biz
moncleroutletonline.win mturkcontent.com
moroccosurfadventures.com muz-shoes.ru
msk-diplomat.com mygameplus.ru
mustwineblog.com nagdak.ru
namenectar.com naperehresti.info
njkmznnb.ru nastroyke.net
nordvpn.com negral.pluto.ro
obiavo.com nlfjjunb5.ru
odoratus.net noclegonline.info
odywpjtw.bloger.index.hr notebook-pro.ru
nudejapan.net
o.light.d0t.ru
obiavo.uz
of-ireland.info of-ireland.info
oneminutesite.it oksrv.com
online247.ml onclkads.com
onlinemegax.com onlinemegax.com
paleohub.info oranga.host.sk
partners-ship.pro ororodnik.goodbb.ru
partybunny.ru paintingplanet.ru
pdns.cz partner-print.men
percin.biz.ly pattersonsweb.com
pinwallpaper.xyz pelfind.me
pizdeishn.com pizda.lol
plohaya-kreditnaya-istoriya.ru plaff-go.ru
pokerniydom.ru porn555.com
polytopesexempt.com pornolook.net
pornhive.org
pornofiljmi.com
pornpost.in
pourvous.info
privatamateure.com
professionaldieselcare.com professionaldieselcare.com
projefrio.com.br prombudpostach.com.ua
quick-offer.com quick-offer.com
rankia.com ranksays.com
ratemodels.net rapidokbrain.com
redirectme.net referencemoi.com
reimageplus.com remybutler.fr
rennlist.com renewablewealth.com
rep-am.com rollercoin.com
rezeptiblud.ru running-line.ru
ribieiendom.no runstocks.com
rimedia.org salmonfishingsacramentoriver.com
ru-mediaget.ru sammlungfotos.online
russian-postindex.ru
russintv.fr
sanyuprojects.com sanyuprojects.com
sarahmilne.top scanner-andrew.top
searchlock.com scenicmissouri.us
sel-hoz.com seasonvar.ru
seoanalyses.com seoboxes.com
shitting.pro seofied.com
shlyahten.ru serdcenebolit.com
signx.info sexyteens.hol.es
simplesite.com shisha-swag.de
sitechecker.pro sisi-go.ru
site.ru
slavkokacunko.de
snts.shell-pmr.ru
social-vestnik.ru
soft-terminal.ru
solitaire-game.ru
sophang8.com sophang8.com
spy-app.info spb-plitka.ru
stathat.com spywarebegone.com
strana-krasoty.ru steebook.com
svarkagid.com stjamesschool.info
svtrd.com subj.ukr-lit.com
swagbucks.com superstats.com
teastory.co surcentro.com
teenporn18.net surgut.zrus.org
texbaza.by swiped.su
thedownloadfreeonlinegames.blogspot.com tattomedia.com
tizanidinehydrochloride2mg.blogspot.com tech4master.com
tizanidinesleepaid.blogspot.com templates.franklinfire.co
topclickguru.com thewebsitetemplate.info
torrentdownloadhub.com timecrimea.ru
turbodsp.com titan-cloud.life
turizmus.us tizanidineorflexeril.blogspot.com
tversvet.ru tizanidinerestlesslegsyndrome.blogspot.com
ultimatesetnewfreeallsoftupgradesystems.pw tn811.us
todohr.com
torrents.life
torrnada.ru
toxicwap.com
traffic100.com
trucri.me
ttsq.fr
twodollarshows.com
uogonline.com uogonline.com
urccvfmc.bloger.index.hr utiblog.fr
veles.shop valueclick.com
vellings.info vancleefreplica.pw
video-woman.com vbabule.net
vids18.site vchulkax.com
vinsit.ru venerologiya.com
vod.com.ua ventelnos.com
vvon.co.uk video-camer.com
webscouter.net videochat.ph
website-analyzer.info videooko.weebly.com
website-speed-check.site vrnelectro.ru
websitevaluebot.com vsdshnik.com
welck.octopis.com webextract.profound.net
westvilletowingservices.co.za weblo.com
wholesalejerseychinaoutlet.com wechatdownload10.com
winwotgold.pl winner7777.net
wwwadultcheck.com witherrom55.eklablog.fr
x-diesel.info worldhistory.biz
xn--b1agm2d.net worst-sites.online
xnxx699.com www.bookmaker-bets.com
yaminecraft.ru xingzi-vision.com
ynymnwbm.bloger.index.hr xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
za-music.mymobiplanet.com xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
zahvat.ru xn--90acenikpebbdd4f6d.xn--p1ai
zetgie.com.pl yebocasino.co.za
zooggames.com youresponsive.com
zeroredirect9.com
zhacker.net
zirondelli.it
zog.link
zrizvtrnpale.tk
zscalerone.net

12
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,21 +1,11 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html> ml><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.159 0; 10.1.0.95 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3069 ### Version: V4.2022.04.3070
### Updated: Tue Apr 26 22:01:17 UTC 2022 ### Updated: Wed Apr 27 10:03:25 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3069 ### Version: V4.2022.04.3070
### Updated: Tue Apr 26 22:01:17 UTC 2022 ### Updated: Wed Apr 27 10:03:25 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##