vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.02.2945 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-02-26 10:09:53 +00:00
parent 1c268067ce
commit 23ab0061a4
46 changed files with 89412 additions and 89412 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2944 #### Version: V4.2022.02.2945
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2944 #### Version: V4.2022.02.2945
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.02.2944 #### Version: V4.2022.02.2945
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11042
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.02.2944 #### Version: V4.2022.02.2945
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11046
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11046
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11046
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11046
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 1; 10.1.1.147 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 0; 10.1.1.147 0;
127.0.0.1 0; 127.0.0.1 0;

11046
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 1; 10.1.1.147 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 0; 10.1.1.147 0;
127.0.0.1 0; 127.0.0.1 0;

11046
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 1; 10.1.1.147 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 0; 10.1.1.147 0;
127.0.0.1 0; 127.0.0.1 0;

11046
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2944 2945

11046
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11046
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.157.38 0; 20.114.15.89 0;

11046
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 1; 10.1.1.147 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 0; 10.1.1.147 0;
127.0.0.1 0; 127.0.0.1 0;

11046
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 1; 10.1.1.147 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 0; 10.1.1.147 0;
127.0.0.1 0; 127.0.0.1 0;

11046
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 1; 10.1.1.147 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 0; 10.1.1.147 0;
127.0.0.1 0; 127.0.0.1 0;

11046
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.157.38 0; 20.114.15.89 0;

11046
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.157.38 0; 20.114.15.89 0;

11046
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 1; 10.1.1.147 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
JikeSpider BunnySlippers
Ninja GrapeFX
SMTBot JOC Web Spider
Seekport Lightspeedsystems
Sosospider Linkbot
Teleport Minefield
gopher PageGrabber
iubenda-radar WebEnhancer
sp_auditbot WebZIP
sysscan zgrab

294
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider
404checker 404checker
404enemy 404enemy
80legs
ALittle Client ALittle Client
ASPSeek
Aboundex Aboundex
Acunetix
AiHitBot
Aipbot Aipbot
Alexibot AlphaBot
Asterias BBBike
Atomseobot
BDCbot
BLEXBot BLEXBot
BackWeb
BacklinkCrawler
Badass Badass
Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga
BetaBot BetaBot
Bitacle Bigfoot
Blow BlackWidow
Boardreader BlowFish
Bolt Bolt
BuiltWith Brandprotect
Brandwatch
Bullseye
CATExplorador CATExplorador
CODE87 CODE87
CSHttp CSHttp
Calculon CherryPicker
CensysInspect
CheTeam
CheeseBot
Citoid
Claritybot Claritybot
Cliqzbot Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Cogentbot Cogentbot
Collector
Copier Copier
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Cosmos Cosmos
Craftbot Curious
Crawling at Home Project DBLBot
Crescent DTS Agent
DIIbot
Demon
Deusu Deusu
Devil
Disco Disco
Discoverybot Discobot
Dispatch
DittoSpyder DittoSpyder
DnyzBot DomainAppender
DomainCrawler Dotbot
Domains Project Download Wonder
Drip Drip
ECCP/1.0
EMail Siphon
EasyDL EasyDL
Ebingbong Ebingbong
Ecxi
Evil Evil
Ezooms Exabot
G-i-g-a-b-o-t ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
Fimap
FlashGet
Freeuploader
FyberSpider
GetWeb GetWeb
Getintent
Gigabot Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It GoZilla
GrapeFX Gotit
GridBot GridBot
HMView HTMLparser
HTTP::Lite HTTrack
Harvest Haansoft
HybridBot Havij
Iblog Heritrix
Id-search IDBTE4M
Image Sucker IlseBot
IndeedBot InterGET
InfoTekies Iskanie
Internet Ninja IstellaBot
JOC Web Spider
Jbrofuzz Jbrofuzz
JennyBot Jetty
JikeSpider JustView
Jorgee
Jyxobot Jyxobot
Kenjin Spider Lanshanbot
Kinza Leap
LexiBot LeechGet
Lftp LibWeb
LinkScan Likse
LinkWalker LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
Lipperhey Lipperhey
Litemage_walker Lmspider
MFC_Tear_Sample Ltx71
MIDown tool
MSFrontPage
MSIECrawler
MTRobot MTRobot
Magnet
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic12
MarkMonitor MarkMonitor
Meanpathbot Masscan
Metauri MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Mister PiX Mister PiX
Mojeek MolokaiBot
Mojolicious
Mozlila Mozlila
Msrabot Msrabot
Musobot Musobot
NICErsPRO
NPbot
Name Intelligence
NearSite
Needle Needle
Nessus NetSpider
Net Vampire Netcraft
NetLyzer NextGenSearchBot
NetZIP Nikto
Nibbler Ninja
NimbleCrawler Nuclei
Not Octopus
Offline Explorer
Offline Navigator Offline Navigator
OnCrawl OnCrawl
OpenVAS OpenLinkProfiler
Openfind
OrangeSpider OrangeSpider
PECL::HTTP OutclicksBot
PHPCrawl OutfoxBot
PageAnalyzer
PageGrabber PageGrabber
Pandalytics Pandalytics
PeoplePal Panscient
Pimonster Petalbot
PleaseCrawl Pi-Monster
Pockey Piepmatz
ProPowerBot
Probethenet Probethenet
Psbot Psbot
Pu_iN
Pump Pump
RankActive QueryN Metasearch
RankActiveLinkBot RankActiveLinkBot
RankFlex RankFlex
RankingBot Re-re
RankingBot2 ReGet
RankurBot RealDownload
Reaper RebelMouse
Recorder Recorder
RepoMonkey RepoMonkey
RocketCrawler SEOkicks-Robot
SBIder SEOprofiler
SEOstats SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScanAlert ScanAlert
ScoutJet Scanbot
Scrapy
ScrepyBot
SearchmetricsBot SearchmetricsBot
Seekport SentiBot
SemanticJuice SeoSiteCheckup
Semrush
SemrushBot
SeobilityBot SeobilityBot
SiteExplorer Siphon
SiteLockSpider Site Sucker
SmartDownload SiteSucker
Snake SlySearch
Snapbot
Snoopy Snoopy
SocialRankIOBot
Sosospider
SpaceBison SpaceBison
SpankBot Spinn3r
Spanner Sqlworm
Spbot
SputnikBot
Sqlmap
Sqworm Sqworm
Steeler Steeler
SuperBot Sucker
Surfbot Surfbot
SurveyBot
Suzuran Suzuran
T0PHackTeam
T8Abot T8Abot
Teleport Telesoft
Telesphoreo TheNomad
Telesphorep
Thumbor
Tracemyfile Tracemyfile
Trendictionbot
True_Robot
Turingos
TurnitinBot TurnitinBot
TwengaBot TwengaBot
Twice Typhoeus
URLy Warning URLy Warning
URLy.Warning URLy.Warning
VidibleScraper UnisterBot
Upflow
VeriCiteCrawler
Voil
WBSearchBot WBSearchBot
WEBDAV WEBDAV
WISENutbot
WPScan WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers/3.0 Wallpapers
WallpapersHD WallpapersHD
Web Auto WeSEE
Web Fetch
Web Sauger
Web Sucker
WebBandit
Web Fetch Web Fetch
Web Fuck Web Fuck
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebLeacher WebLeacher
WebPix WebPix
WebReaper WebWhacker
WebSucker WebZIP
WebmasterWorldForumBot Webalta
Whack Whacker
WiseGuys Robot Wonderbot
Woobot
Wotbox Wotbox
Wprecon YoudaoBot
Xaldon WebSpider
Zauba Zauba
ZmEu ZoomBot
ZumBot ZyBorg
archive.org_bot
arquivo.pt arquivo.pt
cah.io.community autoemailspider
check1.exe cognitiveseo
coccocbot com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler4j crawler4j
eCatch dataforseo.com
evc-batch
facebookscraper
instabid
iubenda-radar iubenda-radar
lwp-request lwp-request
mediawords lwp-trivial
magpie-crawler
muhstik-scan
page scorer
pcBrowser pcBrowser
plumanalytics plumanalytics
polaris version probe-image-size
ripz scalaj-http
s1z.ru
seobility seobility
seoscanners seoscanners
seostar seostar
serpstatbot serpstatbot
sexsearcher sexsearcher
siteripz sitechecker.pro
sp_auditbot sp_auditbot
spyfu
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com voyagerx.com
webprosbot webprosbot
xpymep1.exe xpymep1.exe
zauba.io zgrab

316
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 01h4x.com
404enemy 404checker
80legs 80legs
AIBOT
ALittle Client ALittle Client
Aboundexbot Aboundexbot
Acunetix AhrefsBot
AfD-Verbotsverfahren Aipbot
AllSubmitter AllSubmitter
Alligator Anarchie
Ankit Anthill
Apexoo Aspiegel
AwarioRssBot Asterias
AwarioSmartBot Atomseobot
Attach
BackDoorBot
BackStreet
BackWeb BackWeb
Badass Bandit
Battleztar Bazinga Bitacle
Black Hole Black Hole
BlackWidow
Blackboard
Blow Blow
Bolt Buddy
Brandprotect BuiltBotTough
Brandwatch
BuiltWith
BunnySlippers
BuzzSumo BuzzSumo
CCBot
Calculon
CensysInspect CensysInspect
CheeseBot CheTeam
CherryPicker CherryPicker
Chlooe
Citoid Citoid
Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
CopyRightCheck Collector
Copyscape CrazyWebCrawler
CrunchBot
Curious Curious
Custo
DBLBot DBLBot
DIIbot DataCha0s
DSearch
DTS Agent
Devil Devil
Digincore Digincore
Dirbuster DigitalPebble
Disco Disco
Discobot Discobot
Discoverybot
Dispatch Dispatch
DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DomainAppender DomainAppender
DomainCrawler DomainCrawler
Download Wonder DomainSigmaCrawler
Drip DomainStatsBot
Dotbot
EMail Wolf EMail Wolf
Ebingbong
Ecxi
EirGrabber
EroCrawler EroCrawler
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor ExtractorPro
Extreme Picture Finder EyeNetIE
FemtosearchBot
FlashGet FlashGet
Flunky
Foobot Foobot
Freeuploader
Fuzz Fuzz
FyberSpider FyberSpider
Fyrebot
GalaxyBot GalaxyBot
GermCrawler GermCrawler
GetWeb
Getintent
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It Gotit
GoZilla GrapeFX
GridBot
HEADMasterSEO HEADMasterSEO
HMView HTMLparser
HaosouSpider HTTrack
Haansoft
Havij Havij
Heritrix HonoluluBot
Humanlinks Humanlinks
HybridBot
IDBTE4M IDBTE4M
IDBot
IRLbot IRLbot
Iblog
Image Fetch Image Fetch
InfoTekies IndeedBot
Intelliseek Indy Library
InterGET
Internet Ninja Internet Ninja
InternetSeer Iria
Iskanie Iskanie
JamesBOT
Jbrofuzz Jbrofuzz
Kenjin Spider Jetty
Kozmosbot Keyword Density
LNSpiderguy
Lanshanbot Lanshanbot
Larbin
Leap
LeechFTP LeechFTP
Lftp Libwhisker
LibWeb Likse
LieBaoFast Linkbot
LinkWalker LinkpadBot
Linkdexbot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Lipperhey Spider LinqiaRSSBot
Litemage_walker LinqiaScrapeBot
MIIxpc Lipperhey
MQQBrowser MIDown tool
MJ12bot
MSFrontPage MSFrontPage
Mail.RU_Bot Magnet
Majestic SEO Majestic SEO
Majestic12 Majestic-SEO
MarkMonitor Mass Downloader
Masscan
Mata Hari Mata Hari
MauiBot MegaIndex.ru
Mb2345Browser MicroMessenger
Meanpathbot Minefield
Metauri
Microsoft Data Access
Mister PiX
Moblie Safari Moblie Safari
Mojeek
Mojolicious Mojolicious
Mozlila MolokaiBot
Mr.4x3
Msrabot
Musobot Musobot
NICErsPRO NICErsPRO
NPbot
Nameprotect Nameprotect
Navroad
NearSite NearSite
Needle
Net Vampire
NetLyzer NetLyzer
NetSpider
NetZIP NetZIP
Nimbostratus Netcraft
Octopus Netvibes
Openfind Nibbler
OrangeBot Nikto
Ninja
Nmap
Nutch
Offline Explorer
OutfoxBot
PHPCrawl PHPCrawl
Page Analyzer POE-Component-Client-HTTP
PageGrabber PageThing.com
Panscient
Papa Foto
Pavuk Pavuk
Pi-Monster Pixray
Picsearch PleaseCrawl
Piepmatz Pu_iN
ProPowerBot RankActive
Probethenet RankingBot2
RankActiveLinkBot Rankivabot
Re-re ReGet
RealDownload
Reaper
RebelMouse
Recorder Recorder
Rogerbot SEOkicks
SEOstats SEOlyticsCrawler
SISTRIX SEOprofiler
Scanbot SMTBot
ScoutJet Seekport
Screaming SemanticJuice
ScreenerBot SeobilityBot
Searchestate Site Sucker
SemrushBot SiteLockSpider
SentiBot
Siphon
SiteCheckerBotCrawler
SiteSnagger
Sitebeam Sitebeam
Siteimprove Siteimprove
Snake Sitevigil
Sociscraper Sogou web spider
SputnikBot SputnikBot
Sqlworm Sqlmap
Stripper Sqworm
Sucker
Sucuri Sucuri
Surfbot
SurveyBot
Swiftbot Swiftbot
T0PHackTeam T8Abot
Telesphoreo TeleportPro
Telesphorep Telesoft
TheNomad Toata
Thumbor Toweyabot
Trendiction Trendiction
Trendictionbot Trendictionbot
Turingos True_Robot
Twice Twice
URLy.Warning URLy.Warning
V-BOT UnisterBot
VCI VB Project
Vagabondo Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper VidibleScraper
WPScan Virusdie
Voltron
WASALive-Bot
WWW-Collector-E
WWW::Mechanize
Wallpapers Wallpapers
WallpapersHD WeSEE
Web Enhancer Web Collage
Web Pix
Web Sucker
WebAuto
WebBandit
WebFetch
Web Fuck Web Fuck
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSauger
Web Sucker Web Sucker
WebCollage
WebCopier
WebEnhancer
WebFuck
WebLeacher
WebSauger
WebWhacker
Webalta Webalta
WebmasterWorldForumBot
WebsiteExtractor
Website Quester Website Quester
Webster Whacker
Whack
Whatweb
Widow Widow
WiseGuys Robot Woobot
Wonderbot Wotbox
Wprecon Xaldon WebSpider
Zade YoudaoBot
Zauba
Zermelo Zermelo
Zitebot
ZmEu
ZoomBot
ZyBorg ZyBorg
arquivo-web-crawler arquivo-web-crawler
arquivo.pt
autoemailspider autoemailspider
backlink-check backlink-check
cah.io.community cah.io.community
clark-crawler coccocbot
crawler.feedback crawl.sogou.com
demandbase-bot crawler4j
eCatch eCatch
evc-batch evc-batch
heritrix gopher
instabid ips-agent
internetVista monitor
isitwp.com
iubenda-radar iubenda-radar
netEstate NE Crawler lwp-request
lwp-trivial
magpie-crawler
mediawords
oBot oBot
pcBrowser page scorer
polaris version polaris version
probe-image-size satoristudio.net
scan.lol seocompany.store
seostar
serpstatbot serpstatbot
siteripz sp_auditbot
sogouspider
spyfu
trendiction.com trendiction.com
webgains-bot trendiction.de
webmeup-crawler webmeup-crawler
x22Mozilla webpros.com
webprosbot
x09Mozilla
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
betterhdporn.com awaybird.ru
bigpictures.club break-the-chains.com
fortwosmartcar.pw cam-kontakte.org
hoste.octopis.com geilehausfrauen.net
mirobuvi.com.ua moscow-region.ru
monsterdivx.com shopsellcardsdumps.com
ningessaybe.me sientalyric.co
parvezmia.xyz thegolfclub.info
shariki-zuma-lines.ru videokrik.net
supermodni.com.ua westermarkanjou.se

916
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1000n1.ru 101flag.ru
100searchengines.com 12u.info
11235813.webzdarma.cz 24-ak.ru
2015god.org 2x2fan.ru
23kw.ru 7ooo.ru
3rbseyes.com
3xforum.ro
7yue.org 7yue.org
883zy.com 991mostfm.co.id
8lufu.com 999webdesign.com
8si.ru aa81bf391151884adfa3dd677e41f94be1.com
aanapa.ru absolutelyanalog.com
abbanreddy.com addtoadd.men
abcguru.xyz ads.gold
abwa.tk ads.tremorhub.com
actulite.com adsland.men
adclickservice.com advokat-grodno.by
adconscious.com aero2.ru
adloads.com agapovdg.ru
adloads.net agroeconom.kz
admitad.com agysya.ru
adprotect.net air-edem.ru
adsfresh.men aksonural.ru
aerogo.com alekseevec.ru
aibolita.com alfa-img.com
airlandsea.info all4invest.ru
alert-jdh.xyz alldownload.pw
alienwheels.de allesohnegirls.net
allblogroll.com alloysteel.ru
alldezservice.kz altamayoztourism.com
alot.com alveris.ru
alvtank.se am-se.com
amt-k.ru anabolics.shop
anatomiy.com android-style.com
aosheng-tech.com apartmentratings.com
ap.senai.br apelsinnik.website
apiallgeniusinfo-a.akamaihd.net apiluckyleapnet-a.akamaihd.net
apispringsmartne-a.akamaihd.net apioutoboxnet-a.akamaihd.net
appsecurityr.com appsaurus.com
arate.ru apxeo.info
arkartex.ru arius.tech
asacopaco.tk asrvvv-a.akamaihd.net
asophoto.com atlasvkusov.ru
atofilms.com audiobangout.com
autobudpostach.club australia-opening-times.com
autotrends.today autoloans.com
autowebmarket.com.ua autoseo-traffic.com
avek.ru azarttoto.com
avon-novosib.ru bablonow.ru
azbukadiets.ru balook.com
backlink4u.net basisches-wasser.net
bagcionderlab.com beauty-clinic.ru
balkanfarma.org becuo.com
bannerconnect.net bikini-image.com
bashtime.ru
bavsac.com
beget.tech
best-games.today
bestdooz.com
bestimagecoollibrary.com
bestplacetobuyeriacta.jw.lt
bidbuy.co.kr
biketank.ga
billiard-classic.com.ua billiard-classic.com.ua
blackhatworth.com bimatoprost-careprost.com.ua
blobar.org bitcoinpile.com
blpmovies.com biznesschat.net
bmw-ark.ru bjorkbacken.nu
boanonihaca.tk
bolegapakistan.com bolegapakistan.com
boleznikogi.com
bolezniorganov.ru
bongiornos.info
bonzibuddi.com bonzibuddi.com
bpro1.top bpro1.top
braip.com.br brandehk.dk
brandov.ru brianhenry.co
brokergid.ru brk-rti.ru
btnativenav.com brothers-smaller.ru
buyfriend.ru btvn.ru
calc-for-credit.ru buehne-fuer-menschenrechte.de
callcafe.info buketeg.xyz
carina-sy.de buy-loft.ru
buyclomidonlaine.com
buydissertation.net
buyessayonline19.blogspot.ru
buzz-porno.info
bzero1jewelry.net
c1.onedmp.com
calcularpagerank.com
candiceloves.us
candy-glam-hp.com
cannibalcheerleader.com
canrioloadm.gq
cardiosport.com.ua
cardul.ru
carloans.com
cartierlovestore.com
cartierreplica.top cartierreplica.top
cartujano-pre.de cartierreplica.win
cascadelink.org cartiertrinity.xyz
cbb1smartlist12.click celebsopics.com
cementaresearch.se chocoslim.pro
censys.io christianlouboutinsaleoutletonline.us
chatroulette.online cialischstgerts.com
checkhit.com
cherubinimobili.it
chinacheapelitejerseys.com
chinaelitecheapjerseys.com
cialiswithoutadoctor.net
cinemaenergy-hd.ru
cinemaflix.website cinemaflix.website
cjmc.info click2pawn.com
clicksor.com clickintext.net
cognitiveseo.com clksite.com
collegeessay19.blogspot.ru coderstate.com
cometorussia.net concordexoticrentals.com
commoncrawl.org conocer-sanabria.com
compliance-barak.top cool-wedding.net
compucelunlock.net coolbar.pro
cookie-law-enforcement-ee.xyz cowlmash.com
coop-gamers.ru customsua.com.ua
copro.pw cwetochki.ru
crazyprotocol.com cypernhuset.se
credit-online.ws cyse.tk
d2jsp.org ddsoldes.fr
data.vtc.pw defenderxtactical.com
dawlenie.com dentfidemountpreach.tk
deanmoore.ie derevesendeco.com
dellalimov.com dfwu1013.info
descargar-musica-gratis.net digitalassetmanagement.site
deshevo-nedorogo.ru dimfour.com
deutschland123.de diusyawiga.tk
dev78.dioniqlabb.se diy-handmade-ideas.com
dfiles.me documentbase.net
dipstar.org doeco.ru
discovertreasurenow.com domaincdn.xyz
divku.ru dostavka-v-ukrainu.ru
djonwatch.ru downvids.net
dmmspy.com doyouknowtheword-flummox.ml
docs4all.com drillsaw.ru
doctormakarova.ru drugs-no-rx.info
documentsite.net dvr.biz.ua
domain.webkeyit.com ebonyporn.site
domainsatcost.com ebooknovel.club
duplicashapp.com eduserver.net
dustyorate.com ekaterinburg.xrus.org
e-commerce-seo.com
e-kwiaciarz.pl
e705.net
e90post.com
earthmagic.info
econom.co
edge.sharethis.com
editors.choice6912650.hulfingtonpost.com
ekto.ee ekto.ee
electricwheelchairsarea.com el-nation.com
elektrischezigaretten2.beeplog.com elektronischezigarettekaufen1.beeplog.com
emerson-rus.ru elektrozigaretten1.postbit.com
energydiet24.ru elitepcgames.com
eredijovon.com enpolis.ru
erot.co eupornstar.info
europeanwatches.ru euromasterclass.ru
eurosamodelki.ru
excitacao.com
eyes-on-you.ga
ezb.elvenmachine.com ezb.elvenmachine.com
ezigaretteshop2.vefblog.net f-loaded.de
fanpagerobot.com familienzahnaerzte.com
farmingworm.com fanrto.com
fast-torrent.ru farmprofi.net
feorina.ru fba-mexico.com
fickblock18.com feargames.ru
filkhbr.com ff30236ddef1465f88547e760973d70a.com
filmania-x.ru fickenprivat.info
fitfloponline.store fifa-coins.online
floridahuntingfishingadventures.com filmidivx.com
flprog.com findthe.pet
forexgb.ru fm-upgrade.ru
forexunion.net footballfarrago.com
forms-mtm.ru forums.d2jsp.org
fotosfotos.eu foxweber.com
fotoxxxru.com
foxydeal.com
fr-bearings.ru
franch.info
franecki.net franecki.net
freenode.info free-deals.faith
freewareseek.com free-traffic.xyz
frivgame250.com frvo.alptandem.ru
funnypica.com fsalas.com
galaxyflowers.ru fullgirl.ru
game-mmorpg.net
gamedayassist.com
gamerextra.com gamerextra.com
get-free-social-traffic.com geckoandfly.com
getaclueamerica.com geileweiber.tk
getmiro.com genericlowlatencyasiodriverhq.aircus.com
gettpromos.com get-free-traffic-now.com
gigixo.com gg-arena.ru
glass-msk.ru girlgamerdaily.com
goblacked.com girls-ufa.ru
gojiberriess.apishops.ru girlsatgames.ru
googglet.com girlsfuckdick.com
graphics8.info glavtral.ru
graphicwe.org glogow.pl
grizzlysgrill.com goldandcard.ru
guod.me gombita.info
hannasolution.ru gratuitbaise.com
hermesreplica.win greamimgo.pw
greatgrace.ru
gta-top.ru
gwebtools.com
handsandlegs.ru
hanink.biz.ly
harmonyglen.us
hdimagegallery.net
healbio.ru
hentaiheroes.com
hit-men.men
hjaoopoa.top hjaoopoa.top
homedecoguide.info hobbyhuren-datenbank.com
homeinns.com hobbyhuren24.net
hopeonthestreet.co.uk homeart.space
hoverboard360.de hornymatches.com
hspline.com hoste.octopis.com
hybrid.ru hotblognetwork.com
hyipmanager.in hoverboard360.nl
hystersister.com htmlcorner.com
iblogpress.xyz hyhj.info
ictizanidinehcl4mg.blogspot.com ifmo.ru
ie.57883.net ilbe.club
igru-xbox.net imagecoolpub.com
ihtec2019.org
ilmexico.com
iloveitaly.ru
imgata.com imgata.com
impisr.edunsk.ru imk.com.ua
import-sales.com infazavr.ru
inbabes.sexushost.com insider.pro
inmate-locator.us
inspiring-desperate.tk inspiring-desperate.tk
interior-stickers.ru iskalko.ru
iqs.biz.ua istizanidineanopiate.blogspot.com
ispac.org itrevolution.cf
istripper.com iweblist.info
ixora.pro janettabridal.com
izoll.ru
jacago.com
janavibekken.no
jav-fetish.site
jav-idol.com jav-idol.com
javspace.net javitas.info
je7.us jaxcube.info
jerseywholesalebizchina.com junketjuice.blogspot.com
jobmarket.com.ua jus0wil.pp.ua
journalhome.com justprofit.xyz
jrpmakati.com katadhin.co
kamen-e.ru kazan.xrus.org
keyhantercume.com kchaxton.com
keywordspay.com kerei.ru
kinozapas.com keywordhut.com
keywords-monitoring-success.com
khafre.us
kihi.gdn
kit-opt.ru kit-opt.ru
klikbonus.com klitimg.pw
kolotiloff.ru konteiner24.com
kongoultry.net krafte.ru
koopilka.com kraljeva-sutjeska.com
kostenlos-sexvideos.com
krasivoe-hd.net
kreativperlen.ch
kurwa.win kurwa.win
kvartira-sutochno.com lecbter-relationships.ga
lafourmiliaire.com lesbian.xyz
lafriore.ru lietaer.com
lancheck.net lifeinsurancekb.com
landscapebackgrounds.blogspot.com lignofix.ua
laptop-4-less.com link.ac
lashstudia.ru linkrr.com
laulini.soclog.se lirunet.ru
ldrtrack.com localflirtbuddies.com
li-er.ru lovelycraftyhome.com
liquimondo.com lovi-moment.com.ua
littlesunraiser.com lsp-awak-perikanan.com
locationdesaison.com lumb.co
long-beach-air-conditioning.com maladot.com
lovasszovetseg.hu malls.com
makemoneyonline.com
makis.nu
mamasuper.prom.ua mamasuper.prom.ua
manifestation.betteroffers.review manimpotence.com
map028.com
mastershef.club
matchpal-a.akamaihd.net
max-p.men
meccadumps.net meccadumps.net
medi-fitt.hu
mediafresh.online mediafresh.online
mediawhirl.net mediawhirl.net
medmajor.ru megahdporno.net
medosmotr-ufa.ru mexicotravelnet.com
meget.co.za
mejoresfotos.eu
members.ghanaweb.com
metalonly.info
michaelkorssaleoutletonline.net
middlerush-a.akamaihd.net middlerush-a.akamaihd.net
mnogolok.info mikrobiologies.ru
monarchfind-a.akamaihd.net minegam.com
monclerjacketsoutlet.pw mir-limuzinov.ru
moncleroutletonline.win misterjtbarbers.com
monsterdivx.tv mmoguider.ru
morocco-nomad-excursions.com mobile-appster.ru
mobplayer.ru
moi-glazki.ru
money-every-day.com
moneymaster.ru
morpicert.pw morpicert.pw
moskva.nodup.ru mountainstream.ms
mrbitsandbytes.com mrmoneymustache.com
musicstock.me msk.afora.ru
musirc.com muabancantho.info
muycerdas.xxx musezone.ru
myfreemp3.eu music7s.me
myhealthcare.com musicdaddy.net
mylida.org mvpicton.co.uk
mylovelibrabry.com mybinaryoptionsrobot.com
mywallpaper.top mykings.pw
na15.ru myliveblog.ru
nagdak.ru
narco24.me
nastydollars.com
naturalbreakthroughsresearch.com naturalbreakthroughsresearch.com
nbsproject.ru needtosellmyhousefast.com
neks.info neodownload.webcam
nerudlogistik.ru netvouz.com
netfacet.net nextrent-crimea.ru
netoil.no nikhilbahl.com
netpics.org nomuos.it
nextbackgroundcheck.gq notfastfood.ru
nikkiewart.ru o-o-11-o-o.com
njkmznnb.ru obsessionphrases.com
nullrefer.com offers.bycontext.com
oakleyglassesonline.us officedocuments.net
obiavo.by one-gear.com
of-ireland.info online-sbank.ru
offtime.ru
okuos.com
oneshotdate.com
online-x.ru online-x.ru
onlinemegax.com onlinewritingjobs17.blogspot.ru
onlythegames.com open-odyssey.org
ontargetseo.us otbelivanie-zubov.com
ooomeru.ru oynat.info
openstat.com
ordernorxx.com
orgasmus-virtual.com
osnova3.ru
ownshop.win
oxotl.com
oz-offers.com oz-offers.com
paparazzistudios.com.au papasdelivery.ru
patterntrader-en.com par-fallen.ga
pattersonsweb.com parajumpersjakkesalgnorge.info
pensplan.com pc-services.ru
perederni.net pcimforum.com
pdamods.ru
perosan.com
pestomou.info
picsforkeywordsuggestion.com picsforkeywordsuggestion.com
pictures-and-images.com piluli.info
pijoto.net pio.polytopesexempt.com
pixell.club
pixelrz.com pixelrz.com
platezhka.net pixshark.com
ploenjitmedia.azurewebsites.net placid-rounded-coast.glitch.me
pogodnyyeavarii.gq plastgranar.nu
pogruztehnik.ru poem-paying.gq
polska-poezja.com pons-presse.com
pooleroadmedicalcentre.co.uk poppen-nw.net
popads.net popup-hgd.xyz
pornobrazzers.biz porno-transsexuals.ru
pornogad.com pornofeuer.com
pornogratisdiario.com pornoklad.ru
pornophoto.xyz pornophoto.xyz
pornstartits.xblog.in pospr.waw.pl
portadd.men preventheadacheguide.info
portside.cc printdirectforless.com
prefersurvey.net printingpeach.com
preparevideosafesystem4unow.space prod2016.com
pretty-mart.com prodess.ru
printie.com producm.ru
privat-girl.net
prize44.com
prokotov.com
promodj.com
psa48.ru psa48.ru
pussysaga.com py100.ru
questionmarque.ch qexyfu.bugs3.com
rangjued.com quebec-bin.com
ranksonic.com qwarckoine.com
r-e-f-e-r-e-r.com
rapevideosmovies.com
rarbg.to
rating-casino2021.ru
razamicroelectronics.com
realnye-otzyvy.info realnye-otzyvy.info
registrationdomainsite.com regdefense.com
rent2spb.ru registry-cleaner.net
rethinkwasteni.info remmling.de
ricorsogiustizia.org remont-fridge-tv.ru
rightenergysolutions.com.au remont-ustanovka-tehniki.ru
roma-kukareku.livejournal.com rfd-split.hr
rus-teh.narod.ru rfserial.net
rusprostitute.com rome2rio.com
russkoe-zdorovie.ru rossmark.ru
sa-live.com royalcar-ufa.ru
sale-japan.com rp9.ru
sampleletters.net rvi.biz
savetubevideo.com samara.rosfirm.ru
scanner-george.top saneyes.com
scanner-jack.top sanjosestartups.com
scanner-margo.top sarf3omlat.com
scoopquest.com satellite.maps.ilovevitaly.com
sdelatmebel.ru scanner-alex.top
security60-e.com scanner-fred.top
scanner-mark.top
scanner-marwin.top
scrapinghub.com
search.1and1.com
searchengineranker.email
searchkut.com
searchtooknow-a.akamaihd.net
secretscook.ru
seinterface.com seinterface.com
seksotur.ru seksotur.ru
semxiu.com selectads.men
seo18.su seoexperimenty.ru
seoboxes.com seolab.top
servisural.ru serialsway.ucoz.ru
sex-znakomstva.online seryeznie-znakomstva.ru
sex-foto.pw
sexblog.pw sexblog.pw
sexfreepornoxxx.com sexfreepornoxxx.com
sexkontakteao.info sexgalleries.top
ship-marvel.co.ua sexs-foto.com
silktide.com shikiso.info
site-speed-checker.site shitmovs.com
siteripz.net shitting.pro
sitopreferito.it sierraapps.com
slkrm.ru sigmund-freud.co.uk
small-games.biz sildenafil-tadalafil.info
smart-balancewheel.com sinestesia.host.sk
smart-scripts.com sisiynas.ru
sklad-24.ru
skutecznetabletkinaporostwlosow.pl
sledstvie-veli.net
slowmacfaster.trade
sluganarodu.ru
smartshoppymac.com smartshoppymac.com
smstraf.ru snts.shell-pmr.ru
soaksoak.ru socialmadesimple.com
social-s-hhh.xyz
socialseet.ru
soft-terminal.ru
sogimlecal.tk sogimlecal.tk
spb.ru solution4u.com
sports-supplements.us sonnikforme.ru
spravka130.ru spywarespy.com
sribno.net srdrvp.com
star61.de stair.registrydomainservices.com
starpages.net stardevine.com
stefanbakosab.se steelmaster.lv
stillmiracle.com strongholdsb.ru
store-rx.com strv.se
strag-invest.ru students-cheapskate.ml
strana-solnca.ru supermesta.ru
stroy-portal22.ru superstats.com
stroymonolit.su surffoundation.nl
sumo.com surflinksmedical.com
surgut.zrus.org svarkagid.com
suture.co svetodiodoff.ru
syndicate.fun taxi-v-eisk.ru
tackletarts.co td-33.ru
template-kid.com technopellet.gr
theallgirlarcade.com thebestphotos.eu
themestotal.com theendivechronicles.com
thexart.club
thruport.com
tiandeural.ru
tilido.com
tizanidine4mg.blogspot.com tizanidine4mg.blogspot.com
tizanidinedosage.blogspot.com tizanidineinteractions.blogspot.com
tizanidinehcl4mgtab.blogspot.com tizanidinepain.blogspot.com
tizanidinehydrochloride2mg.blogspot.com tksn.ru
tizanidinerestlesslegsyndrome.blogspot.com top10registrycleaners.com
tnaionline.org topads.men
topdownloads.ru topanasex.com
torrentdownloadhub.com
tourcroatia.co.uk
toys.erolove.in toys.erolove.in
trafaret74.ru tpu.ru
trafficmp.com tracxn.com
trafficshaper.com trafficjunky.net
triplepanda.xyz trichizobswiv.agddns.net
trucri.me tuberkuleznik.ru
trustedmaccleaner.com turbabitload.weebly.com
tryrating.com u17795.netangels.ru
tzritel.tk ultimatesetnewfreeallsoftupgradesystems.pw
unlimitdocs.net unitexindia.com
uroffer.link urdoot.win
ussearche.cf us-america.ru
vacuumscleaner.com usswrite.com
vadimkravtcov.ru ustion.ru
validdomain.xyz vchulkah.net
valueclick.com vchulkax.com
via-energy-acquistare.com vegan-foods.us
via-gra.webstarts.com velen.io
videochat.life via-energy-cumpara.com
videochat.mx viagra.pp.ua
vikistars.com video-hollywood.ru
vipsexfinders.com videogamesecrets.com
vipsiterip.org videooko.weebly.com
virus-respirators.com videospornogratisx.net
visa-china.ru vietimgy.pw
visa-pasport.ru vkmusics.ru
vodkoved.ru vodaodessa.com
watracker.net vseigru.one
wdfdocando.com vzlomfb.com
wdrake.com
we-are-gamers.com
webcamdevochka.com webcamdevochka.com
webmasterhome.cn weekes.biz.tc
website-analytics.online westen-v.life
wedding-salon.net westvilletowingservices.co.za
wemedinc.com wfb.hatedriveapart.com
weprik.ru whengirlsgowild.com
wingsoffury2.com wildnatureimages.com
wladimirpayen.com
wma-x.com
woman-tampon.ru
wordpresscore.com
worldoffiles.ru worldoffiles.ru
wosik-dach.service-for-web.de
woweb.com.ua woweb.com.ua
writingservices17.blogspot.ru www.888.com
x-diesel.info x-lime.net
x-rates.ru xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
x-stars.ru xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai xn----btbdvdh4aafrfciljm6k.xn--p1ai
xn----ctbbcjd3dbsehgi.xn--p1ai xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xn----itbeirbjbi7bc6bh2d.xn--p1ai xn--80ak6aa92e.com
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai xn--b1ag5cfn.xn--p1ai
xn--c1acygb.xn--p1ai xn--e1aggki3c.xn--80adxhks
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai xn--hxazdsfy.blogspot.com
xsfetish.org xolodremont.ru
xxxhdvideo.site xxxmania.top
yebocasino.com xxxtubesafari.com
yogamatsexpert.com you-shall-not-pass.is74.ru
youradexchange.com youtuhe.com
youtubedownload.org zacreditom.ru
ypmuseum.ru zajm-pod-zalog-nedvizhimosti.ru
zarabotok--doma.ru zajm-zalog-krasnodar.ru
zeroredirect12.com zaobao.com.sg
zlatnajesen.com zarajbuilders.com
znakom.sibtest.ru zazagames.org
zojirushi-products.ru zdesoboi.com
zoogdinsney.com zeroredirect6.com
zverokruh-shop.cz zigarettenonlinekaufen1.bloog.pl
zx6.ru zigzog.ru
zoolubimets.ru
zophim.me
zscalertwo.net
zvooq.eu

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0n-line.tv 1-free-share-buttons.com
123cha.com 3-letter-domains.net
273-fz.ru 4istoshop.com
4webmasters.com 55wmz.ru
83net.jp 5forex.ru
adultnet.in 7a2rnuey1tw9ar.ru
agapovdg.ru abbanreddy.com
ahmedabadwebs.com acc.eu.org
akusherok.ru acheterviagrafr24.com
alert.scansafe.net adconscious.com
alfabot.xyz adultfriendfinder.com
alldubai.biz adventureparkcostarica.com
allmarketsnewdayli.gdn adverster.com
alpharma.net adviceforum.info
am-se.com agahinameh.com
amazon-adsystem.com alarmobninsk.ru
ample-awards-today.us analytics-ads.xyz
anticrawler.org ananumous.ru
apioutoboxnet-a.akamaihd.net anniemation.com
arendovalka.xyz artparquet.ru
arius.tech atlant-auto.info
atley.eu.pn aucoinhomes.com
atout-energie-69.com azlex.uz
autonew.biz bagcionderlab.com
aviav.ru.com bambi.ck.ua
avon-novosib.ru bestcalovebracelet.cn
avon-severozapad.ru bezsporno.ru
avtolombard-krasnodar.ru bg6s0.com
azte.ch bio-optomarket.ru
best-games.today bioca.org
bildsuche.ru bizlist.com.de
bjgugu.net.ua blagovest-med.ru
blogporn.in blavia.00author.com
bmw-ark.ru board.f00d.de
brainboostingsupplements.org boeuklad.com
brillianty.info brg8.com
bristolhotel.com brianhenry.co
businesxxl.com browsepulse-a.akamaihd.net
buyantiviralwp.com budpost.com.ua
buyessayonline19.blogspot.ru bumble.cheapwebsitehoster.com
charmstroy.info buqyxa.rincian.info
cheapmoncler.win buy-cheap-pills-order-online.com
chinese-amezon.com buyessaynow.biz
chocolateslim-u-srbiji.com bvlgaribracelet.xyz
cialischmrx.com carina-sy.de
clickaider.com cartierwatch.xyz
clickhype.com cdncash.net
compliance-jane.top cheap-pills-norx.com
compliance-walt.top cheapjerseysa.com
consorzioilmosaico.org chidporn.com
converse.ddsoldes.fr choice-credit.ru
cookie-law-enforcement-aa.xyz christianlouboutinoutlet.win
credit-online.ws cicaki.net
creditmoney.com.ua ciekawinki.pl
cyprusbuyproperties.com compliance-ivan.xyz
czeshop.info compliance-willy.top
date-withme.com cookie-law-enforcement-ff.xyz
deplim.com cutt.us
discovertreasure-a.akamaihd.net cymbaltaandtizanidine.blogspot.com
dokumentalkino.net dailyfinancefix.com
downloaddy.net deanmoore.ie
drugs-no-rx.info dentalpearls.com.au
dumuelave.xyz detoxmed24.ru
e-commerce-seo.com deutschland123.de
dogclothing.store
dogsrun.net
doska-vsem.ru
dotnetdotcom.org
downtuptv.gq
dpihatinh.gov.vn
dtm-spain.com
e90post.com e90post.com
eandsgallery.com eachdayisagift.review
elektir.ru econom.co
elektrischezi.canalblog.com ecxtracking.com
ero-advertising.com emailaccountlogin.co
essay-writing.work erotische-geschichten-xxl.com
etm-consult.de eupornstar.info
exchanges-bet.com euroskat.ru
ezofest.sk exchangeit.gq
fdzone.org ezigarettenkaufen1.deviantart.com
fealq.com fapgon.com
fiuxy.com farm26.ru
flashahead.info fickluder69.com
fordsonmajbor.cf fikasound.tk
formulaantiuban.com filmgo.ru
forum69.info fiverr.com
frighteningremain.cf flowersbazar.com
fun2cell.net focalink.com
fxtips.ru fortevidyoze.net
gamedayhouse.com foto-sisek.porngalleries.top
gateway.zscalertwo.net free-video-tool.com
gay-site.store freewhatsappload.com
gazoblok.net.ua frustrated-favorable.gq
geckoandfly.com fuckbuddybestgilf.info
goodhousekeeping.com game-mmorpg.net
gosreg.amchs.ru gay.adultgalls.com
gsmtlf.ru gov.yanao.ru
guitar-master.org graphics8.info
hdhc.ru graphicwe.org
himazin.info gsasearchengineranker.top
hotelcrocenzi.sm gwhwpxbw.bloger.index.hr
hoverboard360.se gyffu.com
hully.altervista.org hdfreeporno.net
i4track.net hotsocialz.com
id-forex.com howopen.ru
ikearugs.xyz howtowhitenteethfast.xyz
inet-traffic.com huimin764128.com
infoupdate.org hydropump.su
innoslicon.com ihc2015.info
internetproviderstucson.com iideaidekonkatu.info
j-times.ru iqoption-bin.com
james13prix.info it-max.com.ua
jerseychinabizwholesale.us jaxcube.info
karadene.com kaac.ru
karting196.ru kabbalah-red-bracelets.com
katushka.net keywordsuggest.org
kenaba.su kinostorm.net
kmd-pto.ru kiwi237au.tk
kosova.de kopihijau.info
kvartira-sutochno.com kovrenok.ru
larchik.net lacapilla.info
lenpipet.ru levaquin750mg.blogspot.com
lenvred.org lifeinsurancekb.com
lifebyleese.com liveinternet.ru
linkarena.com lkbennettoutlet.online
livesex-amateure.info longlifelomilomi.info
locksmith.jp lordzfilmz.me
lookingglassemb.com lottospring.com
lostfilm-online.ru louisvuittonoutletstore.net
louboutinreplica.pw lovi-moment.com.ua
lutherstable.org lyrics.home-task.com
lyngdalhudterapi.no m4ever.net
marketingvici.com madot.onlinewebshop.net
masturbate.co.uk malls.com
manve.info
marketland.ml
masterseek.com
meccadumps.net
medicinacom.ru medicinacom.ru
medicovi.com
medmajor.ru
meetlocalchicks.com
megagrabber.ru
megahdporno.net megahdporno.net
mejoresfotos.eu mir-betting.ru
minneapoliscopiers.com misterjtbarbers.com
mojpreskumanie.com mobifunapp.weebly.com
monarhs.info mrcsa.com.au
movpod.in mrinsidesales.com
mrbitsandbytes.com musicspire.online
musezone.su musicstock.me
muz-tracker.net
myfreetutorials.com
myra.top
mzdish.site
nastroyke.net nastroyke.net
netallergy.ru o.light.d0t.ru
netanalytics.xyz
new-post.tk
nextconseil.com
nextrent-crimea.ru
nfljerseyscheapbiz.us
nicovideo.jp
o-o-6-o-o.com
obiavo.in
officedocuments.net
oil-td.ru
okayimage.com
okonich.com.ua okonich.com.ua
one.net.in onefilms.net
orhonit.com orhonit.com
osoznanie-narkotikam.net pagesense.com
paceform.com pandroid.co
partnerads.men pewit.pw
petedrummond.com photosaga.info
pictures-and-images.com picurams.pw
playfortuna-play.ru pk-pomosch.ru
playlott.com pornoslive.net
porndl.org
porno-home365.com
porno-transsexuals.ru
pornohub.me
positive2b.ru positive2b.ru
prizesbook.online preconnubial.usuby.site
proekt-gaz.ru pregnant.guru
ptr.ruvds.com preparevideosafesystem4unow.site
quangcaons.com printie.com
quelle.ru raschtextil.com.ua
rasteniya-vs-zombi.ru richinvestmonitor.com
recipedays.com rixpix.ru
redbottomheels.xyz rock-cafe.info
reeyanaturopathy.com ros-ctm.ru
remote-dba.de ruf777.com
rfd-split.hr s-forum.biz
rostov.xrus.org savetubevideo.com
rutor.vip scanner-jack.top
saitevpatorii.com scansafe.net
sashagreyblog.ga sdrescher.net
sbprabooks.com searchimage.co
scanspyware.net searchtooknow-a.akamaihd.net
seasonvar.ru semrush.com
seksotur.ru sex-znakomstva.online
semprofile.com sexgalleries.top
seorankinglinks.com shitmovs.com
sex-dating.co shop-electron.ru
sexs-foto.com shop.acim.org
sexyebonyteen.com sibvitr.ru
sexyteens.hol.es sitevaluation.org
siteexpress.co.il sky-mine.ru
sk.golden-praga.ru skypasss.com
skachat-besplatno-obrazcy.ru smailik.org
slayerlife.com small-games.biz
smart-balancewheel.com socas.pluto.ro
softxaker.ru socialtrade.biz
spb-plitka.ru sport-video-obzor.ru
sr-rekneskap.no
srdrvp.com
stackthatbucks.com
stathat.com stathat.com
strongsignal-a.akamaihd.net streetfire.net
studiofaca.com stroiminsk.com
sundrugstore.com superkanpo.com
svolze.com surffoundation.nl
taraz.xkaz.org survival.betteroffers.review
teencastingporn.com svtrd.com
thecoral.com.br symbaloo.com
tizanidinedosageforsleep.blogspot.com telefonsexsofort.tk
tizanidinehcl2mg.blogspot.com thebitcoincode.com
tizanidinehcl4mgisitanarcotic.blogspot.com thetoiletpaper.com
tizanidinecapsules.blogspot.com
tizanidinestreetprice.blogspot.com tizanidinestreetprice.blogspot.com
token-lab.org toloka.hurtom.com
toolsky.com
top-study.work
top10registrycleaners.com top10registrycleaners.com
topshef.ru traffic2cash.org
torrents-tracker.com trafficfactory.biz
trackzapper.com trafficshaper.com
tripper.de triplepanda.xyz
tversvet.ru typimga.pw
twittrading.com u-cheats.ru
vabasa.inwtrade.com ua.tc
vadimkravtcov.ru uhdtv.website
vezuviy.su umg-stroy.ru
via-energy-order.com
visitcambridge.org
wapsite.me wapsite.me
web-betting.ru wareseeker.com
webkeyit.com waterefficiency.co
webpromotion.ae webix.biz
websiteaccountant.de wedding-salon.net
welck.octopis.com whatsupinfoley.com
westen-z.life winner7777.net
white-truck.life witherrom55.eklablog.fr
wholesalejerseyscheapjerseys.us.com worldhistory.biz
wonderfulflowers.biz x-mix.info
works.if.ua xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
woweb.com.ua
wpthemedetector.co.uk
wygraj-skiny.win
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn----7sbahjd3btneuw1joc.xn--p1ai
xn--80ak6aa92e.com
xn--h1aakne2ba.xn--p1ai
xn--h1ahbi.com.ua xn--h1ahbi.com.ua
xxlargepop.com xn--oogle-wmc.com
youbloodyripper.com xtubeporno.net
youdao.com xxxdatinglocal.us
yourtemplatefinder.com xxxmania.top
yousense.info xz618.com
za-music.mymobiplanet.com yellowads.men
yoshkarola.zrus.org
youporn-forum.ga
youraticles.pl
zapatosenventa.info
zx6.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.140 0; 10.1.1.147 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2944 ### Version: V4.2022.02.2945
### Updated: Fri Feb 25 22:01:30 UTC 2022 ### Updated: Sat Feb 26 10:04:01 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2944 ### Version: V4.2022.02.2945
### Updated: Fri Feb 25 22:01:30 UTC 2022 ### Updated: Sat Feb 26 10:04:01 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##