vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3400 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-09 22:07:10 +00:00
parent 3b771806f6
commit 4049034473
46 changed files with 91980 additions and 91980 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3399 #### Version: V4.2022.10.3400
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3399 #### Version: V4.2022.10.3400
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3399 #### Version: V4.2022.10.3400
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11362
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3399 #### Version: V4.2022.10.3400
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11366
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11366
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11366
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11366
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 1; 10.1.0.150 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 0; 10.1.0.150 0;
127.0.0.1 0; 127.0.0.1 0;

11366
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 1; 10.1.0.150 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 0; 10.1.0.150 0;
127.0.0.1 0; 127.0.0.1 0;

11366
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 1; 10.1.0.150 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 0; 10.1.0.150 0;
127.0.0.1 0; 127.0.0.1 0;

11366
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3399 3400

11366
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11366
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.7.78.143 0; 20.9.48.53 0;

11366
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 1; 10.1.0.150 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 0; 10.1.0.150 0;
127.0.0.1 0; 127.0.0.1 0;

11366
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 1; 10.1.0.150 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 0; 10.1.0.150 0;
127.0.0.1 0; 127.0.0.1 0;

11366
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 1; 10.1.0.150 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 0; 10.1.0.150 0;
127.0.0.1 0; 127.0.0.1 0;

11366
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.7.78.143 0; 20.9.48.53 0;

11366
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.7.78.143 0; 20.9.48.53 0;

11366
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 1; 10.1.0.150 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BDCbot AllSubmitter
Boardreader Cosmos
GT::WWW Moblie Safari
Gotit Octopus
GrapeshotCrawler OpenLinkProfiler
IndeedBot OpenVAS
JikeSpider PageAnalyzer
LinkScan PictureFinder
Re-re SBIder
Typhoeus tAkeOut

308
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404checker
404enemy 404enemy
AIBOT ALittle Client
ASPSeek
Abonti
Aboundex Aboundex
Aboundexbot
AfD-Verbotsverfahren AfD-Verbotsverfahren
Aipbot AhrefsBot
Alexibot AiHitBot
AllSubmitter Alligator
Anarchy99 Anarchy
Ankit Apexoo
Aspiegel Asterias
AwarioRssBot BDCbot
BLEXBot BDFetch
BackWeb BackDoorBot
BacklinkCrawler
Badass Badass
Bandit Barkrowler
BetaBot BatchFTP
Black Hole Battleztar Bazinga
BlackWidow Blow
BlowFish
Bolt Bolt
BotALot Brandprotect
Brandwatch CATExplorador
Buck CCBot
BuiltWith
Bullseye
BuzzSumo
CSHttp CSHttp
Cegbfeieh Calculon
CensysInspect ChinaClaw
Chlooe
Claritybot
Cocolyzebot Cocolyzebot
Collector Cogentbot
Copier
CopyRightCheck CopyRightCheck
Craftbot Copyscape
Crawling at Home Project Crawling at Home Project
CrunchBot CrazyWebCrawler
Custo Crescent
CyotekWebCopy DBLBot
DIIbot DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Devil Devil
DigitalPebble
Dirbuster Dirbuster
Dispatch DnBCrawler-Analytics
DomCopBot
DomainAppender DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dragonfly Domains Project
Drip EMail Siphon
ECCP/1.0
EMail Wolf
EroCrawler
Evil Evil
Extreme Picture Finder ExtractorPro
EyeNetIE
FDM FDM
FHscan FHscan
Fimap Freeuploader
Firefox/7.0 FyberSpider
Flunky G-i-g-a-b-o-t
Fuzz Genieo
GermCrawler
GetRight GetRight
GetWeb
Getintent Getintent
Gigabot Go!Zilla
GoZilla Gotit
Grabber
HMView
HTMLparser
HTTP::Lite HTTP::Lite
HTTrack HaosouSpider
Harvest Harvest
Havij
Heritrix
HonoluluBot
IDBTE4M
IRLbot IRLbot
IlseBot Image Fetch
Indy Library Image Sucker
Intelliseek IndeedBot
InfoNaviRobot
InterGET
Iskanie
JOC Web Spider
JamesBOT JamesBOT
Jbrofuzz Jbrofuzz
Joomla Jorgee
JustView
Jyxobot Jyxobot
Kenjin Spider Keybot Translation-Search-Machine
Keyword Density Kinza
LeechFTP LWP::Simple
LeechGet Lanshanbot
LexiBot Larbin
Lftp Leap
LibWeb LibWeb
LieBaoFast LinkWalker
Likse Lipperhey Spider
LinkpadBot Ltx71
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
MIIxpc MIIxpc
MSIECrawler
MTRobot MTRobot
Majestic SEO Mag-Net
Majestic-SEO Magnet
Masscan Majestic12
MarkMonitor
MarkWatch
Mata Hari
Mb2345Browser Mb2345Browser
MeanPath Bot
Meanpathbot Meanpathbot
Microsoft Data Access Mediatoolkitbot
Mojolicious Metauri
Musobot MicroMessenger
Minefield
Moblie Safari
Morfeus Fucking Scanner
Mozlila
NICErsPRO
NPbot NPbot
Nameprotect Nameprotect
Navroad Navroad
NetZIP NearSite
Net Vampire
Netvibes Netvibes
NextGenSearchBot Nimbostratus
Nikto Ninja
NimbleCrawler Nuclei
Not
Octopus Octopus
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
OpenVAS OnCrawl
Openfind
Openvas
OutfoxBot OutfoxBot
PageGrabber PageAnalyzer
PageScorer
PageThing.com PageThing.com
Papa Foto Pandalytics
PeoplePal Panscient
Pi-Monster
Picscout Picscout
Picsearch
Pimonster Pimonster
PleaseCrawl
Pockey
ProPowerBot ProPowerBot
ProWebWalker ProWebWalker
Probethenet Probethenet
Pump Psbot
PxBroker
PyCurl PyCurl
QueryN Metasearch QueryN Metasearch
RankActiveLinkBot RSSingBot
RankingBot RankActive
RankurBot RebelMouse
ReGet RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot Rogerbot
SBIder
SEOkicks-Robot SEOkicks-Robot
ScanAlert ScreenerBot
Scrapy ScrepyBot
SearchmetricsBot
Seekport Seekport
SemanticJuice Semrush
SemrushBot SemrushBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz
Shodan Shodan
Site Sucker SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteSnagger Sogou web spider
SiteSucker Sottopop
Sitebeam Spammen
Sitevigil Spinn3r
SmartDownload
Snake
Snoopy
Sociscraper
Sosospider
SpankBot
Spbot
Sqlworm Sqlworm
Sucker Sqworm
Steeler
Sucuri
SuperHTTP SuperHTTP
SurveyBot Swiftbot
Szukacz Szukacz
Teleport T8Abot
Telesoft
Telesphoreo Telesphoreo
Telesphorep Telesphorep
TheNomad The Intraformant
Thumbor
Titan
Toata
Toweyabot Toweyabot
Trendiction Trendiction
Turnitin Trendictionbot
Typhoeus Turingos
Twice
URLy Warning URLy Warning
URLy.Warning URLy.Warning
V-BOT Upflow
VB Project VB Project
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron Voltron
WEBDAV WASALive-Bot
WPScan WBSearchBot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Collage Web Collage
Web Enhancer
Web Fuck Web Fuck
Web Sucker Web Pix
Web Sauger
WebAuto WebAuto
WebEnhancer WebEnhancer
WebFetch
WebGo IS WebGo IS
WebImageCollector WebImageCollector
WebLeacher WebLeacher
WebPix WebReaper
WebStripper WebStripper
WebSucker
WebWhacker WebWhacker
WebZIP
WebmasterWorldForumBot WebmasterWorldForumBot
WebsiteExtractor Whack
WebsiteQuester Whacker
Widow Widow
WinHTTrack WinHTTrack
WiseGuys Robot WiseGuys Robot
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot YoudaoBot
Zade
Zauba Zauba
Zermelo
Zeus
Zitebot Zitebot
ZmEu ZmEu
ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
ZyBorg adscanner
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
autoemailspider autoemailspider
clark-crawler backlink-check
coccocbot check1.exe
com.plumanalytics crawler.feedback
domainsproject.org
facebookscraper
gopher gopher
heritrix
internetVista monitor
ips-agent
linkdexbot linkdexbot
lwp-trivial
magpie-crawler magpie-crawler
mediawords mediawords
muhstik-scan
ripz ripz
satoristudio.net seoscanners
scan.lol serpstatbot
seobility siteripz
seostar sogouspider
sitechecker.pro ubermetrics-technologies.com
sp_auditbot
trendiction.com
voyagerx.com
webprosbot
x22Mozilla x22Mozilla
zauba.io zauba.io
zgrab

314
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider
404checker 404checker
404enemy
80legs 80legs
AIBOT ADmantX
ASPSeek ASPSeek
Acunetix Abonti
AiHitBot Alligator
Aipbot Anarchie
AllSubmitter
Anarchy Anarchy
Anarchy99 Anarchy99
Anthill Ankit
Asterias Attach
Atomseobot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BDFetch BacklinkCrawler
Backlink-Ceck BetaBot
Bandit
BatchFTP
Blow Blow
BlowFish
Boardreader
BotALot BotALot
Brandwatch Brandwatch
Buck BuiltBotTough
BuiltWith Bullseye
BunnySlippers BunnySlippers
CATExplorador BuzzSumo
CSHttp CCBot
CheeseBot CensysInspect
ChinaClaw
Chlooe Chlooe
Claritybot Claritybot
Cocolyzebot Copier
Collector CopyRightCheck
Copyscape
Cosmos
Craftbot Craftbot
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Crescent
CrunchBot
Curious
CyotekWebCopy
DSearch
DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli
DigitalPebble DigitalPebble
Dirbuster
Disco Disco
Discoverybot DnBCrawler-Analytics
DomainSigmaCrawler DomCopBot
DomainAppender
Dotbot Dotbot
Download Wonder
Drip
ECCP/1.0 ECCP/1.0
EasyDL EMail Siphon
Ebingbong
Ecxi
EirGrabber EirGrabber
Evil Evil
Exabot Exabot
ExtLinksBot
Extractor Extractor
Ezooms FDM
FHscan
Fimap
Firefox/7.0 Firefox/7.0
FlashGet Flunky
Foobot
Fuzz
G-i-g-a-b-o-t
GermCrawler GermCrawler
Gigabot GetWeb
Go-Ahead-Got-It
Gotit
GrabNet GrabNet
Grafula Grafula
GridBot GrapeFX
HTMLparser HMView
HaosouSpider HTTP::Lite
HonoluluBot HTTrack
Haansoft
IDBTE4M IDBTE4M
Id-search Iblog
InfoTekies Image Fetch
Intelliseek Image Sucker
InfoNaviRobot
InterGET InterGET
InternetSeer Internet Ninja
JOC Web Spider
Jbrofuzz Jbrofuzz
JetCar JennyBot
JikeSpider
Jorgee
JustView JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
LNSpiderguy Keyword Density
Lanshanbot Kinza
LWP::Simple
Larbin Larbin
Leap LexiBot
Libwhisker LieBaoFast
Lightspeedsystems Likse
LinkScan LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
LinqiaMetadataDownloaderBot LinkpadBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot Lipperhey Spider
Lipperhey Lmspider
Litemage_walker
MFC_Tear_Sample
MIDown tool MIDown tool
MIIxpc
MJ12bot MJ12bot
MSIECrawler
MTRobot MTRobot
Mag-Net Mag-Net
Majestic SEO Magnet
Majestic-SEO Mail.RU_Bot
Majestic12
Mass Downloader
Masscan Masscan
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri Metauri
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojolicious Mojolicious
MolokaiBot
Mr.4x3 Mr.4x3
Msrabot Name Intelligence
NICErsPRO Navroad
Net Vampire NetAnts
NetLyzer Nettrack
NetMechanic
NetZIP
Netvibes Netvibes
NextGenSearchBot
Nikto
NimbleCrawler NimbleCrawler
Ninja Ninja
Nmap
Nuclei Nuclei
Nutch Octopus
Offline Explorer OutclicksBot
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OutfoxBot OutfoxBot
PECL::HTTP PHPCrawl
Pandalytics POE-Component-Client-HTTP
Petalbot PageAnalyzer
Piepmatz PageGrabber
Pockey PageScorer
PageThing.com
Panscient
Pavuk
PeoplePal
Pi-Monster
Pixray
PleaseCrawl
Probethenet
Psbot
Pump Pump
PxBroker PxBroker
PyCurl RankActive
Quick-Crawler RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot RankurBot
Re-re ReGet
Reaper
Recorder
RedesScrapy RedesScrapy
RepoMonkey
Ripper Ripper
RocketCrawler RocketCrawler
Rogerbot
SBIder SBIder
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler SEOprofiler
SEOstats SEOstats
SISTRIX ScanAlert
ScoutJet
Scrapy Scrapy
ScrepyBot Screaming
ScreenerBot
SearchmetricsBot
SemanticJuice SemanticJuice
Semrush Semrush
SemrushBot
SentiBot SentiBot
SeoSiteCheckup SeoSiteCheckup
Seomoz Siphon
Site Sucker Site Sucker
SiteCheckerBotCrawler
SiteLockSpider SiteLockSpider
SiteSnagger
Sitebeam Sitebeam
Snapbot SlySearch
Sosospider SmartDownload
Spammen Snoopy
Spinn3r SocialRankIOBot
Sqlworm Sogou web spider
Steeler SpankBot
Sucker Spanner
SuperHTTP Spbot
SputnikBot
Stripper
SuperBot
Suzuran Suzuran
T8Abot T0PHackTeam
Telesoft Telesoft
Telesphoreo Telesphorep
TightTwatBot TightTwatBot
Toata Titan
Toweyabot
Tracemyfile
Trendictionbot Trendictionbot
True_Robot True_Robot
Turingos Typhoeus
TwengaBot
Twice
URLy.Warning URLy.Warning
UnisterBot
Upflow Upflow
V-BOT
VCI VCI
VelenPublicWebCrawler Vagabondo
VeriCiteCrawler Voltron
VoidEYE
WASALive-Bot WASALive-Bot
WEBDAV WEBDAV
WWW-Collector-E WISENutbot
WWW-Mechanize WPScan
WWW::Mechanize
Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE Web Collage
Web Fuck Web Sauger
WebBandit Web Sucker
WebCopier WebFuck
WebFetch
WebGo IS
WebImageCollector WebImageCollector
WebPix WebLeacher
WebWhacker Webalta
WebZIP Website Quester
Webshag WebsiteExtractor
WebsiteQuester WebsiteQuester
Whacker
Whatweb
Widow
WinHTTrack WinHTTrack
WiseGuys Robot WiseGuys Robot
Wotbox
Wprecon Wprecon
YoudaoBot Zauba
Zermelo
Zeus
Zitebot Zitebot
ZmEu archive.org_bot
ZoominfoBot arquivo.pt
arquivo-web-crawler
autoemailspider autoemailspider
clark-crawler backlink-check
cognitiveseo cah.io.community
com.plumanalytics com.plumanalytics
dataforseo.com crawl.sogou.com
domainsproject.org demandbase-bot
evc-batch evc-batch
facebookscraper
gopher
heritrix heritrix
instabid
ips-agent ips-agent
isitwp.com isitwp.com
iubenda-radar linkdexbot
magpie-crawler lwp-request
mediawords oBot
netEstate NE Crawler page scorer
plumanalytics probe-image-size
satoristudio.net scalaj-http
scan.lol scan.lol
seobility
seocompany.store seocompany.store
sysscan seoscanners
ubermetrics-technologies.com webmeup-crawler
webprosbot
x22Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
cityadspix.com alert-fjg.xyz
darmebel.com.ua bdsmgalls.net
googglet.com bum.com.ru
j33x.com buybest1.biz
kaidalibor.de gazporno.com
letmacworkfaster.site magento-crew.net
ops.picscout.com nerudlogistik.ru
takeprofitsystem.com s.lollypopgaming.com
tizanidinevscyclobenzaprine.blogspot.com sinel.info
welcomeauto.ru tovaroboom.vast.ru

926
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1-99seo.com 007angels.com
1bet.com 11235813.webzdarma.cz
1flag.co.za 1kdailyprofit.me
28n2gl3wfyb0.ru 1millionusd.xyz
2ads.co.uk 2015god.org
2itech.ru 24videos.tv
2x2fan.ru 2girls1cup-free.com
4kepics.com 3-letter-domains.net
5forex.ru 51unlim.ru
66cpwgln.space 55wmz.ru
9icmzvn6.website 5elementov.ru
a.pr-cy.ru 5ws.dating-app.ru
aa8780bb28a1de4eb5bff33c28a218a930.com a14download.com
aa9d046aab36af4ff182f097f840430d51.com abusora.com
absolute-s.ru accessoires-mode.in
actionnooz.com actulite.com
admeasures.com admeasures.com
adpremium.org adpremium.org
ads-seo.men akvamaster.dp.ua
adultgalls.com alarmobninsk.ru
advancedmassagebysara.com ald2014.org
agysya.ru alfa-img.com
alert-fdm.xyz allpdfmags.net
alienwheel.es
all4invest.ru
allproblog.com
allwidewallpapers.com allwidewallpapers.com
alpharma.net aosexkontakte.net
alpinism.ru apartmentbay.ru
amateurmatch.com apimossnetinfo-a.akamaihd.net
ameblo.top apiwoodensealcom-a.akamaihd.net
ampower.me arendakvartir.kz
anal-acrobats.hol.es asiavirtualsolutions.com
anti-virus-removal.info
apifasterlightin-a.akamaihd.net
appiq.mobi
apple.com-webbrowsing-security.review
architecturebest.com
arendatora.ru
arkartex.ru
arpelsreplica.xyz
artparquet.ru
asiengirls.net asiengirls.net
asrv-a.akamaihd.net asrvrep-a.akamaihd.net
asseenontvonline.ru
atleticpharm.org atleticpharm.org
atofilms.com atofilms.com
azbukafree.com azazaporn.com
babyfactory.fr
backgroundpictures.net
backlink4u.net backlink4u.net
balook.com baersaratov.ru
batanga.net bagcionderlab.com
benchmarkcommunications.co.uk bankcrediti.ru
berdasovivan.ru bashtime.ru
beatifullandscape.co
belsetirehafi.tk
best-deals-products.com
best-seo-software.xyz best-seo-software.xyz
bestmarriages.com besthomemadepornsites.com
bfz.biz bestwaystogetpaid.us
bharatdefencekavach.com betterhdporn.com
bget.ru
bigpictures.club bigpictures.club
bimatoprost-careprost.com.ua bingo8888.com
bioca.org bjanshee.ru
blpmovies.com blackhatworth.com
bmsco.co blogporn.in
bolezniorganov.ru blogrankers.com
brains2.biz bmw.afora.ru
bristolhotel.com.ua bocoarchives.org
buckspar.gq bonzybuddy.com
bumble.cheapwebsitehoster.com bookmark4you.com.biz
brianhenry.co
brothers-smaller.ru
bscodecs.com
btnativenav.com
bumskontakte.org
bus-offer.com
businesxxl.com businesxxl.com
buyessay3.blogspot.ru buypuppies.ca
buypillsorderonline.com buyscabiescream.com
bvlgariring.xyz bvlgaribracelet.xyz
bzero1jewelry.net bvlgariwallet.xyz
camdolls.com bycontext.com
candycrushshop.com cablecar.us
canrioloadm.gq calvet.altervista.org
canzoni.ru candypeople.se
cartujano-pre.de capacitacionyaprendizaje.com
cementaresearch.se carabela.com.do
centrdebut.ru carsdined.org
cerev.info cartechnic.ru
cheapestjerseys-wholesale.com cartierjusteunclou.xyz
checkm8.com cartiertrinity.xyz
checkpagerank.net cdn.walkme.com
cialisovercounteratwalmartusa.com celebsopics.com
ciekawinki.pl cheap-trusted-backlinks.com
civilwartheater.com cheapbarbour.online
clarithromycin500mg.com cheapestjerseysonwholesale.com
clean-start.net cheapmarmot.online
cleansearch.net chee-by.biz
clevernt.com chocolateslim-u-srbiji.com
clodo.ru cialischsrx.com
cntravelre.com cialisndbrx.com
compliance-viktor.top cjmc.info
contentlook.co classicakuhni.ru
continent-e.tv cleanersoft.com
counter.bloke.com clickaider.com
courtshipgift.com cmd.kz
crd.clan.su collegerentals.com
creditmoney.com.ua compliance-alex.top
creditwell.ru connectingsingles.com
cs-passion.pl cookie-law-enforcement-hh.xyz
customchocolate.business-for-home.com cool-wedding.net
customerguru.in coolbar.pro
cxpromote.com cordstrap.cc
cosmetic.donna7753191.ru
cosmeticswomens-womensports.rhcloud.com
cottageofgrace.com
cracksplanet.com
cranly.net
credit-online.ws
creditnation.ru
customcollegeessays.net
cypernhuset.se cypernhuset.se
d0t.ru dailystrength.org
daooda.com daptravel.com
data-ox.com datract.com
dawlenie.com daydream-studio.ru
day-news.info decorazilla.com
ddospanel.com dellalimov.com
deadlinkchecker.com
decorationspcs.com
dekoration.us
dengi-pod-zalog-nedvizhimosti.ru dengi-pod-zalog-nedvizhimosti.ru
detskie-zabavi.ru detki-opt.ru
digest-project.ru detoxmed24.ru
digital-sale.su dev33.dioniqlabb.se
digitalfaq.com dickssportinggoods.com
divatraffic.com dinosaurus.site
djekxa.ru diusyawiga.tk
dms-sw.ru div.as
doctissimo.fr divisioncore.com
documentsite.net dktr.ru
doktoronline.no dollartree.info
domini.cat domainroam.win
dominterior.org doxysexy.com
dostavka-v-ukrainu.ru draniki.org
downloader12.ru
downtuptv.gq
droidlook.net
drunkenstepfather.com
drupa.com drupa.com
dstroy.su
dumpsmania24.com dumpsmania24.com
editmedios.com earl-brown.info
efkt.jp easytuningshop.ru
ekobata.ru ebooknovel.club
elektrischeziga.livejournal.com ec-file.info
enge-fotzen.info ecookna.com.ua
enternet.ee education-cz.ru
eralph.tk egovaleo.it
erotiktreff24.info eldiariodeguadalajara.com
ertelecom.ru elektrischezigarette2.devhub.com
es5.com elektronischezigarettekaufen1.beeplog.com
escortplius.com elvenar.com
etotupo.ru enskedesquashclub.se
europeanwatches.ru eorogo.top
exchanges-bet.com euromasterclass.ru
executehosting.com extlinks.com
extremez.net extrabot.com
facecup.top ezigarettekaufen.myblog.de
fapgon.com ezigarettenkaufen1.deviantart.com
ezrvrentals.com
favorcosmetics.com favorcosmetics.com
faz99.com
feorina.ru
fetlifeblog.com
fidelityfunding.com fidelityfunding.com
fil.ru filesclub.net
filesdatabase.net
fillmewithhappiness.com fillmewithhappiness.com
finejewelryshop.ru filmetricsasia.com
flashlarevista.com filmgo.ru
forpackningsutveckling.se fireads.men
fitfloponline.store
flash4fun.com
flex4launch.ru
foodgid.net
forex-indextop20.ru
formulaantiuban.com
fortevidyoze.net
foto-basa.com
fototravel.eu fototravel.eu
franch.info fotzen-ficken.com
freejabs.com fr.netlog.com
fxtips.ru franecki.net
g33.org free-laptop-reward.com
gamebackyard.com free-share-buttons.com
gamerextra.com free411games.com
games.kolossale.ru freelifetimefuckbook.com
getpopunder.com front.to
gifspics.com fullgirl.ru
gilbertbanda.net fxund.us
globalscam.ga fyxabomiw.ru
gobongo.info gael-s.ru
goodly.pro gelezki.com
google-liar.ru gemgrab-a.akamaihd.net
gsasearchenginerankerdiscount.com gentamicineyedrops.blogspot.com
gta-top.ru gepezz.info
gymi.name getdot.ru
h2monline.com gk-atlant.info
hatedriveapart.com glopages.ru
heartofpayne.xyz go2album.com
help.tpu.ru golfresa.lucania.se
hexpilot.com gox.com.ua
hit-kino.ru greatgrace.ru
hobild.net greendream.com.ua
homegardenlova.com grtyi.com
homik.pw habermetre.com
hornymatches.com happy.new.yeartwit.com
horoshieokna.com hatdc.org
haveinc.xyz
hazardky.net
hermesreplica.win
histats.com
historichometeam.com
hoporno.com
hostsshop.ru hostsshop.ru
hotblognetwork.com hotblog.top
hotgirlhdwallpaper.com hotcore.info
hotshoppymac.com
hotsocialz.com
housediz.com
howmuchdoestizanidinecost.blogspot.com howmuchdoestizanidinecost.blogspot.com
hunterboots.online ilo134uloh.com
ideawheel.com imediadesk.com
imitex-plus.ru imfamous.info
incolors.club inbabes.sexushost.com
infazavr.ru inboxdollars.com
instasexyblog.com inclk.com
interfucks.net intervsem.ru
investsuccess.org investyb.com
investzalog.ru iskalko.ru
invivo.hu islamtoday.co.za
iopeninghours.co.uk itag.pw
ipchicken.com iyasimasennka.com
isoveti.ru izoll.ru
itservicesthatworkforyou.com javstock.com
ivanovo.zrus.org jobgirl24.ru
jackwolfskinoutlet.online jongose.ninja
jav-fetish.site juliaworld.net
javxxx18.com kakadu-interior.com.ua
je7.us kamen-e.ru
jewelryandfiligree.com kerei.ru
jobmarket.com.ua
justkillingti.me
jwcialislrt.com
jwss.cc
kadashihotel.com
kalb.ru
kam-dom.ru
kazrent.com
kellyonline.xyz
keywesthideaways.co
keywords-monitoring-success.com keywords-monitoring-success.com
kino-filmi.com kino-ecran.ru
kinosed.net kinohall.ru
konkursowo-24.pl knigonosha.net
kotaku.com konturkrasoty.ru
kupit-adenu.ru koopilka.com
kursy-ege.ru kosynka-games.ru
lafourmiliaire.com lalalove.ru
landinez.co landscaping.center
languagecode.com
lapitec.eu lapitec.eu
lazymanyoga.com lasvegaslockandsafe.com
letmacworkfaster.site layola.biz.tc
lexiangwan.com ldrtrack.com
linkarena.com lennatin.info
lidoradio.com
likesuccess.com
linkbuddies.com linkbuddies.com
live-sexcam.tk linkrr.com
livejasmin.com lisque.batcave.net
liver-chintai.org listiseltemournlan.gq
lmrauction.com liveshoppersmac.com
loadopia.com liveu.infoteka.hu
lollypopgaming.com
lomb.co
lombia.co lombia.co
lubetube.com louisvuittonoutletstore.net
lulea-auktionsverk.se m1media.net
mabdoola.blogspot.com m4ever.net
macdamaged.space mafcards.ru
mafa-free.com magento-crew.net
manve.info mainlinehobby.net
maridan.com.ua makis.nu
markjaybeefractal.com manualterap.roleforum.ru
martlinker.com map028.com
maslenka.kz mature.free-websites.com
master-muznachas.ru medanestesia.ru
matpre.top meddesk.ru
max-eclat.men megaapteka.ru
mebel-vstroika.ru megakino.net
meble-bogart.info
mega-bony-2017.pl
mega-bony2017.pl
metalonly.info metalonly.info
mezaruk.info metaxalonevstizanidine.blogspot.com
mil-stak.com meteocast.net
missclub.info michaelkorsoutletstore.net
missis.top mindeyegames.com
minyetki.ru
misswell.net
mobilierland.com
modenamebel.ru modenamebel.ru
monclercheap.xyz moetomnenie.com
moncleroutletonline.pw moneyteam24.com
moneymaster.ru moxo.com
moneyviking-a.akamaihd.net mrbojikobi4.biz
motherboard.vice.com
mountainstream.ms
mrinsidesales.com mrinsidesales.com
msk-diplomat.com musicas.baixar-musicas-gratis.com
musezone.ru musicpro.monster
musicktab.com mustwineblog.com
muz-tracker.net muz-shoes.ru
my-floor.in.ua
myfreemp3.eu myfreemp3.eu
myftpupload.com myphotopipe.com
mypornfree.ru myxdate.info
myseoconsultant.com narutonaruto.ru
nac-bearings.ru nbsproject.ru
narkologiya-voronezh.ru needtosellmyhousefast.com
nash-krym.info netvouz.com
nelc.edu.eg new-apps.ru
newsperuse.com new7ob.com
newstraveller.ru news-readers.ru
nhl09.ru nextlnk12.com
nicefloor.co.uk nicovideo.jp
nonameread45.live nikitabuch.com
novosibirsk.xrus.org nofreezingmac.click
nowtorrents.com normalegal.ru
notfastfood.ru
novgorod.xrus.org
ntic.fr
nyfinance.ml nyfinance.ml
o.light.d0t.ru nzfilecloud.weebly.com
offers.bycontext.com o-o-11-o-o.com
officedocuments.net obiavo.net
offtime.ru omsk.xrus.org
okroshki.ru onclickpredictiv.com
online-sbank.ru oneclickfiles.com
onlineslotmaschine.com orgasmatrix.com
onlythegames.com outpersonals.com
openfrost.net pandroid.co
oren-cats.ru peekyou.com
osagonline.ru pepperstyle.ru
pacificair.com photorepair.ru
panchro.xyz pic2fly.com
paperwritingservice17.blogspot.ru pixelrz.com
parajumpersoutlet.online play-mp3.com
perl.dp.ua playmsn.com
phuketscreen.com pochtovyi-index.ru
pic-re.blogspot.com polytopesexempt.com
piccshare.com pomoc-drogowa.cba.pl
picmoonco.pw pornhub-ru.com
piratecams.com pornoklad.ru
pixshark.com pornolook.net
plastjulgranar.se pornotubs.com
play.leadzupc.com pornpost.in
playboyfiles.xblog.in
pokemon-go-play.online
pons-presse.com
porn-w.org
pornhub-forum.ga
pornofiljmi.com
pornoklad.net
pornoslive.net
porto.abuilder.net porto.abuilder.net
privatbank46.ru potolokelekor.ru
prizefestival.mobi pozdravleniya-c.ru
pro-poly.ru pozvonim.com
pro-tec.kz predmety.in.ua
push-ad.com primedice.com
qwesa.ru priora-2.com
rankia.com prizeestates.cricket
rapidgator-porn.ga prodess.ru
razamicroelectronics.com profitkode.com
realtytimes.com promgirldresses.xyz
rebelmouse.com pronorm.fr
rebuildermedical.com prostitutki-odessa.org
recipedays.ru prostitutki-rostova.org
rednise.com prostitutki-tyumeni.org
registrysweeper.com pskcijdc.bloger.index.hr
remontvsamare.su quality-traffic.com
remote-dba.de questionmarque.ch
renecaovilla.online rangoman.date
rankexperience.com
rapidsites.pro
redirlock.com
referencemoi.com
registratciya-v-moskve.ru
rennlist.com
responsinator.com
respublica-otel.ru
restaurantlescampi.com restaurantlescampi.com
resultshub-a.akamaihd.net ribieiendom.no
rewardit.com rique.host.sk
riders.ro rosbalt.com.ua
ringporno.com russintv.fr
rockma.se s.lollypopgaming.com
rossanasaavedra.net saecsa.co
runtnc.net saitevpatorii.com
rusoft-zone.ru salut-camp.ru
russian-postindex.ru santechnik.jimdo.com
rutor.group saveriopiazza.it
rvtv.ru scanner-margo.top
sack.net scanner-mark.top
salmonfishingsacramentoriver.com schlampen-treffen.com
salutmontreal.com sdi-pme.com
scanner-fred.top search.alot.com
scanner-ivan.top securityallianceservices.com
scanner-mary.top see-your-website-here.com
scanner-olga.top seemoreresultshu-a.akamaihd.net
scenarii-1-sentyabrya.uroki.org.ua sendearnings.com
search-error.com service.adtech.us
searchencrypt.com sevendays.com.ua
searchimage.co sex-tracker.de
searchinterneat-a.akamaihd.net sharebutton.net
searchmywindow-a.akamaihd.net shijian.ac.cn
seasonvar.ru shillyourcoins.com
segol.tv shop.xz618.com
seo-tools-optimizing.com shopwme.ru
seoexperimenty.ru shymkent.xkaz.org
seojokes.net sideeffectsoftizanidine.blogspot.com
seolab.top siteaero.com
serw.clicksor.com skypasss.com
sex-dating.co skytraf.xyz
sexobzor.info slowmacfaster.trade
sexpartygirls.net snowplanes.com
sextracker.de soviet-portal.do.am
sexy-pings.com space-worry.ml
share-buttons-for-free.com
ship-marvel.co.ua
shop.acim.org
site.ru
skutecznetabletkinaporostwlosow.pl
sky-mine.ru
smokewithrabbits.com
soaksoak.ru
socialbuttons.xyz
solution4u.com
sonata-arctica.wz.cz
space4updating.win space4updating.win
spb.afora.ru spl63.fr
specialfinanceoffers.com staticfs.host
spy-app.info
srdrvp.com
starwars.wikia.com
statoutlook.info statoutlook.info
stop-zavisimost.com stoki.ru
streetfire.net stopnarco.ru
studiofmp.com subj.ukr-lit.com
sundrugstore.com sugarkun.com
support.nopeas.sk supermama.top
svetodiodoff.ru svnuppsalaorebro.se
swagbucks.com tdsing.ru
sweepstakes.rewardit.com techart24.com
swsociety.se telefonsex-ohne0900.net
tabletkinaodchudzanie.com.pl terrafootwear.us
tackletarts.co thedownloadfreeonlinegames.blogspot.com
tanieaukcje.com.pl thegolfclub.info
td-l-market.ru themeforest.net
teastory.co thin.me.pn
tech4master.com ticketsys.inetwd.com
teencastingporn.com tilido.com
teesdaleflyballclub.co.uk time-japan.ru
telegraf.by timetorelax.biz
texbaza.by timhost.ru
the-torrent-tracker.blogspot.com tizanidine4mgstreetvalue.blogspot.com
thecoolimages.net tizanidinecapsules.blogspot.com
theendivechronicles.com tizanidinehclsideeffects.blogspot.com
thewomenlife.com tizanidineoral.blogspot.com
tizanidinehcl2mgtablet.blogspot.com tizanidinepain.blogspot.com
tizanidinehcl4mgtab.blogspot.com tootoo.to
tizanidinevscyclobenzaprine.blogspot.com topads.men
tnctrx.com torrentdownloadhub.com
token-lab.org torrents.cd
top10-online-games.com traffic-club.info
top10registrycleaners.com trafficmania.com
topquality.cf trafficreceiver.club
torrnada.ru trainoffend.ml
toursmaps.com tsan.net
trkdf.com turbabitload.weebly.com
trucri.me typimga.pw
trustedmaccleaner.com uginekologa.com
turizmus.us uhod-za-sobakoj.ru
u-cheats.ru ultimateclassicrock.com
ua.tc ultramart.biz
um-razum.ru umityangin.net
uni.me universals.com.ua
unionmarkt.de upproar.com
unitygame3d.com uptimechecker.com
unmaroll.ya.ru url-extractor.xyz
urzedowski.eu url-img.link
usacasino.com urlopener.com
vacuumcleanerguru.com us-america.ru
varikoz24.com usbggettwku.ga
venerologiya.com uzungil.com
via-gra.webstarts.com vancleefreplica.pw
video-chat.in vclicks.net
veselokloun.ru
videochat.tv.br videochat.tv.br
vids18.site videosbox.ru
vietimgy.pw videospornogratisx.net
vikistars.com vip-dom.in
vip2ch.com vip.51.la
virtualbb.com vipromoffers.com
vizitki.net virtuagirl.com
vkonche.com voloomoney.com
vladimir.zrus.org volume-pills.biz
voditeltrezviy.ru vzlomtw.com
voloslove.ru wallpapers-best.com
vrotike.ru warningwar.ru
vzlomsn.org watracker.net
warningzscaler.heraeus.com web.cvut.cz
waycash.net website-analyzer.info
webmonetizer.net websites-reviews.com
webradiology.ru weburok.com
website-audit.com.ua westvilletowingservices.co.za
websitevaluebot.com wiosenny-bon-1500.pl
westen-z.life
whatistizanidinehclusedfor.blogspot.com
whatzmyip.net
whiteproduct.com
wholesalejerseychinashop.com
wineitudes.wordpress.com
withstandingheartwarming.com withstandingheartwarming.com
wladimirpayen.com wnoz.de
worldinternetauthority.com wordkeyhelper.com
www.labves.ru works.if.ua
www.wohnkabinen-shop.de worst-sites.online
wovis.site
wzgyyq.com wzgyyq.com
x-diesel.biz x5market.ru
xn--oogle-wmc.com xboxster.ru
xtube.com xmnb.net
xtubeporno.net xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xxart.ru xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
xz618.com xn----9sbebi2bvzr7h.xn--p1ai
y8games-free.com xn--e1afanlbnfckd7c3d.xn--p1ai
yaoguangdj.com yginekologa.com
yatrk.xyz youraticles.pl
yourdesires.ru zaimite.ru
yoursearch.me zapatosenventa.info
yousense.info zapiszto.pl
zambini.ru zarepta.com
zed21.net zirondelli.it
zskdla.site znakom.sibtest.ru
znakomstvaonlain.ru
znaniyapolza.ru
zona-aqua.ru
zscalerone.net
zvooq.eu zvooq.eu

468
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0lovespells0.blogspot.com 108shot.com
2drittel.de 12bet.com
5elementov.ru 1flag.co.za
aa9d046aab36af4ff182f097f840430d51.com 1millionusd.xyz
aab94f698f36684c5a852a2ef272e031bb.com 202ch.com
absolutelyanalog.com 6128786.com
7zap.com
8558l.jobs.net
acheterviagrafr24.com acheterviagrafr24.com
adtech.fr acmebtn.ml
affrh2015.com admatic.com.tr
agecheckadult.com adtiger.tk
ahrefs.com alarmobninsk.ru
aktivator-windows10.blogspot.com alf-img.com
andpolice.com alive-ua.com
alltheviews.com
alphaforum.ru
am15.net
analnoeporno.tv
anapa-inns.ru
anaseracresar.tk
apartmentbay.ru apartmentbay.ru
apartmentratings.com apibatbrowsecom-a.akamaihd.net
apioasisspacenet-a.akamaihd.net apidiamondatanet-a.akamaihd.net
apiportalmorecom-a.akamaihd.net apiluckyleapnet-a.akamaihd.net
apiqualitinknet-a.akamaihd.net atmagroup.ru
appearance-cool.com australia-opening-times.com
arcadepages.com
arcteryxstore.online
atelielembrancaqueencanta.com.br
autoblogger24.info autoblogger24.info
autodo.info autoua.top
azinoofficial777.ru ayodhya.co
balla-boo.se balkanfarma.ru
barbourjackets.online bannertesting.com
basedecor.ru bayareaaeroclub.org
beachfix.co beachdriveblog.com
beatifullandscape.co beremenyashka.com
benchmarkcommunications.co.uk besthomemadepornsites.com
bestserials.com bfz.biz
betterscooter.com bidbuy.co.kr
bigcareer.info bio.trade-jp.net
bonky.biz bioinnovate.co
brillianty.info bitcoins-live.ru
byme.se bkgr.se
canrioloadm.gq blog.axant.it
cartierjusteunclou.xyz brewdom.ru
cartierlovestore.xyz buyparajumpers.online
cartiertrinity.xyz callawaygolfoutlet.online
cenoval.ru candlehandmade.com
changde.58.com cars-modification.net
cialischstgerts.com cartierlove2u.xyz
cialisovercounteratwalmartusa.com cdnanalytics.xyz
cicaki.net ceotrk.com
cinemaenergy-hd.ru check-this-out-now.online
cleanpcnow.com chidporn.com
click2pawn.com
co.lumb.co co.lumb.co
compliance-fred.top compliance-barak.top
compliance-george.top compliance-irvin.xyz
compliance-julia.top cookielawblog.wordpress.com
compliance-mary.top
comsysnet.com
cornerstone-countertops.com cornerstone-countertops.com
craftburg.ru country-chic.ru
creditnation.ru
cubook.supernew.org cubook.supernew.org
customboxes4less.com dafatiri.com
cv.wallhade.co daydream-studio.ru
cwetochki.ru ddpills.com
cxpromote.com demon-tweeks.com
czat.wp.pl dfiles.me
dating-time-now.com digital-sale.su
defenderxtactical.com discovertreasure-a.akamaihd.net
delta-line.men dnsrsearch.com
digilander.libero.it dotmass.top
digitalassetmanagement.site doxysexy.com
dyt.net dynainbox.com
e-commerce-seo.com e-collantes.com
ednorxmed.com edge.sharethis.com
enthuse.computernetworksonline.com ege-russian.ru
erotik0049.com elektronischezi.livejournal.com
eupornstar.info elkacentr.ru
ezigarettekaufen2.yolasite.com empathica.com
fandlr.com englishdictionaryfree.com
filesmonster.porn eropho.net
film-one.ru essaypro.com
filmbokep69.com estelight.ru
filmi-onlain.info falopicm.pw
finteks.ru feorina.ru
forex.osobye.ru filmfanatic.com
forum-engineering.ru financeloan.us
forum.doctissimo.fr fiuxy.com
free411games.com forex21.ru
fungamelands.com freshdz.com
gambarxkata.co fx-brokers-review.com
gdcentre.ru gambarkataku.co
games.kolossale.ru
gdzkurokam.ru gdzkurokam.ru
getoutofdebtfree.org ge0ip.net
gojiberriess.apishops.ru gheus.altervista.org
googlefeud.com goldenggames.com
gotwebsite1.com google-liar.ru
gpms.org.my googlsucks.com
guardlink.org gratuitxblcodes.com
hatdc.org gwagka.com
hausfrauensex18.com hamptonoaks.ca
hawaiisurf.com
hccoder.info
headpharmacy.com
heartofbeijing.blogspot.com heartofbeijing.blogspot.com
heartofpayne.xyz hermesbelts.xyz
hebr.myddns-flir.com hosting-tracker.com
high-speed1.net houseofgaga.ru
highstairs-a.akamaihd.net hubbble.com
howtowhitenteethfast.xyz imagerydatabase.com
humbmosquina.tk import-sales.com
iblogpress.xyz in-tandem.co
iccornacircri.cf iqupdatetmz.win
ido3.com iscblog.info
imadedinner.net jasonpartington.com
informatiecentro.be jetsli.de
innoslicon.com job.icivil.ir
insider.pro jrpmakati.com
insurple.com keywesthideaways.co
iradiology.ru khadastoafarde.tk
jofucipiku.tk kino-rf.ru
kino-rating.ru koral.se
kinosed.net kostenlos-sexvideos.com
knigonosha.net krasnodar.ru
kolotiloff.ru laxdrills.com
krasnodar-avtolombards.ru lego4x4.ru
kredit-blog.ru lerporn.info
kvartira-sutochno.com lesbian.xyz
ladsblue.com linkwithin.com
lakomka.com.ua liveinternet.ru
lernur.net loadingpages.me
lezbiyanki.net louboutinshoes.xyz
liran-locks.com
longgreen.info
lsp-awak-perikanan.com lsp-awak-perikanan.com
m-google.xyz m1media.net
macdamaged.space macfix.life
magiadinamibia.blogspot.com machicon-akihabara.info
mainlinehobby.net macotool.com
managerpak204.weebly.com mafcards.ru
manualterap.roleforum.ru
mararoom.ru
marinetraffic.com
marketingtechniques.info marketingtechniques.info
marsgatan.com masturbate.co.uk
mebeldekor.com.ua matsdale.com
meble-bogart.info medicineseasybuy.com
metalonly.info meendo-free-traffic.ga
metaxalonevstizanidine.blogspot.com milblueprint.com
mixed-wrestling.ru minyetki.ru
moetomnenie.com mirtorrent.net
monthlywinners.com missis.top
mp3films.ru mmofreegames.online
muz-tracker.net mobsfun.net
mygameplus.com most.gov.iq
netfacet.net mostantikor.ru
nisuturnetdgu.tk mp3ritm.top
nudepatch.net my-bc.ru
obiavo.kz myra.top
narkologiya-orel.ru
new7ob.com
next-dentists.tk
nhl09.ru
nightvision746.weebly.com
northfacestore.online
obiavo.ru obiavo.ru
odesproperty.com obuv-kupit.ru
ochistka-stokov.ru
oecnhs.info
ok.ru ok.ru
onblastblog.online onetravelguides.com
onefilms.net online-sbank.ru
onlinedomains.ru onlinefilmz.net
onlinemegax.com panamaforbeginners.com
orel-reshka.net paydayonlinecom.com
ownshop.cf phelissota.xyz
pacificair.com
painting-planet.com
panouri-solare-acoperis.com
pcgroup.com.uy
perfectplanned.com
photochki.com
phuketscreen.com
pierrehardysale.online
pintattoos.com pintattoos.com
poligon.com pinup-casino1.ru
pornohd1080.online platinumdeals.gr
pregnant.guru poiskzakona.ru
preparevideosafesystem4unow.site pons-presse.com
privacylocationforloc.com pontiacsolstice.info
pro-poly.ru popup-fdm.xyz
profitsport.club pornodojd.ru
projefrio.com.br pornosexrolik.com
pulseonclick.com pr-ten.de
quick-offer.com preg.marketingvici.com
rangoman.date profolan.pl
reklama-i-rabota.ru radiodigital.co
renewablewealth.com redhotfreebies.co.uk
resant.ru regdefense.com
rixpix.ru remontvsamare.su
rocis.site revistaindustria.com
rossanasaavedra.net rockprogblog.com
rusenvironmental.net roznica.com.ua
sarf3omlat.com saveriopiazza.it
sbwealthsolutions.ca seeresultshub-a.akamaihd.net
scoopquest.com sexvideo-sex.com
sdelatmebel.ru sexy-pings.com
seoexperimenty.ru sfd-chess.ru
sexfreepornoxxx.com sharebutton.to
sexystrippe.info shlyahten.ru
shop.acim.org sindragosa.comxa.com
siteheart.net sisi-go.ru
social-vestnik.ru site-speed-check.site
softtor.com social-search.me
sotechco.co socialbuttons.xyz
sovetogorod.ru spanking.to
strana-solnca.ru spravka-medosmotr.ru
strigkaomsk.ru strigkaomsk.ru
takeprofitsystem.com supervesti.ru
theallgirlarcade.com telefonsex-ohne0900.net
thebestphotos.eu telemetryverification.net
theporndude.com templates.franklinfire.co
tiandeural.ru thecoral.com.br
tiens2010.ru thejournal.ru
titslove.yopoint.in
tizanidine6mg.blogspot.com tizanidine6mg.blogspot.com
tmearegion26.com tizanidinerecreationaluse.blogspot.com
tobeyouday.win tizanidinevsvalium.blogspot.com
tradedeals.biz tksn.ru
tradgardspartner.se topmira.com
trafficnetzwerk.de truebeauty.cc
trainoffend.ml trustl.life
tramadolandtizanidine.blogspot.com try-rx.com
typimga.pw tsyndicate.com
uamtrk.com tuberkuleznik.ru
ukr-lit.com tversvet.ru
umnovocaminho.com twittrading.com
unionmarkt.de ucoz.ru
uptime-delta.net udsgame.online
uzporno.mobi ultimatesetnewfreeallsoftupgradesystems.pw
varikoz24.com urlopener.blogspot.com.au
varikozdok.ru uroffer.link
vbabule.net vavilone.com
vikistars.com videos-for-your-business.com
voprosotvet24.ru vut.com.ru
watchmygf.net
waterpurifier.club
we-are-gamers.com we-are-gamers.com
weblibrary.win weightatraining.com
website-audit.com.ua whatistizanidinehclusedfor.blogspot.com
wieseversa.no wjgony.com
woman-h.ru wnoz.de
wufak.com worldis.me
wzgyyq.com wosik-dach.service-for-web.de
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai www.ehscloud.cn
xn--d1abj0abs9d.in.ua x-true.info
xn--e1aggki3c.xn--80adxhks xblog.in
yaaknaa.info xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
yginekologa.com xxart.ru
youbrainboost.asia xzlive.com
yourtemplatefinder.com yougotanewdomain.com
youtubedownload.org zacreditom.ru
zeroredirect10.com zahvat.ru
zetmaster.ru zoodrawings.com
znaturaloriginal.com zryydi.com
zynax.ua

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.66 0; 10.1.0.150 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3399 ### Version: V4.2022.10.3400
### Updated: Sun Oct 9 10:03:27 UTC 2022 ### Updated: Sun Oct 9 22:01:15 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3399 ### Version: V4.2022.10.3400
### Updated: Sun Oct 9 10:03:27 UTC 2022 ### Updated: Sun Oct 9 22:01:15 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##