vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3429 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-24 10:12:05 +00:00
parent 02cd29d13e
commit bf05f08c25
46 changed files with 95937 additions and 95937 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3428 #### Version: V4.2022.10.3429
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3428 #### Version: V4.2022.10.3429
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3428 #### Version: V4.2022.10.3429
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11856
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3428 #### Version: V4.2022.10.3429
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11860
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11860
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11860
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11860
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 1; 10.1.1.98 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 0; 10.1.1.98 0;
127.0.0.1 0; 127.0.0.1 0;

11860
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 1; 10.1.1.98 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 0; 10.1.1.98 0;
127.0.0.1 0; 127.0.0.1 0;

11860
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 1; 10.1.1.98 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 0; 10.1.1.98 0;
127.0.0.1 0; 127.0.0.1 0;

11860
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3428 3429

11860
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11860
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.229.226 0; 20.253.182.240 0;

11860
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 1; 10.1.1.98 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 0; 10.1.1.98 0;
127.0.0.1 0; 127.0.0.1 0;

11860
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 1; 10.1.1.98 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 0; 10.1.1.98 0;
127.0.0.1 0; 127.0.0.1 0;

11860
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 1; 10.1.1.98 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 0; 10.1.1.98 0;
127.0.0.1 0; 127.0.0.1 0;

11860
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.229.226 0; 20.253.182.240 0;

11860
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.229.226 0; 20.253.182.240 0;

11860
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 1; 10.1.1.98 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
CODE87 Cocolyzebot
FHscan DSearch
HaosouSpider DomainAppender
JustView EyeNetIE
Mail.RU_Bot RedesScrapy
Sociscraper SearchmetricsBot
Virusdie Sosospider
coccocbot WeSEE
scalaj-http ZumBot
serpstatbot check1.exe

298
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 404checker
80legs 404enemy
AIBOT
ASPSeek ASPSeek
Abonti
AfD-Verbotsverfahren
AhrefsBot
Aipbot Aipbot
Alexibot Alexibot
AllSubmitter AllSubmitter
Ankit Anarchy
Anarchy99
Anthill
Apexoo Apexoo
Attach Aspiegel
AwarioSmartBot Asterias
AwarioRssBot
BBBike BBBike
BDCbot BDCbot
BLEXBot BLEXBot
BackStreet
BackWeb
Backlink-Ceck Backlink-Ceck
Bandit Bandit
Barkrowler Black Hole
BetaBot Bolt
Bitacle BuiltBotTough
BlackWidow BuiltWith
BotALot
Buck
Bullseye
CATExplorador
CCBot CCBot
CODE87
CazoodleBot CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect CensysInspect
CherryPicker
ChinaClaw ChinaClaw
Citoid Chlooe
Claritybot
Cocolyzebot Cocolyzebot
Cosmos Cogentbot
CopyRightCheck
CrazyWebCrawler CrazyWebCrawler
Custo CrunchBot
Curious
CyotekWebCopy CyotekWebCopy
DBLBot
DIIbot DIIbot
DTS Agent DSearch
DataCha0s DatabaseDriverMysqli
Demon Demon
DigitalPebble
Dirbuster
Discoverybot Discoverybot
Dispatch Dispatch
DittoSpyder
DnyzBot
DomCopBot DomCopBot
DomainCrawler Domains Project
DomainSigmaCrawler Dragonfly
DomainStatsBot
Download Wonder
ECCP/1.0 ECCP/1.0
Ecxi EMail Wolf
ExtLinksBot EasyDL
Extractor Ebingbong
Extreme Picture Finder Exabot
ExtractorPro
EyeNetIE EyeNetIE
FDM
Fimap Fimap
Firefox/7.0 Firefox/7.0
FlashGet
Flunky Flunky
Freeuploader
FrontPage
FyberSpider FyberSpider
GT::WWW Fyrebot
GalaxyBot GermCrawler
GetRight
Getintent Getintent
Gigabot Gigabot
Go!Zilla Go-Ahead-Got-It
Gotit
GrabNet GrabNet
Grafula GrapeFX
GridBot GrapeshotCrawler
HaosouSpider HEADMasterSEO
HTMLparser
HTTP::Lite
Harvest Harvest
Havij Hloader
HonoluluBot
Humanlinks
IRLbot IRLbot
Iblog IlseBot
Id-search IndeedBot
Image Fetch Iria
InfoNaviRobot JOC Web Spider
InterGET JamesBOT
IstellaBot JennyBot
Jbrofuzz
JetCar JetCar
Joomla Jetty
Jyxobot JikeSpider
Keybot Translation-Search-Machine Kozmosbot
Keyword Density LNSpiderguy
Kinza LWP::Simple
Lanshanbot Lanshanbot
Larbin
LeechGet
LexiBot LexiBot
Lftp
LibWeb
Libwhisker Libwhisker
Lightspeedsystems Lightspeedsystems
Likse
LinkScan LinkScan
Linkbot Linkbot
Lipperhey LinksManager
Lmspider Ltx71
MIDown tool MIDown tool
MTRobot
Mag-Net Mag-Net
Magnet Magnet
Mail.RU_Bot Majestic SEO
MarkWatch MarkMonitor
Mass Downloader MeanPath Bot
Masscan
Meanpathbot
Mediatoolkitbot Mediatoolkitbot
MicroMessenger Metauri
Mister PiX Microsoft Data Access
Minefield
Moblie Safari Moblie Safari
Mojeek Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
Musobot Nameprotect
Navroad Nessus
Net Vampire
NetLyzer NetLyzer
NetMechanic NetSpider
NetZIP NetZIP
Netvibes Nettrack
NextGenSearchBot
Nibbler Nibbler
Niki-bot Niki-bot
Nimbostratus Nimbostratus
Nuclei Not
Nutch Octopus
Offline Navigator
OnCrawl OnCrawl
OpenVAS
OutclicksBot OutclicksBot
PECL::HTTP PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageThing.com Pandalytics
Papa Foto
Pavuk Pavuk
PeoplePal PeoplePal
Picsearch Picscout
PleaseCrawl PictureFinder
ProWebWalker Piepmatz
QueryN Metasearch Pimonster
RankActive Pixray
Pu_iN
Pump
PyCurl
RankingBot RankingBot
ReGet Reaper
RealDownload RedesScrapy
RepoMonkey Ripper
Rogerbot SEOlyticsCrawler
SBIder SEOprofiler
SEOkicks
SEOstats
SISTRIX SISTRIX
Screaming SalesIntelligent
ScanAlert
Scrapy
ScrepyBot ScrepyBot
SearchmetricsBot
Semrush Semrush
SentiBot SentiBot
SeobilityBot SeobilityBot
Seomoz
Shodan Shodan
Site Sucker Site Sucker
Sitebeam SiteCheckerBotCrawler
Siteimprove SiteSucker
Sitevigil Sitevigil
Snake
Snapbot
SocialRankIOBot
Sociscraper Sociscraper
Sottopop Sosospider
Spammen Spammen
Spinn3r SpankBot
Sqlworm Spanner
Stripper Sqlmap
Surfbot Steeler
Szukacz SuperBot
Telesphoreo SuperHTTP
Suzuran
Swiftbot
T0PHackTeam
TeleportPro
Telesphorep
TheNomad TheNomad
Thumbor TightTwatBot
Titan
Toata Toata
Toweyabot Toweyabot
Trendiction Tracemyfile
TurnitinBot Trendictionbot
TwengaBot Turnitin
Typhoeus Typhoeus
URLy.Warning
UnisterBot UnisterBot
VB Project VB Project
VCI VCI
Vacuum VelenPublicWebCrawler
Vagabondo VeriCiteCrawler
VidibleScraper
Virusdie
WASALive-Bot WASALive-Bot
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0 Wallpapers/3.0
Web Auto WallpapersHD
Web Enhancer WeSEE
Web Fetch
Web Fuck Web Fuck
Web Sauger
Web Sucker Web Sucker
WebBandit WebBandit
WebEnhancer WebEnhancer
WebImageCollector WebFetch
WebReaper WebFuck
Webalta WebSauger
WebmasterWorldForumBot WebSucker
Webshag WebZIP
Website Quester Website Quester
Webster WebsiteQuester
Who.is Bot Whack
WinHTTrack WinHTTrack
Wonderbot
Woobot
Wotbox Wotbox
Wprecon
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot YoudaoBot
Zade Zade
Zermelo Zauba
Zeus Zeus
ZoominfoBot ZumBot
archive.org_bot ZyBorg
arquivo-web-crawler arquivo-web-crawler
arquivo.pt
autoemailspider autoemailspider
cah.io.community backlink-check
coccocbot clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback crawler.feedback
dataforseo.com facebookscraper
demandbase-bot
eCatch
gopher
instabid instabid
linkdexbot linkdexbot
meanpathbot lwp-request
lwp-trivial
oBot oBot
pcBrowser
ripz
s1z.ru
satoristudio.net
scalaj-http scalaj-http
scan.lol seobility
seocompany.store sogouspider
seoscanners
sexsearcher
sitechecker.pro
sp_auditbot
sysscan sysscan
x09Mozilla trendiction.de
webgains-bot
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
zauba.io zauba.io
zgrab zgrab

310
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
ASPSeek 404checker
80legs
ADmantX
AIBOT
Abonti Abonti
Aboundexbot AhrefsBot
Acunetix
AfD-Verbotsverfahren
Aipbot
Alligator Alligator
Ankit
Anthill Anthill
Aspiegel Aspiegel
AwarioSmartBot Asterias
BDFetch Attach
Badass AwarioRssBot
BBBike
BDCbot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
BatchFTP
Bigfoot Bigfoot
Black Hole Black Hole
BlowFish Blackboard
Boardreader
Bolt
BotALot BotALot
Buck
Buddy
BuiltBotTough
Bullseye Bullseye
BunnySlippers CATExplorador
Cegbfeieh Calculon
Cloud mapping CazoodleBot
Copier CheeseBot
Cosmos Citoid
Crawling at Home Project Claritybot
CrazyWebCrawler Cocolyzebot
CrunchBot Collector
Curious Copyscape
Custo Craftbot
DBLBot CyotekWebCopy
DataCha0s DIIbot
Demon Deusu
Digincore
DigitalPebble DigitalPebble
Dirbuster
Disco
Discobot
Dispatch Dispatch
DittoSpyder DittoSpyder
DomCopBot DomCopBot
DomainStatsBot DomainAppender
Dotbot Dotbot
Download Wonder
EMail Siphon EMail Siphon
EMail Wolf EasyDL
Ebingbong Ebingbong
EirGrabber EirGrabber
EroCrawler Extractor
Exabot
Extreme Picture Finder Extreme Picture Finder
Ezooms Ezooms
FemtosearchBot FHscan
Firefox/7.0 Fimap
FlashGet
Flunky
Freeuploader
FrontPage
Fuzz Fuzz
FyberSpider GT::WWW
GetWeb GetRight
Getintent Getintent
Gigabot Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla GrapeFX
Grafula
GridBot GridBot
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite HTTP::Lite
HTTrack
Haansoft Haansoft
HaosouSpider
Harvest Harvest
Havij HybridBot
Heritrix
IDBTE4M
Iblog Iblog
Id-search Id-search
Image Fetch
InfoTekies InfoTekies
Intelliseek
InterGET
Internet Ninja Internet Ninja
Iskanie Iria
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT JennyBot
JetCar JetCar
Joomla Jetty
Jorgee
JustView JustView
Kenjin Spider Keybot Translation-Search-Machine
Keyword Density Keyword Density
LWP::Simple Kozmosbot
LNSpiderguy
Lanshanbot Lanshanbot
LeechGet Larbin
Leap
LeechFTP
Lftp Lftp
LibWeb Libwhisker
LinkScan LinkScan
LinkextractorPro LinkextractorPro
LinqiaRSSBot LinqiaScrapeBot
Litemage_walker MFC_Tear_Sample
Lmspider
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Magnet
Majestic-SEO Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader Mass Downloader
Masscan
Mb2345Browser Mb2345Browser
Mister PiX MeanPath Bot
Mr.4x3 Metauri
Name Intelligence MicroMessenger
Navroad Microsoft Data Access
NetLyzer Moblie Safari
Morfeus Fucking Scanner
Musobot
NICErsPRO
NPbot
NearSite
Needle
NetMechanic
NetSpider NetSpider
NetZIP NextGenSearchBot
Nettrack Niki-bot
Netvibes Nmap
Ninja Nuclei
Offline Explorer Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS
Openfind Openfind
Openvas
OrangeBot OrangeBot
OutfoxBot OutfoxBot
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer Pandalytics
PageGrabber Panscient
PageScorer Papa Foto
PageThing.com
PeoplePal
Petalbot
Pi-Monster Pi-Monster
PictureFinder
Piepmatz
Pimonster
Pixray
Pockey
ProPowerBot ProPowerBot
ProWebWalker ProWebWalker
Probethenet Pu_iN
Psbot PxBroker
Pump
QueryN Metasearch QueryN Metasearch
RankingBot2 RankActive
Re-re Re-re
RealDownload RebelMouse
Recorder Recorder
RepoMonkey Rogerbot
Ripper
RocketCrawler
SEOkicks SEOkicks
SEOprofiler SEOprofiler
ScanAlert SMTBot
ScoutJet ScoutJet
ScreenerBot
Searchestate Searchestate
SemanticJuice SemrushBot
SentiBot
SeoSiteCheckup SeoSiteCheckup
Seomoz
Shodan Shodan
Siphon
Site Sucker
SiteExplorer SiteExplorer
SiteSnagger SiteSnagger
Siteimprove Sitevigil
SmartDownload SlySearch
Snapbot
Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper Sociscraper
Sosospider
Spammen
SpankBot
Spanner
Spbot Spbot
Sqlmap Spinn3r
Stripper Steeler
Sucuri SuperBot
Surfbot
SurveyBot SurveyBot
Suzuran Suzuran
Swiftbot T0PHackTeam
Szukacz Telesoft
Teleport TightTwatBot
TeleportPro Titan
The Intraformant
TheNomad
Thumbor
Toata Toata
Tracemyfile Toweyabot
Trendiction Trendiction
True_Robot Trendictionbot
Turnitin Turnitin
Typhoeus URLy Warning
V-BOT URLy.Warning
VCI Vacuum
Vagabondo VeriCiteCrawler
VelenPublicWebCrawler VidibleScraper
Virusdie Virusdie
VoidEYE
WASALive-Bot WASALive-Bot
WEBDAV WISENutbot
WPScan WWW-Collector-E
WWW-Mechanize WWW::Mechanize
Wallpapers WWWOFFLE
WeSEE Web Enhancer
Web Auto
Web Collage
Web Fetch Web Fetch
Web Pix Web Pix
WebFuck Web Sauger
WebGo IS Web Sucker
WebAuto
WebEnhancer
WebFetch
WebImageCollector
WebLeacher WebLeacher
WebPix
WebSauger
WebWhacker
Webalta
Webshag Webshag
WebsiteQuester
Whack Whack
Whacker Whatweb
WinHTTrack WinHTTrack
Wonderbot
Wprecon Wprecon
Xaldon_WebSpider YoudaoBot
Xenu
Zauba Zauba
Zermelo Zeus
ZyBorg Zitebot
ZoomBot
ZumBot
adscanner
arquivo.pt arquivo.pt
backlink-check check1.exe
cah.io.community
clark-crawler clark-crawler
dataforseo.com coccocbot
demandbase-bot crawl.sogou.com
domainsproject.org domainsproject.org
facebookscraper gopher
internetVista monitor internetVista monitor
lwp-request
lwp-trivial
meanpathbot meanpathbot
netEstate NE Crawler mediawords
muhstik-scan
oBot oBot
page scorer page scorer
pcBrowser pcBrowser
plumanalytics plumanalytics
probe-image-size ripz
seocompany.store scalaj-http
scan.lol
seostar seostar
serpstatbot
sexsearcher
sitechecker.pro sitechecker.pro
sogouspider
sp_auditbot sp_auditbot
sysscan sysscan
tAkeOut
trendiction.com trendiction.com
webpros.com trendiction.de
webgains-bot
webmeup-crawler
webprosbot webprosbot
zgrab x09Mozilla
x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aac52006ec82a24e08b665f4db2b5013f7.com asrvvv-a.akamaihd.net
alphahoverboards.com clickcash.com
carrauterie.be corta.co
eachdayisagift.review dogbreedspicture.net
gettpromos.com karachev-city.ru
pornoforadult.com picphotos.net
siteimprove.com proekt-mos.ru
writersgroup580.web.fc2.com seogadget.ru
yellowads.men vysigy.su
zaloro.com zzlgxh.com

944
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0c47f8422d3f.com 11pikachu.ru
0n-line.tv 1314dh.com
123locker.com 20pascals.nl
1kdailyprofit.me 214jaluwobapef.cf
55wmz.ru 28n2gl3wfyb0.ru
5forex.ru 300richmond.co.nz
5kstore.com 3th.co.in
a96527gi.beget.tech 8jn.dating-app.ru
aasoldes.fr 98oi.ru
abcdeg.xyz aa9d046aab36af4ff182f097f840430d51.com
abclauncher.com aac500b7a15b2646968f6bd8c6305869d7.com
abwa.tk absolute-s.ru
acmebtn.ml adktrailmap.com
adbetclickin.pink
adrunnr.com adrunnr.com
adsref.men adzerg.com
adtech.de agysya.ru
aihelen.net aimayangzhi.com
air-edem.ru alienwheels.de
alienwheel.es all-number.com
alif-ba-ta.com aloofly.com
all-streaming-media.com
allcredits.su
allesohnegirls.net
allproblog.com
amoi.tn amoi.tn
angkortours.vn anapa-inns.ru
animal-drawings.com antons-transporte.de
apifasterlightin-a.akamaihd.net app-ready.xyz
apimossnetinfo-a.akamaihd.net appfixing.space
apiwebwebgetcom-a.akamaihd.net apxeo.info
app5.letmacworkfaster.world arcadepages.com
appleid-verification.com arcteryxsale.online
arcadeplayhouse.com arpelsreplica.xyz
ardimobileinfo.ml artparquet.ru
artefakct.com as5000.com
asscenihotosidea.blogspot.co.za asmxsatadriverin.aircus.com
astana.xxxkaz.org asseenontv.ru
atlant-auto.info atlasvkusov.ru
autonew.biz atleticpharm.org
avtovolop.ru autodo.info
b2b-lounge.com autogrep.ru
bagsonsale.online avon-novosib.ru
banki76.ru avto-oligarh.ru
bausparen.bz.it balois.worldbreak.com
bannerconnect.net
battle.net
bdsmgalls.net
becuo.com
belstaffstore.online
best-deals-products.com best-deals-products.com
best-mam.ru bestmobilityscooterstoday.com
best-seo-solution.com
bestcurs.org
bestmouthwash.club bestmouthwash.club
bestwebsiteawards.com bestplacetobuyeriacta.jw.lt
bestwebsitesawards.com beta.hotkeys.com
big-cash.net bibys.com
biketank.ga biglistofwebsites.com
bizlist.com.de bigpenisguide.com
bkns.vn binaryoptionscops.info
bloggerads.net bio-market.kz
brandedleadgeneration.com bitcoins-live.ru
brandimensions.com blogrankers.com
breastaugmentation.co.za bmsco.co
breget74.ru bombla.org
brendbutik.ru bonzybuddy.com
bristolhotel.com braip.com.br
bryansk.zrus.org brianhenry.co
buketeg.xyz brk-rti.ru
buqyxa.rincian.info bugof.gq
buy-loft.ru business-suggested.tk
buyclomidonlaine.com buytizanidineonlinenoprescription.blogspot.com
bvlgariring.xyz bycontext.com
calc-for-credit.ru byme.se
cardul.ru c-gainsbourg.com
ccjp.eu canrioloadm.gq
ceotrk.com cars-modification.net
cezartabac.ro cartierlovestore.xyz
cheapbarbour.online catalogs-parts.com
chinaelitecheapjerseys.com chatroulette.si
cheapjerseysfootballshop.com
chocolateslim-en-espana.com
choosecuisine.com
chorus.terakeet.com chorus.terakeet.com
christianlouboutinreplica.win ciekawinki.pl
christianlouboutinshoes.xyz cigarpass.com
cialiswithoutadoctor.net cityadspix.com
cibpenonptib.flu.cc cleanallvirus.com
cl.s7.exct.net club-musics.ru
clickaider.com cocolyze.com
clickpapa.com cometorussia.net
clicksotrk.com compliance-barak.xyz
compliance-alex.xyz compliance-don.top
compliance-don.xyz compliance-elena.top
compliance-donald.xyz compliance-walt.top
compliance-fred.xyz constantaservice.net
compliance-walter.top contextualyield.com
concealthyself.com copenergo.ru
conciergegroup.org cracksplanet.com
contentlook.co cranly.net
cookie-law-enforcement-aa.xyz cyse.tk
copblock.org dame-ns.kz
copypaste.traderzplanet.in danashop.ru
cscwtalkto.site descargar-musica-gratis.net
cutt.us designdevise.com
dafatiri.com dipstar.org
dangphoto.trade directivepub.com
datract.com discountliv.com
dawlenie.com divatraffic.com
dbmkfhqk.bloger.index.hr divci-hry.info
dealwifi.com dividendo.ru
decorationspcs.com djihispano.com
delfin-aqua.com.ua dodlive.mil
depositfiles-porn.ga dogbreedspicture.net
design-ideas.info dokfilms.net
deutschehobbyhuren.net donvito.unas.cz
diffbot.com
dikqlyremy.info
dimkino.ru
diy-handmade-ideas.com
dms-sw.ru
dojki-hd.com
doska-vsem.ru doska-vsem.ru
doxysexy.com download-walpaperhd.blogspot.com
drivotracker.com e-buyeasy.com
drugspowerstore.com eaplay.ru
dscaas.website easyshoppermac.com
duplicashapp.com ege-russian.ru
dvervmoskvu.ru ekosmetyki.net.pl
dwomlink.info ekto.ee
eandsgallery.com electrik-avenue.com
ed-shop01.ru elektronischezigarette2.mex.tl
eduinfosite.com elektrozigaretten1.webs.com
ege-essay.ru emediate.eu
electro-prom.com empathica.com
elektrischezigarette2.onsugar.com ertelecom.ru
elektrozigarettekaufen2.blogse.nl
emerson-rus.ru
eredijovon.com
escortslet.net escortslet.net
espaceinventoristes.com exci.ru
estelight.ru expolicenciaslatam.co
evehemming.blogspot.com.au expresstoplivo.ru
ewebarticle.info extlinks.com
extads.net
extractorandburner.com extractorandburner.com
eyessurgery.ru eyelike.com.ua
ezigaretteshop.webs.com ezigarettenkaufen1.pagina.gr
familyholiday.ml f012.de
fashion-mk.net f5mtrack.com
fastcrawl.com falcon-images.blogspot.com
filefilter.weebly.com family1st.ca
filerockstar298.weebly.com faracontrol.ir
filesvine.com fickkontaktehobbyhuren.com
filmetricsasia.com filesdatabase.net
filmfanatic.com flex4launch.ru
financeloan.us
firesub.pl
fitfloponline.store
fiuxy.com
flirt4free.com
fodelsedagspresenter.nu fodelsedagspresenter.nu
fok.nl
footballfarrago.com footballfarrago.com
fordsonmajbor.cf forensicpsychiatry.ru
forex21.ru forminecrafters.ru
frameimage.org fortwosmartcar.pw
free-video-tool.com foto-telok.net
freelinkbuilding.website.tk fr-bearings.ru
freshsuperbloop.com fr.netlog.com
freza-sverlo.ru franklinfire.co
gallictures.com fuel-gas.com
gamezblox.com fungamelands.com
gamingspark.com gallery.rennlist.com
ge0ip.com gamedayassist.com
generalporn.org gamevalue7.weebly.com
genericviagrasildenafiled.net gay.adultgalls.com
getresponse.com gaytube.com
gg.zzyjxs.com gdebestkupit.ru
goatse.ru genetworx.com
gogps.me gfaq.ru
golden-praga.ru gigapeta.com
googlefeud.com girls-ufa.ru
goosefishpost.bid global-ics.co.za
gotwebsite1.com golaya.pw
growmyfunds.ca goodnightjournal.com
gsasearchengineranker.site googst2.ru
gta-club.ru gorabagrata.ru
guitar-master.org greendream.com.ua
gunsvicceadadebt.tk grizzlysgrill.com
handsandlegs.ru gsasearchengineranker.space
hao123.com gsasearchenginerankerhelp.com
hasfun.com gsmlab.pl
guildebzh.info
guruofcasino.com
gwagka.com
haikuware.com
hamilton.ca
hccoder.info hccoder.info
heartofpayne.xyz hchha.com
hermesbelts.xyz headpharmacy.com
histats.com hebr.myddns-flir.com
hobild.net hem.passagen.se
hoholikik.club hermesbirkinhandbagoutlets.com
homeinns.com highspeed5.net
homelygarden.com homegardenlova.com
hoporno.com hosting-tracker.com
hotchatdate.com hoterika.com
hotdl.in hotgirlhdwallpaper.com
hothot.ru humanorightswatch.org
house.sieraddns.com humbmosquina.tk
housediz.com hunterboots.online
hoverboard360.at idc.com.ua
hoverboard360.nl igtools.club
hydropump.su imgata.com
iamsport.org imperiafilm.ru
ideawheel.com incep.imagine-ex.co
iloveitaly.ru infodocsportal.com
ilovevitaly.com innodgfdriverhm.aircus.com
ilovevitaly.xyz instakink.com
imgarit.pw intermesh.net
impisr.ru io9.com
importchinacoach-teach.com iptool.xyz
indianmedicaltourismshop.com irunfar.com
intervsem.ru istizanidinelikexanax.blogspot.com
istripper.com janettabridal.com
johnnyhaley.top jerseychinabizwholesale.us
jpcycles.com jerseysbizwholesalecheap.com
juliaworld.net jerseywholesalechinabiz.com
kaidalibor.de jetsli.de
karachev-city.ru jewelryandfiligree.com
kazinogames.lv jikoman.info
ketrzyn.pl jjbabskoe.ru
keywords-monitoring-success.com jobmarket.com.ua
khadastoafarde.tk jongose.ninja
kidd.reunionwatch.com juliadiets.com
kiinomaniak.pl justbcause.com
kinky-fetishes.com jyrxd.com
kalandranis.gr
kamorel.com
kartiniresto.com
keenoutlet.online
kemerovo.zrus.org
kino-rf.ru
kinobest.pl kinobest.pl
kinozapas.org kirov.zrus.org
kiprinform.com klikbonus.com
komputernaya-pomosh-moscow.ru kongruan.com
konturkrasoty.ru kopihijau.info
kountrylife.com krafte.ru
ks1234.com kraljeva-sutjeska.com
kung-fu-ru.com krasnodar.zrus.org
laapp.com kredit-blog.ru
labvis.host.sk kvartira-sutochno.com
landmania.ru ladsblue.com
laptop-4-less.com languagecode.com
lawyersinfo.org lapitec.eu
laudit.ru
leboard.ru leboard.ru
lecbter-relationships.ga leftofcentrist.com
legalrc.biz
lennatin.info
letmacwork.world letmacwork.world
letslowbefast.today linkpulse.com
lexixxx.com liveinternet.ro
lightinghomes.net liver-chintai.org
lignofix.ua liverpool.gsofootball.com
littlesexdolls.com locatellicorretor.com.br
livingcanarias.com louboutinreplica.xyz
locimge.pw m3gadownload.pl
lomb.co mafcards.ru
lonfon.xyz
lookingglassemb.com
lost-alpha.ru
magiadinamibia.blogspot.com magiadinamibia.blogspot.com
makedo.ru make-money-online.com
makenahartlin.com makenahartlin.com
markjaybeefractal.com malwareremovalcenter.com
mebeldekor.com.ua mantramusic.ru
medanestesia.ru manuscript.su
mediaoffers.click marmotstore.online
mega-bony-2017.pl mathgym.com.au
max-eclat.men
medkritika.ru
megagrabber.ru megagrabber.ru
memberty.com megavolt.net.ua
metaxalonevstizanidine.blogspot.com member-quiz.com
mhtr.be mere.host.sk
microsoftportal.net meteocast.net
microstatic.pl michaelkorssaleoutletonline.net
millionare.com middlerush-a.akamaihd.net
mini-modus.ru mlvc4zzw.space
missis.top mnogabukaff.net
monclerjacketsoutlet.win mobile.ok.ru
moncleroutletonline.win moncleroutletonline.win
moncleroutletonline.xyz monetizationking.net
monsterdivx.com morepoweronmac.trade
monsterdivx.tv moyakuhnia.ru
most-kerch.org moz.com
most.gov.iq
moviemail-online.co.uk
muschisexbilder.com muschisexbilder.com
mydoctorok.ru mvpicton.co.uk
naj-filmy24.pl myindospace.com
najaden.no na-telefon.biz
napalm51.nut.cc na15.ru
negral.pluto.ro naturalbreakthroughsresearch.com
naughtyconnect.com
negociosdasha.com
nelc.edu.eg
netpics.org
newhairstylesformen2014.com
newyorkhotelsmotels.info
nfljerseysforsalewholesaler.com
nibbler.silktide.com nibbler.silktide.com
nightvision746.weebly.com njpalletremoval.com
nlfjjunb5.ru norththeface.store
nordstar.pro nosecret.com.ua
notaria-desalas.com nucia.biz.ly
notebook-pro.ru nudejapan.net
novgorod.xrus.org odoratus.net
nuup.info office-windows.ru
nvformula.ru officedocuments.net
o-dachnik.ru onblastblog.online
o-o-8-o-o.ru onlineslotmaschine.com
oecnhs.info onlyforemont.ru
ohmyrings.com ororodnik.goodbb.ru
omgtnc.com osagonline.ru
oneshotdate.com ownshop.win
online-templatestore.com oyster-green.com
onlythegames.com pandroid.co
openfrost.com paramountmarble.co.uk
optikremont.ru patterntrader-en.com
orenburg-gsm.ru pcimforum.com
outrageousdeal-a.akamaihd.net pensplan.com
pacificair.com pensplan4u.com
partybunny.ru perm-profnastil.ru
pechikamini.ru pertlocogasilk.tk
peekyou.com photosaga.info
pekori.to php-market.ru
photo.houseofgaga.ru pics-group.com
pictures-and-images.net picsforkeywordsuggestion.com
picturesboss.com picturesify.com
pirateday.ru pills24h.com
piter.xrus.org pinup-casino1.ru
playlott.com pizdeishn.com
plohaya-kreditnaya-istoriya.ru pl-top.pl
poem-paying.gq poligon.com
pokemongooo.ml polimga.pw
popserve.adscpm.net
popugaychiki.com popugaychiki.com
porno-play.net popunder.ru
pornowarp.info porndl.org
poshiv-chehol.ru porndroids.com
positive2b.ru porno-dojki.net
pospr.waw.pl porno-home365.com
powenlite24.ru pornoreino.com
pp-budpostach.com.ua portnoff.od.ua
predominant-invent.tk portside.xyz
privatefx-in.ru posible.net
privetsochi.ru preg.marketingvici.com
qpypcx.com preparevideosafesystem4unow.site
quickchange.cc prize44.com
rangoman.date prodess.ru
rarbg.to producm.ru
rebrand.ly professionaldieselcare.com
remont-comp-pomosh.ru projefrio.com.br
rentaremotecomputer.com prostitutki-astana.org
replicalouboutin.xyz pussysaga.com
rewardit.com quality-traffic.com
rockprogblog.com realting-moscow.ru
rukino.org realtytimes.com
rusvideos.su rebuildermedical.com
rvzr-a.akamaihd.net reckonstat.info
ryetaw.com registry-cleaner.net
sabaapress.com renecaovillasale.online
saddiechoua.com rucrypt.com
sanidumps.com runtnc.net
savingsslider-a.akamaihd.net russkie-gorki.ru
sbdl.no s-iwantyou.com
sbtdesign.co.uk sakhboard.ru
scanmarine.info samo-soznanie.ru
scanmyphones.com sarf3omlat.com
scanner-alexa.top sarm.tk
scanner-brian.top sbetodiodnye-lampy.ru
scanner-don.top sbf441.com
scanner-donald.top scalerite.co.za
scanner-jess.top schlampen-treffen.com
scanner-walt.top seansonline24.pl
searchimage.co search-goo.com
securityallianceservices.com searchwebknow-a.akamaihd.net
semaltmedia.com seasaltwithfood.com
sendearnings.com sei80.com
seo-platform.com seoanalyses.com
seoheap.com sevendays.com.ua
seokicks.de sexyali.com
seoprofiler.com ship-marvel.co.ua
seorankinglinks.xyz shopperifymac.com
service.adtech.fr shoppytoolmac.com
sex-watch.com shopwme.ru
sex.hotblog.top shtaketniki.ru
sexflirtbook.com sideeffectsoftizanidine.blogspot.com
sexpartygirls.net signal03.ru
sfj-ror.no site-auditor.online
sharebutton.net siteexpress.co.il
shop-electron.ru smadihome.com
shtaketniki.kz smartpet.ru
sibecoprom.ru snjack.info
sildenafilcitratemed.com snts.shell-pmr.ru
sisi-go.ru soaksoak.ru
siteimprove.com social-fun.ru
sladkoevideo.com socialmadesimple.com
slimcdn.com softxaker.ru
smallseotools.com sogimlecal.tk
socas.pluto.ro solitaire-game.ru
social-button.xyz sosdepotdebilan.com
social-search.me spacash.com
sockshare.net spamnuker.com
soft-program.com sr-rekneskap.no
softonicads.com sribno.net
softtor.com startwp.org
softwaretrend.net steelmaster.lv
soserfis.com sterva.cc
soundfrost.org stop-gepatit.te.ua
spasswelt.net stpolice.com
splendorsearch-a.akamaihd.net subj.ukr-lit.com
stackthatbucks.com sugarlyflex.pw
star61.de superoboi.com.ua
stard.shop surflinksmedical.com
stardevine.com surgut.zrus.org
sticken.co szucs.ru
stoki.ru talant-factory.ru
surfbuyermac.com technika-remont.ru
swinon.site
tedy.su
teenbbw.yopoint.in teenbbw.yopoint.in
telefonsexsofort.tk teesdaleflyballclub.co.uk
templates.franklinfire.co tfxiq.com
thaismartloan.com thebestweightlosspills.ovh
thecounter.com thedownloadfreeonlinegames.blogspot.com
themeforest.net thenetinfo.com
thepantonpractice.co.uk thenews-today.info
thexart.club thepokertimer.com
ticketsys.inetwd.com thiegs.reco.ws
tivolibasket.it tivolibasket.it
tizanidineformigraines.blogspot.com tizanidinehcl2mg.blogspot.com
tizanidinehcl2mgtablet.blogspot.com tizanidinehcl4mgtabinfo.blogspot.com
tizanidinehcl4mgtablet.blogspot.com tizanidineingredients.blogspot.com
tizanidineinfo.blogspot.com topappspro.com
tjkckpytpnje.com topbestgames.com
tnaionline.org topquality.cf
top10-online-games.com totu.info
topshef.ru toursmaps.com
torrentgamer.net toxicwap.com
totu.us toyota.7zap.com
touchmods.fr trackmedia101.com
track.deriv.com traxdom.ru
tradgardspartner.se turizmus.us
trafaret74.ru tvteleport.ru
tramadolandtizanidine.blogspot.com udsgame.online
tuberkuleznik.ru ukkelberg.no
tvnewsclips.info undergroundcityphoto.com
tvorozhnaja-zapekanka-recept.ru
typimga.pw
uginekologa.com
ukr-lit.com
ukrtvory.in.ua
umaseh.com
unmaroll.ya.ru
upproar.com upproar.com
usiad.net url2image.com
urldelivery.com
ussearche.cf
usswrite.com usswrite.com
valmetrundan.se v-doc.co
vclicks.net validdomain.xyz
vedomstvo.net vbtracker.net
venerologiya.com vchulkah.net
ventelnos.com vereo.eu
vepad.com viagra-soft.ru
via-energy-order.com
viberdownload10.com viberdownload10.com
videositename.com videonsk.com
vids18.site videooko.weebly.com
vipsiterip.org vip-dom.in
vizag.kharkov.ua vip-file.com
vkgaleria.com vip2ch.com
vtcdns.com volgograd.xrus.org
warezaccess.com vostoktrade.info
waterpurifier.club vriel.batcave.net
webcamtalk.net w-journal.ru
webix.me wallpapersdesk.info
website-analyzer.info watch-movies.ru
websiteaccountant.de watchdogs-2.ru
weddingdresses.xyz webkeyit.com
wfb.hatedriveapart.com weblo.com
whereverdesperate.gq webmasterhome.cn
wineration.com webpromotion.ae
wiosenny-bon-1500.pl webscouter.net
withstandingheartwarming.com westen-z.life
wpthemedetector.co.uk wholinkstome.com
www.888.com world-mmo.com
www.arenda-yeisk.ru worldoffiles.ru
www.timer4web.com www.solartek.ru
x-diesel.org x-diesel.com
xaijo.com x69ty.ru
xblognetwork.com xblognetwork.com
xn----9sbebi2bvzr7h.xn--p1ai xchangetrak.com
xn--1-8sbcpb0bdm8k6a.xn--p1ai xev.ru
xn--b1ag5cfn.xn--p1ai xfluro.com
xn--b1agm2d.net xjrul.com
xn--d1aifoe0a9a.top xmladserver.com
xn--e1aggki3c.xn--80adxhks xmlinde.com
xn--oogle-wmc.com xmnb.net
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
xn--80aodinpgi.xn--p1ai
xn--90acenikpebbdd4f6d.xn--p1ai
xn--b1addnj3cah.xn--p1ai
xnxx699.com
xpresscare.ru
xvideosbay.com
xxlargepop.com xxlargepop.com
xxxguitars.com yellocloud.be
yatrk.xyz yellowproxy.net
youbrainboost.asia yottos.com
youghbould.wordpress.com yougame.biz
youraticles.pl youjizz.vc
zacreditom.ru yourporngay.com
zaimhelp.ru yourserverisdown.com
zarabotok--doma.ru zajm-zalog-krasnodar.ru
zastenchivosti.net zatjmuzu.info
zeroredirect11.com zeroredirect1.com
zirondelli.it zhuravlev.info
znakomstva-piter78.ru zigarettenonlinekaufen1.bloog.pl
zoogdinsney.com zrus.org
zoomovies.org zvetki.ru
zscaler.net zygophyceous.womanstars.site
zvuker.net zytpirwai.net

474
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1001desert.com 101billion.com
12masterov.com 1adult.com
3rbseyes.com 1bet.com
5elementov.ru 2daytrendingnews.com
5u.com 2nt.ru
6hopping.com 3weekdiet.com
8xv8.com 91abcw.com
aaronabel.com 9med.net
aghanyna.com aa8780bb28a1de4eb5bff33c28a218a930.com
airlandsea.info academiacsmendoza.org
akita.kz adclickthru.net
alienwheel.es adtech.de
allpdfmags.net aero2.ru
anmysite.com airmaxshoes-2016.com
anniemation.com alert-hgd.xyz
apishops.ru alt-servis.ru
am-se.com
aosheng-tech.com
apiadanaknet-a.akamaihd.net
apimountainbikei-a.akamaihd.net
apper.de apper.de
approvedlocal.co.za appfastplay.com
applyneedy.xyz
arcadeplayhouse.com arcadeplayhouse.com
arendatora.ru arraty.altervista.org
arendovalka.xyz azartmsl.com
avirasecureserver.com
awency.com
back.dog back.dog
backlink4u.net balans.shahterworld.org
bannerconnect.net bannerbank.ru
bannertesting.com bitcoins-live.ru
battleforupdating.site bjorkbacken.nu
betshuckclean.com bloggerads.net
beyan.host.sk blue-square.biz
big-cash.net bronzeaid-a.akamaihd.net
biographiya.com
bizcheapjerseyswholesalechina.com
blog.f00kclan.de
bloke.com
bodybuilding-shop.biz
bongacams.com
brainzpod.win
bscodecs.com
bupropion-sr-150-mg.us bupropion-sr-150-mg.us
buron.pw camdenmemorials.com
buy-cheap-online.info candlehandmade.com
buy-meds24.com canrole.com
buydissertation.net cartierloveringreplica.xyz
buytizanidineonline.blogspot.com chatroulette.world
canzoni.ru cheapsergiorossi.online
check-host.net cineacademy.ru
cindymatches.com circlesl.com
clips.ua.ac.be classiquebijoux.ru
colehaanoutlet.store clothesforcash.com
counterbot.com cmhomestayagency.com
culturevie.info com-onlinesupport.site
customerguru.in compliance-alex.top
dirtpics.pw compliance-alexa.xyz
doska-vsem.ru concordexoticrentals.com
dostavimvdom.ru cpajunkies.com
dvrlists.com crest3d.ru
efnor-ac.com cymbaltaandtizanidine.blogspot.com
election.interferencer.ru doeco.ru
enbersoft.com domainsphoto.com
enthuse.computernetworksonline.com downloadeer.net
erotik-kostenlos.net elektrozigarette1.dreamwidth.org
executehosting.com elstal.com.pl
fakehandbags.xyz energydiet24.ru
feeriaclub.ru ertelecom.ru
ferretsoft.com estelight.ru
fillmewithhappiness.com excitacao.com
fitfloponline.store ezigarettenshop2.myblog.de
flirt4free.com fashion-stickers.ru
fr-bearings.ru fettefrauen.net
free-social-buttons.xyz findthe.pet
freetangodownload.com floridahuntingfishingadventures.com
froggytube.com flowersbazar.com
gamezblox.com footbalive.org
ge0ip.net forodvd.com
glass-msk.ru forum20.smailik.org
glcomputers.ru forzeronly.com
gnuetella.com free-fbook-traffic.com
golden-praga.ru frustrated-favorable.gq
gorabagrata.ru funtoonez.com
gratuitxblcodes.com gamblingnerd.com
gta-club.ru gamebackyard.com
gwebtools.com ghazel.ru
hamilton.ca gheus.altervista.org
hdpixent.com gotcher.us
healbio.ru greatidea.marketing
hidemyass.com growboxbl.ru
homelygarden.com guitar-master.org
homik.pw hacktougroup.ru
hornymatches.com hatdc.org
hostcritique.com hotgirlhdwallpaper.com
hosting-tracker.com ideibiznesa2015.ru
housediz.com ido3.com
impisr.edunsk.ru imitex-plus.ru
incanto.in.ua incanto.in.ua
incest-ru.com inmate-locator.us
infokonkurs.ru instabid.tech
internetproviderstucson.com investzalog.ru
investpamm.ru ip-guide.com
islamtoday.co.za kamorel.com
istmira.ru karaganda.xkaz.org
iwanttodeliver.com kazrent.com
javrip.net kinobest.pl
justdating.online kinosed.net
kazka.ru knowyournextmove.com
kemerovo.zrus.org landscaping.center
keywordblocks.com
keywordhouse.com
kidskunst.info
kinofak.net
kirov.zrus.org
kiskinhouse.com
kiwe-analytics.com
ktotut.net
kunstaktien.info
ladsup.com
laudit.ru laudit.ru
laxdrills.com
layola.biz.tc
lego4x4.ru lego4x4.ru
liky.co.ua letsrepair.in
linkpulse.com lietaer.com
live-sexcam.tk livetsomudvekslingstudent.bloggersdelight.dk
longadventure.com macotool.com
mabdoola.blogspot.com magnetic-bracelets.ru
macrotek.ru make-money-online.com
maju.bluesalt.co
masthopehomes.com masthopehomes.com
mebel-ekb.com matb3aa.com
mebel-vstroika.ru members.ghanaweb.com
meduza-consult.ru
menetie.ru
mesbuta.info mesbuta.info
mobplayer.net mhi-systems.ru
mundoaberrante.com mielec.pl
musflashtv.com miniature.io
myperiod.club moesexy.com
new7ob.com monclercheap.xyz
next-dentists.tk morf.snn.gr
nextbackgroundcheck.gq mossmesi.com
nicovideo.jp mp3ritm.top
njpalletremoval.com mrbitsandbytes.com
notasprensa.info muizre.ru
novosibirsk.xrus.org mydownlodablefiles.com
nrjmobile.fr myseoconsultant.com
o00.in narosty.com
o333o.com naturtreenspicerx.pw
officedocuments.net naughtyconnect.com
oktube.ru netcheckcdn.xyz
online-sbank.ru nucia.biz.ly
otbelivanie-zubov.com obiavo.uz
ownshop.cf oddamzadarmo.eu
parajumpersstore.online oklogistic.ru
peugeot-club.org olgacvetmet.com
pflexads.com oneshotdate.com
pictures-and-images.net openstat.com
pintattoos.com optitrade24.com
pio.polytopesexempt.com pammik.ru
pix-hd.com pavlodar.xkaz.org
pixelrz.com pcgroup.com.uy
popunder.net pharmacyincity.com
pornotubexxx.name piter.xrus.org
portnoff.od.ua piuminiita.com
powc.r.ca.d.sendibm2.com pl-top.pl
pr0fit-b0x.com play.leadzupc.com
privatamateure.com popup-hgd.xyz
profitfx.online porndl.org
progonrumarket.ru pornokorol.com
pyramidlitho.webs.com prizeestates.cricket
quickbuck.com prostitutki-tolyatti.org
ragecash.com quebec-bin.com
randalljhoward.com qwarckoine.com
rating-casino2021.ru realitykings.com
razorweb-a.akamaihd.net redirectme.net
recipedays.ru reklama-i-rabota.ru
refads.pro relax.ru
rff-cfal.info remont-mobile-phones.ru
rossanasaavedra.net rfid-locker.co
s-forum.biz rialp.getenjoyment.net
scanner-elena.top runtnc.net
scrapy.org russia-today-video.ru
sdi-pme.com russkie-gorki.ru
seinterface.com saneyes.com
selectads.men satellite.maps.ilovevitaly.com
scanner-barak.top
scanner-don.top
scanner-irvin.top
scrnet.biz.ua
search-goo.com
searchmywindow-a.akamaihd.net
seccioncontrabajo.com
secret.xn--oogle-wmc.com
sei80.com
seo-prof1.xyz
seolab.top seolab.top
sex-tracker.de serving.adbetclickin.pink
sex-watch.com sexreliz.com
sexy-pings.com sexvideo-sex.com
sexyteens.hol.es sexyebonyteen.com
share-buttons-for-free.com shariki-zuma-lines.ru
shisha-swag.de sideeffectsoftizanidine.blogspot.com
siteaero.com signoredom.com
sk.golden-praga.ru sildenafil-tadalafil.info
solnplast.ru site-auditor.online
sophang8.com siteimprove.com
souvenirua.com sitevaluation.com
space4updating.win slim.sellany.ru
stroymonolit.su solitaire-game.ru
styro.ru soviet-portal.do.am
symbaloo.com srecorder.com
tech4master.com stats-public.grammarly.io
technopellet.gr stauga.altervista.org
testbotprocessor44.com stefanbakosab.se
thecoral.com.br stuff-about-money.com
thefotosgratis.eu telefonsex-ohne0900.net
tilido.com thebitcoincode.com
tizanidinecapsules.blogspot.com thepokertimer.com
tizanidinedosage.blogspot.com threecolumnblogger.com
tk-assortiment.ru tizanidine4mgtablets.blogspot.com
token-lab.org tizanidinehcl4mgtab.blogspot.com
tozup.com tizanidineshowupondrugtest.blogspot.com
trafficshaper.com tkanorganizma.ru
treasuretrack-a.akamaihd.net toproadrunner5.info
trion.od.ua track.deriv.com
tsan.net trkur.com
tubeoffline.com trustaffs.com
tuckpointingmasonrysystems.com tryrating.com
tyumen.xrus.org ttrraacckkrr.com
uginekologa.com tula.howotorg.ru
turizm.bz
uhdtv.website
uhod-za-sobakoj.ru
ultramart.biz ultramart.biz
unionmarkt.de unblocksit.es
unmaroll.ya.ru urlcut.ru
unrealcommander.org vacances-voyages.info
uptimechecker.com varikozdok.ru
uytmaster.ru velpanex.ru
v24s.net via-energy-acquistare.com
varikoz24.com videochat.tv.br
venta-prom.ru vkak.ru
video--production.com vmnmvzsmn.over-blog.com
video-hollywood.ru
viel.su
virtuagirl.com
vita.com.hr
vodaodessa.com
vodkoved.ru
voltrknc1.com
vvon.co.uk vvon.co.uk
wahicbefa31.soup.io vvpg.ru
webscouter.net weboptimizes.com
wemedinc.com whiteproduct.com
whiteelephantwellington.com wholesalenfljerseys.us.com
whosonmyserver.com wormix-cheats.ru
wingsofrefuge.net wufak.com
winwotgold.pl wygraj-skiny.win
winx-play.ru xep.info
womensterritory.ru xingzi-vision.com
x-diesel.com xn----9sbubg3ambdfl1j.xn--p1ai
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai xn----dtbndd4ae7eub.top
xn--h1aakne2ba.xn--p1ai
xtraffic.plus
xxx-cam.webcam xxx-cam.webcam
xxxtubesafari.com xxxtube69.com
zaapplesales.blogspot.com youbloodyripper.com
znakomstvaonlain.ru youthreaders.com
zahvat.ru
zaidia.xhost.ro
zazagames.org
zetmaster.ru
zigarettenonlinekaufen1.bloog.pl
zigzog.ru
znaniyapolza.ru
zophim.me

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.77 0; 10.1.1.98 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3428 ### Version: V4.2022.10.3429
### Updated: Sun Oct 23 22:01:15 UTC 2022 ### Updated: Mon Oct 24 10:06:12 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3428 ### Version: V4.2022.10.3429
### Updated: Sun Oct 23 22:01:15 UTC 2022 ### Updated: Mon Oct 24 10:06:12 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##