V3.2019.06.1433 [ci skip]

This commit is contained in:
Travis 2019-06-19 10:00:25 +02:00
parent 4a364cc22f
commit 675260442d
51 changed files with 123 additions and 76 deletions

View file

@ -85,6 +85,7 @@ crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
CSHttp
Curious
Custo
@ -132,6 +133,7 @@ ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
facebookscraper
FDM
FemtosearchBot
FHscan
@ -316,6 +318,7 @@ Page Analyzer
PageGrabber
page scorer
PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk
@ -401,6 +404,7 @@ Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sosospider
@ -456,6 +460,7 @@ TwengaBot
Twice
Typhoeus
UnisterBot
Upflow
URLy.Warning
URLy Warning
Vacuum