V4.2022.02.2905 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
-01h4x.com
-404enemy
+360Spider
+404checker
 80legs
-AIBOT
-ALittle Client
 ASPSeek
-AhrefsBot
-AiHitBot
+Aboundexbot
 Aipbot
-AllSubmitter
-Anarchy
-Ankit
-Apexoo
-Aspiegel
+Anthill
 Asterias
-AwarioSmartBot
-BDCbot
+Attach
+AwarioRssBot
+BBBike
+BDFetch
 BLEXBot
-Bandit
-BatchFTP
-BlackWidow
-BotALot
-Brandwatch
-Buddy
+BacklinkCrawler
+Badass
+Bigfoot
+Bitacle
+Black Hole
+Blow
+Buck
 BuiltWith
-Calculon
+Bullseye
+BunnySlippers
+CODE87
+CSHttp
 CazoodleBot
-CensysInspect
 CheeseBot
-Citoid
+Chlooe
 Claritybot
 Cliqzbot
-Cogentbot
+Cloud mapping
 Collector
 CopyRightCheck
-Cosmos
-Crawling at Home Project
-Custo
-CyotekWebCopy
-DBLBot
-DataCha0s
-Demon
+Craftbot
+Crescent
+CrunchBot
+Curious
+DSearch
+DTS Agent
 Deusu
 Devil
-DigitalPebble
-Disco
-DnBCrawler-Analytics
-Domains Project
-Dragonfly
-ECCP/1.0
-EMail Siphon
-EasyDL
-Ebingbong
+Digincore
+Discoverybot
+DomCopBot
+DomainAppender
+Download Wonder
+EroCrawler
 Evil
+ExtLinksBot
 Extractor
+ExtractorPro
+Extreme Picture Finder
 Ezooms
+FHscan
+FemtosearchBot
+Fimap
+FlashGet
 Flunky
+Freeuploader
 FrontPage
-FyberSpider
 G-i-g-a-b-o-t
 GT::WWW
-Genieo
-Getintent
-Go!Zilla
-Go-Ahead-Got-It
-GoZilla
-GrabNet
-HMView
+GermCrawler
+GetWeb
+Grafula
 HTTrack
 Haansoft
-HaosouSpider
-Heritrix
-Hloader
-IDBTE4M
+Humanlinks
+HybridBot
 Iblog
-Id-search
-IlseBot
-Indy Library
-JennyBot
-JetCar
-JikeSpider
-Jorgee
-Keyword Density
+Intelliseek
+Iria
+IstellaBot
+Jbrofuzz
+Kenjin Spider
 Kinza
-LNSpiderguy
-LWP::Simple
-Lanshanbot
+Kozmosbot
+Leap
+LeechFTP
+LeechGet
 Lftp
-LibWeb
-LinksManager
+Libwhisker
+LieBaoFast
+Lightspeedsystems
+Likse
+LinkScan
+Linkbot
+LinkextractorPro
+LinqiaMetadataDownloaderBot
 LinqiaRSSBot
-Lipperhey Spider
-Litemage_walker
 MIDown tool
 MIIxpc
+MQQBrowser
+MSFrontPage
 MSIECrawler
 MTRobot
-Mag-Net
-Majestic SEO
-Majestic-SEO
-MarkMonitor
-MarkWatch
 Mass Downloader
-Masscan
 Mata Hari
-Mb2345Browser
-MeanPath Bot
 Meanpathbot
+Mediatoolkitbot
 MegaIndex.ru
-Microsoft Data Access
-Minefield
+Microsoft URL Control
 Mister PiX
-Moblie Safari
-Mozlila
-Msrabot
+Morfeus Fucking Scanner
+Mr.4x3
 Musobot
 Nameprotect
-Navroad
 NearSite
 Needle
-NetLyzer
 NetMechanic
+Netcraft
 Nettrack
+Netvibes
 NextGenSearchBot
-Niki-bot
-Nikto
+NimbleCrawler
 Nimbostratus
-Nmap
-Not
+Ninja
 Nuclei
-Nutch
 Octopus
+Offline Explorer
 OnCrawl
-OpenVAS
-Openfind
+OpenLinkProfiler
+Openvas
+PECL::HTTP
 POE-Component-Client-HTTP
-Page Analyzer
-PageAnalyzer
-PageThing.com
+PageScorer
+Pandalytics
+Panscient
 Papa Foto
-Pimonster
-Pixray
+Petalbot
+Pi-Monster
+PictureFinder
+Piepmatz
 Pockey
 ProPowerBot
 ProWebWalker
 Probethenet
-Pu_iN
-PxBroker
-PyCurl
+Pump
 RankActive
-RankingBot
-Reaper
-RedesScrapy
+RankActiveLinkBot
+RankurBot
+Recorder
 Ripper
-SEOkicks-Robot
+RocketCrawler
+SEOkicks
 SEOlyticsCrawler
+SEOprofiler
 SEOstats
-SMTBot
+SISTRIX
 SalesIntelligent
-ScoutJet
+Screaming
 ScreenerBot
+ScrepyBot
 Searchestate
-SearchmetricsBot
-SemanticJuice
-SentiBot
-SiteCheckerBotCrawler
-SiteExplorer
-SiteSnagger
+Semrush
+Seomoz
+Siphon
 SiteSucker
+Sitebeam
 Siteimprove
-SlySearch
-SmartDownload
-Snoopy
+Snake
+Snapbot
+Sociscraper
 Sottopop
 SpaceBison
-Spanner
 SputnikBot
-Sucker
-SuperBot
-SuperHTTP
+Sqlmap
+Sqworm
+Surfbot
+Suzuran
+Swiftbot
 Szukacz
 T0PHackTeam
 T8Abot
-The Intraformant
-TurnitinBot
-Typhoeus
+Teleport
+Telesphorep
+Titan
+Toweyabot
+Tracemyfile
+Trendictionbot
+True_Robot
+Turingos
+URLy Warning
+V-BOT
+VB Project
 Vacuum
 Vagabondo
 VelenPublicWebCrawler
+VeriCiteCrawler
 VidibleScraper
-Voil
-WBSearchBot
-WWW-Mechanize
+WWW::Mechanize
 WWWOFFLE
 Wallpapers
 WallpapersHD
 WeSEE
+Web Collage
 Web Enhancer
+Web Fetch
+Web Fuck
 Web Pix
+Web Sucker
+WebAuto
 WebBandit
-WebCollage
-WebCopier
 WebEnhancer
+WebFetch
 WebImageCollector
 WebPix
 WebStripper
 WebSucker
-Webalta
+WebWhacker
 Webshag
 WebsiteExtractor
-WebsiteQuester
-Whatweb
 Who.is Bot
 Widow
 WinHTTrack
 WiseGuys Robot
-Woobot
+Wonderbot
 Wprecon
+Xenu
 Zade
-Zermelo
-Zitebot
-ZoomBot
+Zauba
 ZoominfoBot
-ZumBot
+ZyBorg
+adscanner
+arquivo-web-crawler
 arquivo.pt
-autoemailspider
-crawl.sogou.com
+check1.exe
+clark-crawler
 dataforseo.com
 domainsproject.org
-eCatch
-instabid
-muhstik-scan
-page scorer
+facebookscraper
+gopher
+internetVista monitor
+ips-agent
+iubenda-radar
 pcBrowser
-plumanalytics
-polaris version
-probe-image-size
 ripz
-scalaj-http
-scan.lol
-seocompany.store
-sexsearcher
-siteripz
-sogouspider
+s1z.ru
+satoristudio.net
+seobility
+serpstatbot
+sp_auditbot
+sysscan
+tAkeOut
 trendiction.com
 ubermetrics-technologies.com
 webgains-bot
-webmeup-crawler
-webprosbot
+webpros.com
+x09Mozilla
 x22Mozilla