V4.2022.09.3341 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
-01h4x.com
-360Spider
-ASPSeek
-Abonti
-AfD-Verbotsverfahren
-Alexibot
+404checker
+ALittle Client
 AllSubmitter
+Anarchy
 Anarchy99
+Ankit
 Apexoo
-Asterias
-Atomseobot
+Attach
+AwarioRssBot
 AwarioSmartBot
 BDCbot
-BDFetch
 BLEXBot
-BackWeb
-Barkrowler
+BackStreet
+Battleztar Bazinga
 BetaBot
-Bitacle
-Black Hole
-BlackWidow
-Boardreader
-BotALot
-Brandprotect
-Buddy
-BunnySlippers
-BuzzSumo
-CATExplorador
-CSHttp
-CazoodleBot
-CherryPicker
+Bigfoot
+Blow
+Bolt
+Brandwatch
+Bullseye
+CCBot
+Cegbfeieh
+CensysInspect
+CheTeam
+CheeseBot
 ChinaClaw
-Chlooe
-Cliqzbot
+Claritybot
+Cloud mapping
 Collector
 Copier
+CopyRightCheck
 Copyscape
-Craftbot
+Crawling at Home Project
 CrazyWebCrawler
 Crescent
-CyotekWebCopy
+CrunchBot
+DataCha0s
 DatabaseDriverMysqli
-Demon
-Deusu
-Disco
+Devil
+DigitalPebble
+Dispatch
 DittoSpyder
 DnBCrawler-Analytics
-DomainAppender
+DomCopBot
+Domains Project
 Dotbot
-Download Wonder
-EMail Wolf
+Dragonfly
+ECCP/1.0
+EMail Siphon
+EasyDL
+Ebingbong
+EroCrawler
+Evil
 Exabot
-ExtLinksBot
-ExtractorPro
-Fimap
+EyeNetIE
+Firefox/7.0
+Flunky
 Freeuploader
 FrontPage
-Fuzz
+FyberSpider
 Fyrebot
 G-i-g-a-b-o-t
-GetRight
+Genieo
 GetWeb
-Getintent
-Gigabot
 Go!Zilla
-Go-Ahead-Got-It
+GoZilla
 Gotit
-GrapeshotCrawler
-HMView
-HTTrack
+Grabber
+HEADMasterSEO
+HTMLparser
 Haansoft
+Havij
 Heritrix
 Humanlinks
 HybridBot
+IDBTE4M
 IndeedBot
-InfoNaviRobot
-InterGET
-InternetSeer
-IstellaBot
-JamesBOT
-JikeSpider
-Jorgee
-JustView
-Kenjin Spider
+Indy Library
+InfoTekies
+Intelliseek
+Iria
+Jyxobot
 Kinza
 LWP::Simple
-Lanshanbot
+Leap
 LeechFTP
-LeechGet
 Lftp
-LibWeb
 LieBaoFast
 Lightspeedsystems
+Likse
 LinkScan
 Linkbot
 LinkextractorPro
-LinkpadBot
-LinksManager
+LinqiaMetadataDownloaderBot
 Lipperhey Spider
-Lmspider
 MIIxpc
-MJ12bot
+MSFrontPage
+MSIECrawler
 Mail.RU_Bot
-Majestic-SEO
-Majestic12
+MauiBot
+MeanPath Bot
+Metauri
 MicroMessenger
-Microsoft Data Access
-Minefield
-Moblie Safari
-MolokaiBot
-Morfeus Fucking Scanner
-Mr.4x3
+Mister PiX
 Msrabot
-Musobot
 Nameprotect
-Navroad
-NearSite
+Net Vampire
 NetAnts
-NetZIP
+NetMechanic
+Netcraft
+Netvibes
 NextGenSearchBot
+Nibbler
 Nikto
 NimbleCrawler
-Nmap
-Not
+Nimbostratus
 Nuclei
+Octopus
 Offline Explorer
 Offline Navigator
+OpenLinkProfiler
 OpenVAS
-Openfind
 OutclicksBot
+OutfoxBot
 PECL::HTTP
 PHPCrawl
+Page Analyzer
+PageAnalyzer
+PageGrabber
 PageScorer
 PageThing.com
 Pandalytics
-Papa Foto
-Picscout
-ProPowerBot
+Panscient
+Pavuk
+Petalbot
+Pixray
+PleaseCrawl
+ProWebWalker
 Probethenet
+Psbot
+Pu_iN
 Pump
-PxBroker
 PyCurl
-QueryN Metasearch
-RSSingBot
+RankActiveLinkBot
+RankFlex
+RankingBot
 Rankivabot
 RankurBot
-RealDownload
+Re-re
+ReGet
+RepoMonkey
 Rogerbot
-SBIder
+SEOkicks-Robot
+SEOlyticsCrawler
 SISTRIX
-ScanAlert
+SalesIntelligent
 ScoutJet
 Scrapy
 Screaming
+ScrepyBot
 Searchestate
-SearchmetricsBot
-Seekport
-Semrush
-SeobilityBot
-Shodan
-Site Sucker
-SiteExplorer
-SiteSnagger
+Seomoz
+Siphon
+SiteLockSpider
 Sitevigil
-SlySearch
-SmartDownload
-Snake
-Snoopy
-SocialRankIOBot
 Sosospider
 Spammen
+SpankBot
+Spanner
+Spinn3r
+SputnikBot
 Sqlmap
+Sqworm
 Steeler
 Sucuri
 SuperBot
-SurveyBot
-T0PHackTeam
+Surfbot
 Teleport
-Telesphorep
-TightTwatBot
-Titan
-Toata
+TeleportPro
+TheNomad
 Trendictionbot
+Turingos
+TurnitinBot
 TwengaBot
 Twice
-URLy Warning
-URLy.Warning
-Upflow
 V-BOT
-VB Project
-VCI
 Vacuum
-VoidEYE
-Voil
+Vagabondo
+VelenPublicWebCrawler
+VidibleScraper
 Voltron
 WASALive-Bot
-WEBDAV
 WISENutbot
-WPScan
-WWWOFFLE
-WeSEE
 Web Auto
+Web Collage
+Web Enhancer
+Web Fetch
 Web Pix
-WebBandit
+Web Sucker
+WebCollage
 WebCopier
+WebFetch
+WebGo IS
 WebImageCollector
-WebPix
-WebSauger
+WebSucker
 WebZIP
-Webalta
+WebmasterWorldForumBot
 Webshag
 Website Quester
-Whatweb
-Woobot
+WebsiteExtractor
+Whack
+Xaldon WebSpider
+Xenu
 YoudaoBot
-Zade
+Zauba
 Zermelo
 Zeus
+ZmEu
 ZumBot
-adscanner
-arquivo-web-crawler
-autoemailspider
+arquivo.pt
 cah.io.community
-cognitiveseo
-crawler4j
-evc-batch
-gopher
+clark-crawler
+crawl.sogou.com
+facebookscraper
 instabid
-internetVista monitor
-iubenda-radar
+ips-agent
 magpie-crawler
 meanpathbot
-netEstate NE Crawler
-oBot
-pcBrowser
-probe-image-size
+mediawords
+page scorer
+plumanalytics
+ripz
 s1z.ru
 satoristudio.net
+scalaj-http
 scan.lol
+seobility
 seocompany.store
-seoscanners
 serpstatbot
-siteripz
+sexsearcher
+sitechecker.pro
+sp_auditbot
 sysscan
-trendiction.com
-ubermetrics-technologies.com
-webprosbot
+tAkeOut
+webgains-bot
+webpros.com
 x09Mozilla
+x22Mozilla
+xpymep1.exe
 zauba.io
-zgrab