V4.2022.05.3099 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
+01h4x.com
 404checker
 404enemy
 ASPSeek
-Abonti
+Aboundex
 Aboundexbot
-Acunetix
-Aipbot
-AllSubmitter
-Alligator
-Anarchy
-Anarchy99
+AiHitBot
+Alexibot
 Ankit
+Anthill
 Aspiegel
-Asterias
-Atomseobot
 Attach
+AwarioSmartBot
+BBBike
 BDFetch
-BackDoorBot
-BackStreet
-BacklinkCrawler
+BLEXBot
+Badass
 Bandit
-BatchFTP
 BetaBot
+Bigfoot
+Blackboard
+Blow
 BlowFish
-Boardreader
 Bolt
+Brandprotect
+Buck
+Buddy
 BuiltBotTough
-CATExplorador
-CCBot
 CODE87
-Calculon
+CazoodleBot
+Cegbfeieh
 CensysInspect
-Chlooe
+CheeseBot
+CherryPicker
+ChinaClaw
+Citoid
+Claritybot
 Cliqzbot
 Cloud mapping
-Cocolyzebot
 Cogentbot
-Custo
+Collector
+Copier
+Crawling at Home Project
+CrazyWebCrawler
+Curious
 DSearch
-DatabaseDriverMysqli
+DigitalPebble
 Dispatch
-DittoSpyder
 DnBCrawler-Analytics
-DomainCrawler
-DomainSigmaCrawler
-DomainStatsBot
-Dotbot
+DomainAppender
+Domains Project
+Download Wonder
+Dragonfly
 ECCP/1.0
-EMail Wolf
-EasyDL
-EirGrabber
+Ecxi
 Exabot
+Express WebPictures
 ExtLinksBot
-Extractor
+ExtractorPro
+Ezooms
 FDM
-Flunky
-Foobot
-Freeuploader
-FyberSpider
-Fyrebot
+FemtosearchBot
+Fuzz
+G-i-g-a-b-o-t
+GT::WWW
+Genieo
 GermCrawler
-Gigabot
+Getintent
+Go!Zilla
+Go-Ahead-Got-It
 GoZilla
-Gotit
-GrapeFX
-GrapeshotCrawler
-GridBot
+GrabNet
+Grafula
 HEADMasterSEO
-HTTP::Lite
+HMView
 Haansoft
-Humanlinks
-IDBot
-IRLbot
+Havij
+HybridBot
 IlseBot
+Image Fetch
 Image Sucker
-IndeedBot
+InfoTekies
 Intelliseek
 Iria
 Iskanie
-JamesBOT
-Jbrofuzz
+IstellaBot
+JOC Web Spider
 Jetty
 Joomla
 Jyxobot
-Kenjin Spider
+Keybot Translation-Search-Machine
 Kinza
 LNSpiderguy
+LWP::Simple
+Lanshanbot
 Larbin
-LeechGet
+Leap
+LexiBot
 Lftp
-LibWeb
-LieBaoFast
-Likse
 LinkScan
+LinkpadBot
+LinksManager
 LinqiaMetadataDownloaderBot
-MIDown tool
-MIIxpc
+LinqiaScrapeBot
+Lipperhey
+Lmspider
 MQQBrowser
-MTRobot
-Mag-Net
-Magnet
 Majestic-SEO
+Majestic12
 MarkMonitor
 Mata Hari
+MauiBot
 Mb2345Browser
-Mediatoolkitbot
-Mojeek
-Mojolicious
+MegaIndex.ru
+Minefield
+Moblie Safari
 Morfeus Fucking Scanner
-NICErsPRO
+Mr.4x3
+Musobot
 NPbot
 Name Intelligence
-Nameprotect
-Navroad
 Needle
+Nessus
 Net Vampire
+NetMechanic
 NetSpider
-NetZIP
-NextGenSearchBot
+Nettrack
 Nibbler
 Nikto
+NimbleCrawler
 Nimbostratus
-Nmap
-Nutch
 Offline Navigator
 Openfind
 Openvas
-OrangeBot
-PECL::HTTP
-PHPCrawl
-Page Analyzer
-PageGrabber
-Pandalytics
-Panscient
+OutclicksBot
+POE-Component-Client-HTTP
+PageAnalyzer
 Papa Foto
 Pavuk
 PeoplePal
-Picsearch
-PictureFinder
 Piepmatz
 Pockey
+ProPowerBot
 Psbot
-Pu_iN
-PxBroker
+Pump
 PyCurl
-RSSingBot
+QueryN Metasearch
 RankingBot
-ReGet
+Rankivabot
+Re-re
 Reaper
-Recorder
+RebelMouse
+RedesScrapy
 Ripper
-SBIder
-SEOkicks-Robot
-SEOprofiler
+RocketCrawler
 SMTBot
-ScanAlert
 ScoutJet
-Screaming
-ScreenerBot
+Scrapy
 ScrepyBot
-Searchestate
+Semrush
 SentiBot
-Seomoz
 Siphon
-SiteLockSpider
-Sitebeam
-Siteimprove
+SiteCheckerBotCrawler
+SiteExplorer
 Sitevigil
-Snoopy
+Snake
+Sociscraper
 Sogou web spider
-Sosospider
-Sottopop
-Spammen
+SpaceBison
+SpankBot
 Spinn3r
-SputnikBot
-Sqlmap
-Sucker
-Sucuri
 SuperBot
-SurveyBot
-Swiftbot
+SuperHTTP
+Surfbot
+Szukacz
 T0PHackTeam
 T8Abot
-Teleport
-TeleportPro
-Telesoft
+Telesphoreo
+Telesphorep
+Thumbor
+TightTwatBot
+Tracemyfile
+Trendiction
 Trendictionbot
-True_Robot
-Turingos
-Turnitin
+Twice
 Typhoeus
-URLy.Warning
+URLy Warning
 UnisterBot
-Upflow
-V-BOT
-VelenPublicWebCrawler
-VeriCiteCrawler
-Virusdie
-WEBDAV
-WWW::Mechanize
-WWWOFFLE
+VoidEYE
+Voltron
+WASALive-Bot
+WBSearchBot
+WISENutbot
+WPScan
+WWW-Collector-E
 WallpapersHD
+WeSEE
 Web Auto
 Web Collage
-Web Pix
-WebAuto
-WebBandit
+Web Enhancer
+Web Sauger
 WebCollage
-WebFetch
-WebGo IS
-WebStripper
-WebSucker
+WebImageCollector
+WebPix
+Webalta
+WebsiteExtractor
 WebsiteQuester
-Webster
+Whack
+Whacker
 Who.is Bot
+WinHTTrack
 WiseGuys Robot
-Woobot
-Wotbox
-Wprecon
 Xenu
 YoudaoBot
 Zade
 Zauba
-Zitebot
 ZmEu
-ZyBorg
-adscanner
-coccocbot
+archive.org_bot
+arquivo-web-crawler
+arquivo.pt
+autoemailspider
+backlink-check
+clark-crawler
 cognitiveseo
-com.plumanalytics
-demandbase-bot
+crawl.sogou.com
+dataforseo.com
+eCatch
 evc-batch
 gopher
+heritrix
 instabid
-iubenda-radar
-lwp-trivial
+internetVista monitor
+ips-agent
+isitwp.com
+linkdexbot
+magpie-crawler
+meanpathbot
 mediawords
-oBot
-pcBrowser
+page scorer
 probe-image-size
-ripz
-seobility
-seocompany.store
-seoscanners
+satoristudio.net
+scalaj-http
 sexsearcher
-ubermetrics-technologies.com
+sogouspider
+spyfu
 voyagerx.com
 webgains-bot
 webmeup-crawler
-zauba.io
+webpros.com
+xpymep1.exe