nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-04 10:07:16 +00:00

100 lines
1.1 KiB
Text

80legs
AiHitBot
Anarchy99
Attach
Bandit
Bigfoot
BotALot
CSHttp
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainSigmaCrawler
EasyDL
Ebingbong
EirGrabber
Express WebPictures
FDM
FHscan
Foobot
GetWeb
Gigabot
Gotit
HEADMasterSEO
HTMLparser
HonoluluBot
Image Sucker
InfoNaviRobot
JetCar
Jyxobot
Keybot Translation-Search-Machine
LeechFTP
Lmspider
MIIxpc
Majestic SEO
Mediatoolkitbot
Microsoft Data Access
Minefield
NICErsPRO
Name Intelligence
Netcraft
OutclicksBot
PageScorer
PageThing.com
Pimonster
Pixray
Rainbot
ReGet
RealDownload
RebelMouse
SISTRIX
ScreenerBot
ScrepyBot
Seekport
SentiBot
Shodan
SiteLockSpider
SiteSnagger
Snake
Snapbot
Sociscraper
Spammen
Spanner
SurveyBot
Szukacz
Telesphorep
The Intraformant
Thumbor
Toata
Toweyabot
Trendiction
VidibleScraper
Voltron
WBSearchBot
WISENutbot
WWW-Mechanize
WWWOFFLE
WallpapersHD
Web Pix
WebLeacher
WebSucker
WebZIP
Webalta
Whatweb
Widow
Wotbox
Wprecon
Zermelo
arquivo-web-crawler
autoemailspider
coccocbot
crawler.feedback
demandbase-bot
ips-agent
meanpathbot
openai.com
s1z.ru
spyfu
tAkeOut
ubermetrics-technologies.com
webmeup-crawler