Plugin Development : Cosmos (V1) #236

heejin-github · 2022-08-24T07:15:25Z

heejin-github · 2022-08-24T07:30:57Z

1st phase

we already make some plugins for cosmos-sdk/tendermint based project and linux systems. trying to make first version of cosmos plugin with existed plugins, method, or systems in 1st phase.

Create new repo for vatz-plugin-cosmos
Collect developed plugins into vatz-plugin-cosmos
- exist one : up, block-height, hwstat(cpu, mem, disk)
- need develop : peer count
All plugins will be based on the Vatz SDK and have its own module.
Build all plugins with make
Run and manage plugins with pm2
Testing on cosmos mainnet sentry machine or any other cosmos-sdk based testnet nodes.

2nd phase

Find improvements and newly developments, if needed.

Check any problem to monitor cosmos node with current plugins.
Check if any further monitoring items required.
Check for unnecessary monitoring items in current plugins.
Find enhancement for Build and Run.
Decide whether cosmos plugin integrate into Vatz and CLI interaction
Discuss about any action items or �requirements for the next phase.

@xellos00 @meetrick @Choi-Jinhong @skonhwang
any feedback is welcome!
Let's start to develop cosmos plugin.

heejin-github · 2022-08-26T07:44:29Z

plugin list

./vatz-plugin-cosmos
└── plugin
    ├── chainstat
    │   ├── block_height
    │   ├── peer_count
    │   └── up
    └── hwstat
        ├── cpu
        ├── disk
        └── mem

heejin-github · 2022-08-26T08:03:27Z

CI

Build and Test with github action
https://docs.github.com/en/actions/automating-builds-and-tests/building-and-testing-go

xellos00 · 2022-08-26T18:09:17Z

plugin list

./vatz-plugin-cosmos
└── plugin
    ├── chainstat
    │   ├── block_height
    │   ├── peer_count
    │   └── up
    └── hwstat
        ├── cpu
        ├── disk
        └── mem

I prefer to separate that for checking hardwares because it's going to be used for everyone.

heejin-github · 2022-08-31T09:35:26Z

plugin list

./vatz-plugin-cosmos
└── plugin
    ├── chainstat
    │   ├── block_height
    │   ├── peer_count
    │   └── up
    └── hwstat
        ├── cpu
        ├── disk
        └── mem

I prefer to separate that for checking hardwares because it's going to be used for everyone.

plugin separated to vatz-plugin-cosmoshub and vatz-plugin-sysutil as we discussed from #225

# tree ./vatz-plugin-sysutil
./vatz-plugin-sysutil
├── plugins
│   ├── cpu_monitor
│   │   ├── go.mod
│   │   ├── go.sum
│   │   └── main.go
│   ├── disk_monitor
│   │   ├── go.mod
│   │   ├── go.sum
│   │   └── main.go
│   └── mem_monitor
│       ├── go.mod
│       ├── go.sum
│       └── main.go
└── README.md

# tree ./vatz-plugin-cosmoshub
./vatz-plugin-cosmoshub
├── plugins
│   ├── cosmos-sdk-blocksync
│   │   ├── main.go
│   │   ├── main_test.go
│   │   ├── Makefile
│   │   ├── mocks
│   │   │   ├── Collector.go
│   │   │   └── Estimator.go
│   │   ├── policy
│   │   │   ├── policy.go
│   │   │   └── policy_test.go
│   │   └── status
│   │       ├── status.go
│   │       └── status_test.go
│   ├── is_alived
│   │   ├── go.mod
│   │   ├── go.sum
│   │   └── main.go
│   └── peer_count
│       ├── go.mod
│       ├── go.sum
│       └── main.go
├── README.md
└── rpc
    └── cosmos
        ├── api.go
        ├── api_test.go
        ├── fixtures.go
        └── mocks
            └── Client.go

heejin-github · 2022-10-11T06:46:21Z

2022-10-11 `vatz-plugin-cosmoshub` Phase 1 Development

PR list

Summary

Collect developed plugins and revised it with RPC API call.
Can execute independent and works well in current.
We can go to phase2 development of vatz-plugin-cosmoshub

Code Tree

~/vatz-plugin-cosmoshub # tree .
.
├── Makefile
├── plugins
│   ├── cosmos-sdk-blocksync
│   │   ├── go.mod
│   │   ├── go.sum
│   │   ├── main.go
│   │   ├── main_test.go
│   │   ├── Makefile
│   │   ├── mocks
│   │   │   ├── Collector.go
│   │   │   └── Estimator.go
│   │   ├── policy
│   │   │   ├── policy.go
│   │   │   └── policy_test.go
│   │   └── status
│   │       ├── status.go
│   │       └── status_test.go
│   ├── is_alived
│   │   ├── go.mod
│   │   ├── go.sum
│   │   └── main.go
│   └── peer_count
│       ├── go.mod
│       ├── go.sum
│       ├── main.go
│       └── net_info.go
├── README.md
└── rpc
    └── cosmos
        ├── api.go
        ├── api_test.go
        ├── fixtures.go
        ├── go.mod
        ├── go.sum
        └── mocks
            └── Client.go

10 directories, 26 files

heejin-github · 2022-10-11T06:51:56Z

Phase2 development items

All plugins combine in a module
- make a unified module for all plugins vatz-plugin-cosmoshub#13
refactoring current plugins with new module structure
- peer_count: refactoring for unified module vatz-plugin-cosmoshub#16
- Add health check vatz-plugin-cosmoshub#19
Test code for the plugins
- Fix test code for cosmos-sdk-blocksync/status vatz-plugin-cosmoshub#15
- Add health check vatz-plugin-cosmoshub#19
- Add Test code for validator active status check vatz-plugin-cosmoshub#20
- will be added test code for peer_count
new monitoring plugins
- Add Active status plugin vatz-plugin-cosmoshub#18
github action for testing : TBD. after open repo to the public.

Testing on cosmos node
Find issue during the test
Freeze for open to the public

xellos00 · 2022-11-14T20:25:35Z

@heejin-github
I've installed following plugins

vatz-plugin-sysutil
vatz-plugin-cosmos-sdk

is there any command that you used pm2 or other method.
start & stop plugins easy?

heejin-github · 2022-11-15T02:38:20Z

@heejin-github I've installed following plugins

vatz-plugin-sysutil

vatz-plugin-cosmos-sdk

is there any command that you used pm2 or other method. start & stop plugins easy?

@xellos00
no longer use pm2. I think It's not familiar way other than node.js.
I'm just using a simple start/stop script.

root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# ls
default.yaml  plugin_start.sh  plugin_stop.sh  vatz_start.sh  vatz_stop.sh
root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# cat vatz_start.sh
#!/bin/bash

vatz start --config=/root/dsrv/bin/vatz/default.yaml >> /var/log/vatz/vatz.log 2>&1 &
echo "true"
root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# cat vatz_stop.sh
#!/bin/bash
set -e
set -v

pid=`pidof vatz`
# Kill process
kill -15 $pid

# wait Kill process
sleep 1

while (( `lsof -p $pid | wc -l` > 0 ))
do
        echo `lsof -p $pid | wc -l`
        sleep 1
done

echo "vatz $pid is killed."
root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# cat plugin_start.sh
#!/bin/bash

#cosmos-sdk-blocksync >> /var/log/vatz/cosmos-sdk-blocksync.log 2>&1 &
is_alived --rpcAddr="http://localhost:16657" >> /var/log/vatz/is_alived.log 2>&1 &
peer_count --port=9092 >> /var/log/vatz/peer_count.log 2>&1 &
active_status --port=9097 --rpcURI="http://localhost:11317" --valoperAddr="tpvaloper1cnar5gh3mycnlhw9kkmsg3s792e74xs5x787j6" >> /var/log/vatz/active_status.log 2>&1 &
cpu_monitor >> /var/log/vatz/cpu_monitor.log 2>&1 &
mem_monitor >> /var/log/vatz/mem_monitor.log 2>&1 &
disk_monitor >> /var/log/vatz/disk_monitor.log 2>&1 &
echo "true"
root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# cat plugin_stop.sh
#!/bin/bash

pid=`pidof cosmos-sdk-blocksync`
kill -15 $pid
echo "cosmos-sdk-blocksync $pid is killed."

pid=`pidof is_alived`
kill -15 $pid
echo "is_alived $pid is killed."

pid=`pidof peer_count`
kill -15 $pid
echo "peer_count $pid is killed."

pid=`pidof active_status`
kill -15 $pid
echo "active_status $pid is killed."

pid=`pidof cpu_monitor`
kill -15 $pid
echo "cpu_monitor $pid is killed."

pid=`pidof mem_monitor`
kill -15 $pid
echo "mem_monitor $pid is killed."

pid=`pidof disk_monitor`
kill -15 $pid
echo "disk_monitor $pid is killed."

xellos00 · 2022-11-15T12:38:01Z

@heejin-github I've installed following plugins

vatz-plugin-sysutil

vatz-plugin-cosmos-sdk

is there any command that you used pm2 or other method. start & stop plugins easy?

@xellos00 no longer use pm2. I think It's not familiar way other than node.js. I'm just using a simple start/stop script.

root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# ls
default.yaml  plugin_start.sh  plugin_stop.sh  vatz_start.sh  vatz_stop.sh
root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# cat vatz_start.sh
#!/bin/bash

vatz start --config=/root/dsrv/bin/vatz/default.yaml >> /var/log/vatz/vatz.log 2>&1 &
echo "true"
root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# cat vatz_stop.sh
#!/bin/bash
set -e
set -v

pid=`pidof vatz`
# Kill process
kill -15 $pid

# wait Kill process
sleep 1

while (( `lsof -p $pid | wc -l` > 0 ))
do
        echo `lsof -p $pid | wc -l`
        sleep 1
done

echo "vatz $pid is killed."
root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# cat plugin_start.sh
#!/bin/bash

#cosmos-sdk-blocksync >> /var/log/vatz/cosmos-sdk-blocksync.log 2>&1 &
is_alived --rpcAddr="http://localhost:16657" >> /var/log/vatz/is_alived.log 2>&1 &
peer_count --port=9092 >> /var/log/vatz/peer_count.log 2>&1 &
active_status --port=9097 --rpcURI="http://localhost:11317" --valoperAddr="tpvaloper1cnar5gh3mycnlhw9kkmsg3s792e74xs5x787j6" >> /var/log/vatz/active_status.log 2>&1 &
cpu_monitor >> /var/log/vatz/cpu_monitor.log 2>&1 &
mem_monitor >> /var/log/vatz/mem_monitor.log 2>&1 &
disk_monitor >> /var/log/vatz/disk_monitor.log 2>&1 &
echo "true"
root@provenance-testnet-validator-dc-seoul:~/dsrv/bin/vatz# cat plugin_stop.sh
#!/bin/bash

pid=`pidof cosmos-sdk-blocksync`
kill -15 $pid
echo "cosmos-sdk-blocksync $pid is killed."

pid=`pidof is_alived`
kill -15 $pid
echo "is_alived $pid is killed."

pid=`pidof peer_count`
kill -15 $pid
echo "peer_count $pid is killed."

pid=`pidof active_status`
kill -15 $pid
echo "active_status $pid is killed."

pid=`pidof cpu_monitor`
kill -15 $pid
echo "cpu_monitor $pid is killed."

pid=`pidof mem_monitor`
kill -15 $pid
echo "mem_monitor $pid is killed."

pid=`pidof disk_monitor`
kill -15 $pid
echo "disk_monitor $pid is killed."

Yeah. so currently there's no options to run those plugins overall in the codes, right?

heejin-github · 2022-11-15T14:13:54Z

Yeah. so currently there's no options to run those plugins overall in the codes, right?

@xellos00 Yes, you're right. we don't have any option.

heejin-github · 2022-12-28T12:36:20Z

2022-12-28

Release Candidate : dsrvlabs/vatz-plugin-cosmoshub@ac80cb2

heejin-github · 2023-01-09T06:45:52Z

2022-01-06

v1.0-beta release : https://github.com/dsrvlabs/vatz-plugin-cosmoshub/releases/tag/v1.0-beta

heejin-github added Vatz Project Name area:plugin Anything related to Vatz plugin. type:feature-development Any development regarding Vatz service/plugin, etc. labels Aug 24, 2022

heejin-github self-assigned this Aug 24, 2022

heejin-github assigned meetrick, gnongs and skonhwang Aug 24, 2022

xellos00 added the good_first_issue Good for newcomers label Aug 29, 2022

heejin-github mentioned this issue Aug 29, 2022

Official Plugins strategies #225

Closed

4 tasks

xellos00 added this to the VATZ project managements with Big Chunk milestone Aug 31, 2022

xellos00 mentioned this issue Aug 31, 2022

Vatz Official Plugins Developments & Managements #241

Open

15 tasks

xellos00 removed the good_first_issue Good for newcomers label Aug 31, 2022

This was referenced Sep 7, 2022

Cosmos - plugin - is_alived #243

Closed

Cosmos - plugin - peer_count #244

Closed

Cosmos - plugin - Build and Run #245

Closed

heejin-github added the good_first_issue Good for newcomers label Oct 11, 2022

This was referenced Oct 11, 2022

Cosmos - Plugin - CI for cosmoshub plugin with github action #270

Closed

Cosmos - Plugin - Refactoring is_alived plugin #266

Closed

This was referenced Oct 25, 2022

Cosmos - Plugin - Create Validator active status check plugin #288

Closed

Cosmos - Plugin - Testing on nodes #294

Closed

This was referenced Nov 16, 2022

Cosmos - Plugin - New blocksync check plugin #304

Closed

Cosmos - Plugin - Revise plugins name #303

Closed

skonhwang mentioned this issue Dec 14, 2022

Cosmos - Plugin - Governance alarm #326

Closed

3 tasks

xellos00 removed the good_first_issue Good for newcomers label Jan 26, 2023

xellos00 added the good_first_issue Good for newcomers label Nov 7, 2023

xellos00 modified the milestones: VATZ project managements with Big Chunk 2023, VATZ project managements with Big Chunk 2024 Mar 5, 2024

xellos00 changed the title ~~Plugin Development : Cosmos~~ Plugin Development : Cosmos (V1) Mar 5, 2024

xellos00 closed this as completed Oct 18, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Plugin Development : Cosmos (V1) #236

Plugin Development : Cosmos (V1) #236

heejin-github commented Aug 24, 2022 •

edited by skonhwang

Loading

heejin-github commented Aug 24, 2022

heejin-github commented Aug 26, 2022

heejin-github commented Aug 26, 2022

xellos00 commented Aug 26, 2022

plugin list

heejin-github commented Aug 31, 2022 •

edited

Loading

plugin list

heejin-github commented Oct 11, 2022

heejin-github commented Oct 11, 2022 •

edited by xellos00

Loading

xellos00 commented Nov 14, 2022

heejin-github commented Nov 15, 2022

xellos00 commented Nov 15, 2022

heejin-github commented Nov 15, 2022

heejin-github commented Dec 28, 2022

heejin-github commented Jan 9, 2023

Plugin Development : Cosmos (V1) #236

Plugin Development : Cosmos (V1) #236

Comments

heejin-github commented Aug 24, 2022 • edited by skonhwang Loading

Checklist

Is your feature request related to a problem? Please describe.

Describe the solution you'd like| Ex

Describe alternatives you've considered

Additional context or comment

Child Issues

Phase 1.

Phase 2.

heejin-github commented Aug 24, 2022

1st phase

2nd phase

heejin-github commented Aug 26, 2022

plugin list

heejin-github commented Aug 26, 2022

CI

xellos00 commented Aug 26, 2022

plugin list

heejin-github commented Aug 31, 2022 • edited Loading

plugin list

heejin-github commented Oct 11, 2022

2022-10-11 vatz-plugin-cosmoshub Phase 1 Development

PR list

Summary

Code Tree

heejin-github commented Oct 11, 2022 • edited by xellos00 Loading

Phase2 development items

xellos00 commented Nov 14, 2022

heejin-github commented Nov 15, 2022

xellos00 commented Nov 15, 2022

heejin-github commented Nov 15, 2022

heejin-github commented Dec 28, 2022

2022-12-28

heejin-github commented Jan 9, 2023

2022-01-06

heejin-github commented Aug 24, 2022 •

edited by skonhwang

Loading

heejin-github commented Aug 31, 2022 •

edited

Loading

2022-10-11 `vatz-plugin-cosmoshub` Phase 1 Development

heejin-github commented Oct 11, 2022 •

edited by xellos00

Loading