Stopped scan for unknown reason

[fewensa]

$ docker logs pangolin-ropsten 2>&1 | grep "redeem"
[2021-11-22T03:10:12Z DEBUG lifeline::spawn] START RedeemService/task-pangolin-ropsten-service-redeem-scan
[2021-11-22T03:10:12Z DEBUG lifeline::spawn] START RedeemService/task-pangolin-ropsten-service-redeem-command
[2021-11-22T03:10:12Z INFO  task_pangolin_ropsten::service::redeem::handler] SERVICE RESTARTING...
[2021-11-22T03:10:12Z INFO  task_pangolin_ropsten::service::redeem::handler] SERVICE RESTARTING...
[2021-11-22T03:10:12Z INFO  task_pangolin_ropsten::service::redeem::handler] ✨ SERVICE STARTED: ETHEREUM <> DARWINIA REDEEM
[2021-11-22T03:10:12Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:10:12Z INFO  task_pangolin_ropsten::service::redeem::handler] ✨ SERVICE STARTED: ETHEREUM <> DARWINIA REDEEM
[2021-11-22T03:12:13Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:14:13Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:16:13Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:18:14Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:20:14Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:22:14Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:24:15Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:26:15Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:28:16Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:30:16Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:32:16Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:34:17Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:36:17Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:38:18Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:40:18Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:42:18Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:44:18Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:46:19Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:48:19Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:50:19Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:52:20Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:54:22Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10
[2021-11-22T03:56:24Z TRACE task_pangolin_ropsten::service::redeem] Track ropsten redeem block: 11460246 and limit: 10

# bridger kv -n task-pangolin-ropsten get scan.ropsten.redeem.running scan.ropsten.redeem.current -o table --include-key
+-----------------------------+----------+
| scan.ropsten.redeem.running | true     |
+-----------------------------+----------+
| scan.ropsten.redeem.current | 11460246 |
+-----------------------------+----------+

[fewensa]

It's happened again, I think the question is appears in gql-client-rs.
https://github.com/arthurkhlghatyan/gql-client-rs/blob/3679352e194070102ae7c728242c9d101ec6baf8/src/client.rs#L66
In this library, the timeout is not set when create a new client.

This issue must be resolved before the new version is released.

Related:
seanmonstar/reqwest#36
seanmonstar/reqwest#62

[fewensa]

Maybe I found the reason

~$  docker logs pangolin-ropsten 2>&1 | grep "thegraph"
GQLClient Error: error sending request for url (https://api.thegraph.com/subgraphs/name/fewensa/bridge-ropsten): operation timed out
', /__w/bridger/bridger/components/thegraph-liketh/src/graph.rs:50:14
GQLClient Error: error sending request for url (https://api.thegraph.com/subgraphs/name/fewensa/bridge-ropsten): operation timed out
', /__w/bridger/bridger/components/thegraph-liketh/src/graph.rs:50:14
GQLClient Error: error sending request for url (https://api.thegraph.com/subgraphs/name/fewensa/bridge-ropsten): operation timed out
', /__w/bridger/bridger/components/thegraph-liketh/src/graph.rs:50:14
GQLClient Error: error sending request for url (https://api.thegraph.com/subgraphs/name/fewensa/bridge-ropsten): operation timed out
', /__w/bridger/bridger/components/thegraph-liketh/src/graph.rs:50:14

When timeout for reading thegraph. there will be unwrap() (panic) directly. so this thread will be dropped.

bridger/components/thegraph-liketh/src/graph.rs

Line 50 in 1989d4d

.unwrap();