1
docker compose -f compose-server.yaml up
2
WARN[0000] Found orphan containers ([specter-validator-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
3
[+] Running 6/0
4
 ⠿ Container specter-srvb-1    Created                                                                                                                                                                                                                                                           0.0s
5
 ⠿ Container specter-srva-1    Created                                                                                                                                                                                                                                                           0.0s
6
 ⠿ Container specter-srvd-1    Created                                                                                                                                                                                                                                                           0.0s
7
 ⠿ Container specter-pebble-1  Created                                                                                                                                                                                                                                                           0.0s
8
 ⠿ Container specter-seed-1    Created                                                                                                                                                                                                                                                           0.0s
9
 ⠿ Container specter-srvc-1    Created                                                                                                                                                                                                                                                           0.0s
10
Attaching to specter-pebble-1, specter-seed-1, specter-srva-1, specter-srvb-1, specter-srvc-1, specter-srvd-1
11
specter-pebble-1  | Pebble 2022/08/10 21:44:50 Starting Pebble ACME server
12
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Generated new root issuer CN=Pebble Root CA 495692 with serial 6906bbb859466b21 and SKI 9e0833985e25ac1637e01feee59d491384978f37
13
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Generated new intermediate issuer CN=Pebble Intermediate CA 582eef with serial 7d9c38c2b607853a and SKI 3f1396bf52da3b3982c24e4a9e9bf8aea93fcc3e
14
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Generated issuance chain: Pebble Root CA 495692 -> Pebble Intermediate CA 582eef
15
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Using system DNS resolver for ACME challenges
16
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Disabling random VA sleeps
17
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Disabling VA challenge requests. VA always returns valid
18
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Configured to reject 5% of good nonces
19
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Configured to attempt authz reuse for each identifier 50% of the time
20
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Configured to show 3 orders per page
21
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Management interface listening on: 0.0.0.0:15000
22
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Root CA certificate available at: https://0.0.0.0:15000/roots/0
23
specter-pebble-1  | Pebble 2022/08/10 21:44:51 Listening on: 0.0.0.0:14000
24
specter-pebble-1  | Pebble 2022/08/10 21:44:51 ACME directory available at: https://0.0.0.0:14000/dir
25
specter-srva-1    | 2022-08-10T21:44:51.313Z    INFO    server/server.go:215    Using certmagic as cert provider        {"email": "admin@example.com", "challenger": "hostedacme.com"}
26
specter-srva-1    | 2022-08-10T21:44:51.321Z    INFO    quic-go@v0.28.1/packet_handler_map.go:142       failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 2048 kiB, got: 416 kiB). See https://github.com/lucas-clemente/quic-go/wiki/UDP-Receive-Buffer-Size for details.
27
specter-srva-1    | 2022-08-10T21:44:51.322Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "chord", "node": 37795961421988, "listen": "172.22.0.3:1113"}
28
specter-srva-1    | 2022-08-10T21:44:51.322Z    INFO    overlay/alpn_mux.go:85  alpn muxer started      {"component": "alpnMux", "protos": ["h3", "h3-29", "specter-chord/1", "specter-tcp/1", "specter-tun/1"]}
29
specter-srva-1    | 2022-08-10T21:44:51.322Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 37795961421988, "peer": "address:\"seed:1113\" unknown:true"}
30
specter-srvb-1    | 2022-08-10T21:44:52.005Z    INFO    server/server.go:215    Using certmagic as cert provider        {"email": "admin@example.com", "challenger": "hostedacme.com"}
31
specter-srvb-1    | 2022-08-10T21:44:52.008Z    INFO    quic-go@v0.28.1/packet_handler_map.go:142       failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 2048 kiB, got: 416 kiB). See https://github.com/lucas-clemente/quic-go/wiki/UDP-Receive-Buffer-Size for details.
32
specter-srvb-1    | 2022-08-10T21:44:52.009Z    INFO    overlay/alpn_mux.go:85  alpn muxer started      {"component": "alpnMux", "protos": ["h3", "h3-29", "specter-chord/1", "specter-tcp/1", "specter-tun/1"]}
33
specter-srvb-1    | 2022-08-10T21:44:52.010Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "chord", "node": 84671371534117, "listen": "172.22.0.4:1113"}
34
specter-srvb-1    | 2022-08-10T21:44:52.009Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 84671371534117, "peer": "address:\"seed:1113\" unknown:true"}
35
specter-srvd-1    | 2022-08-10T21:44:52.639Z    INFO    server/server.go:215    Using certmagic as cert provider        {"email": "admin@example.com", "challenger": "hostedacme.com"}
36
specter-srvd-1    | 2022-08-10T21:44:52.647Z    INFO    quic-go@v0.28.1/packet_handler_map.go:142       failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 2048 kiB, got: 416 kiB). See https://github.com/lucas-clemente/quic-go/wiki/UDP-Receive-Buffer-Size for details.
37
specter-srvd-1    | 2022-08-10T21:44:52.649Z    INFO    overlay/alpn_mux.go:85  alpn muxer started      {"component": "alpnMux", "protos": ["h3", "h3-29", "specter-chord/1", "specter-tcp/1", "specter-tun/1"]}
38
specter-srvd-1    | 2022-08-10T21:44:52.649Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "chord", "node": 76056495571947, "listen": "172.22.0.5:1113"}
39
specter-srvd-1    | 2022-08-10T21:44:52.649Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 76056495571947, "peer": "address:\"seed:1113\" unknown:true"}
40
specter-srvc-1    | 2022-08-10T21:44:53.418Z    INFO    server/server.go:215    Using certmagic as cert provider        {"email": "admin@example.com", "challenger": "hostedacme.com"}
41
specter-srvc-1    | 2022-08-10T21:44:53.427Z    INFO    quic-go@v0.28.1/packet_handler_map.go:142       failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 2048 kiB, got: 416 kiB). See https://github.com/lucas-clemente/quic-go/wiki/UDP-Receive-Buffer-Size for details.
42
specter-srvc-1    | 2022-08-10T21:44:53.428Z    INFO    overlay/alpn_mux.go:85  alpn muxer started      {"component": "alpnMux", "protos": ["h3", "h3-29", "specter-chord/1", "specter-tcp/1", "specter-tun/1"]}
43
specter-srvc-1    | 2022-08-10T21:44:53.428Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "chord", "node": 118605669798269, "listen": "172.22.0.6:1113"}
44
specter-srvc-1    | 2022-08-10T21:44:53.428Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 118605669798269, "peer": "address:\"seed:1113\" unknown:true"}
45
specter-seed-1    | 2022-08-10T21:44:54.231Z    INFO    server/server.go:215    Using certmagic as cert provider        {"email": "admin@example.com", "challenger": "hostedacme.com"}
46
specter-seed-1    | 2022-08-10T21:44:54.237Z    INFO    quic-go@v0.28.1/packet_handler_map.go:142       failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 2048 kiB, got: 416 kiB). See https://github.com/lucas-clemente/quic-go/wiki/UDP-Receive-Buffer-Size for details.
47
specter-seed-1    | 2022-08-10T21:44:54.239Z    INFO    chord/local_membership.go:17    Creating new Chord ring {"component": "chord", "node": 272898810982308}
48
specter-seed-1    | 2022-08-10T21:44:54.239Z    INFO    overlay/alpn_mux.go:85  alpn muxer started      {"component": "alpnMux", "protos": ["h3", "h3-29", "specter-chord/1", "specter-tcp/1", "specter-tun/1"]}
49
specter-seed-1    | 2022-08-10T21:44:54.239Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "chord", "node": 272898810982308, "listen": "172.22.0.7:1113"}
50
specter-seed-1    | 2022-08-10T21:44:54.239Z    INFO    chord/local_chord.go:69 Discovered new predecessor via Notify   {"component": "chord", "node": 272898810982308, "previous": "nil", "predecessor": 272898810982308}
51
specter-seed-1    | 2022-08-10T21:44:54.239Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 272898810982308, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48]}
52
specter-seed-1    | 2022-08-10T21:44:54.240Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
53
specter-seed-1    | 2022-08-10T21:44:54.240Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key"}
54
specter-seed-1    | 2022-08-10T21:44:54.240Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
55
specter-seed-1    | 2022-08-10T21:44:54.241Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key"}
56
specter-seed-1    | 2022-08-10T21:44:54.241Z    INFO    gateway/gateway.go:114  gateway server started  {"component": "gateway"}
57
specter-seed-1    | 2022-08-10T21:44:54.241Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
58
specter-seed-1    | 2022-08-10T21:44:54.241Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "exists": false}
59
specter-seed-1    | 2022-08-10T21:44:54.241Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "tun", "node": 55853783565444, "listen": "172.22.0.7:1113"}
60
specter-seed-1    | 2022-08-10T21:44:54.241Z    INFO    server/server.go:47     publishing identities to chord  {"component": "tun", "node": 55853783565444}
61
specter-seed-1    | 2022-08-10T21:44:54.242Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/identities/chord/seed:1113/272898810982308", "id": 35134149804376}
62
specter-seed-1    | 2022-08-10T21:44:54.242Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_1333181507267158217", "id": 81406019167879}
63
specter-seed-1    | 2022-08-10T21:44:54.242Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/identities/tunnel/seed:1113/55853783565444", "id": 245607335684585}
64
specter-seed-1    | 2022-08-10T21:44:54.242Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
65
specter-seed-1    | 2022-08-10T21:44:54.243Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_1333181507267158217", "id": 81406019167879}
66
specter-seed-1    | 2022-08-10T21:44:54.243Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "rw_test_1333181507267158217", "val_length": 10240}
67
specter-seed-1    | 2022-08-10T21:44:54.243Z    INFO    server/resolve.go:45    identities published on chord   {"component": "tun", "node": 55853783565444, "chord": "/identities/chord/seed:1113/272898810982308", "tun": "/identities/tunnel/seed:1113/55853783565444"}
68
specter-seed-1    | 2022-08-10T21:44:54.243Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "exists": false}
69
specter-seed-1    | 2022-08-10T21:44:54.243Z    DEBUG   chord/local_kv.go:75    KV Delete       {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_1333181507267158217", "id": 81406019167879}
70
specter-seed-1    | 2022-08-10T21:44:54.243Z    INFO    server/server.go:52     specter server started  {"component": "tun", "node": 55853783565444}
71
specter-seed-1    | 2022-08-10T21:44:54.243Z    INFO    obtain  certmagic@v0.16.2/config.go:466 acquiring lock  {"component": "acme", "identifier": "dev.con.nect.sh"}
72
specter-seed-1    | 2022-08-10T21:44:54.243Z    DEBUG   chord/local_kv.go:118   KV Acquire      {"component": "chord", "node": 272898810982308, "lease": "/acme-storage/issue_cert_dev.con.nect.sh", "id": 158622818693899}
73
specter-seed-1    | 2022-08-10T21:44:54.243Z    DEBUG   storage/chord.go:62     Lease acquired  {"component": "storage", "key": "issue_cert_dev.con.nect.sh", "lease": 1660167954243819400}
74
specter-seed-1    | 2022-08-10T21:44:54.243Z    INFO    obtain  certmagic@v0.16.2/config.go:489 lock acquired   {"component": "acme", "identifier": "dev.con.nect.sh"}
75
specter-seed-1    | 2022-08-10T21:44:54.244Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_1993065010604600790", "id": 278672947863643}
76
specter-seed-1    | 2022-08-10T21:44:54.244Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_1993065010604600790", "id": 278672947863643}
77
specter-seed-1    | 2022-08-10T21:44:54.244Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "rw_test_1993065010604600790", "val_length": 10240}
78
specter-seed-1    | 2022-08-10T21:44:54.244Z    DEBUG   chord/local_kv.go:75    KV Delete       {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_1993065010604600790", "id": 278672947863643}
79
specter-seed-1    | 2022-08-10T21:44:54.244Z    INFO    obtain  certmagic@v0.16.2/config.go:466 acquiring lock  {"component": "acme", "identifier": "*.dev.con.nect.sh"}
80
specter-seed-1    | 2022-08-10T21:44:54.244Z    DEBUG   chord/local_kv.go:118   KV Acquire      {"component": "chord", "node": 272898810982308, "lease": "/acme-storage/issue_cert_*.dev.con.nect.sh", "id": 1553179569973}
81
specter-seed-1    | 2022-08-10T21:44:54.244Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
82
specter-seed-1    | 2022-08-10T21:44:54.245Z    DEBUG   storage/chord.go:62     Lease acquired  {"component": "storage", "key": "issue_cert_*.dev.con.nect.sh", "lease": 1660167954245079422}
83
specter-seed-1    | 2022-08-10T21:44:54.245Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "exists": false}
84
specter-seed-1    | 2022-08-10T21:44:54.245Z    INFO    obtain  certmagic@v0.16.2/config.go:489 lock acquired   {"component": "acme", "identifier": "*.dev.con.nect.sh"}
85
specter-seed-1    | 2022-08-10T21:44:54.245Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
86
specter-seed-1    | 2022-08-10T21:44:54.245Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key"}
87
specter-seed-1    | 2022-08-10T21:44:54.246Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
88
specter-seed-1    | 2022-08-10T21:44:54.246Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "exists": false}
89
specter-seed-1    | 2022-08-10T21:44:54.246Z    DEBUG   obtain  certmagic@v0.16.2/config.go:528 trying issuer 1/1       {"component": "acme", "issuer": "pebble:14000-dir"}
90
specter-seed-1    | 2022-08-10T21:44:54.247Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
91
specter-seed-1    | 2022-08-10T21:44:54.247Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key"}
92
specter-seed-1    | 2022-08-10T21:44:54.247Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/acme/pebble-14000-dir/users/admin@example.com/admin.json", "id": 120038001843607}
93
specter-seed-1    | 2022-08-10T21:44:54.247Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "acme/pebble-14000-dir/users/admin@example.com/admin.json"}
94
specter-seed-1    | 2022-08-10T21:44:54.248Z    DEBUG   obtain  certmagic@v0.16.2/config.go:528 trying issuer 1/1       {"component": "acme", "issuer": "pebble:14000-dir"}
95
specter-seed-1    | 2022-08-10T21:44:54.248Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/acme/pebble-14000-dir/users/admin@example.com/admin.json", "id": 120038001843607}
96
specter-seed-1    | 2022-08-10T21:44:54.248Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "acme/pebble-14000-dir/users/admin@example.com/admin.json"}
97
specter-seed-1    | 2022-08-10T21:44:54.271Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "srvc:1113/118605669798269"}
98
specter-seed-1    | 2022-08-10T21:44:54.271Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "srvc:1113/118605669798269"}
99
specter-seed-1    | 2022-08-10T21:44:54.272Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "srvd:1113/76056495571947"}
100
specter-seed-1    | 2022-08-10T21:44:54.272Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "srvd:1113/76056495571947"}
101
specter-srvc-1    | 2022-08-10T21:44:54.272Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 118605669798269, "direction": "outgoing", "key": "seed:1113/272898810982308"}
102
specter-srvc-1    | 2022-08-10T21:44:54.272Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 118605669798269, "direction": "outgoing", "key": "seed:1113/272898810982308"}
103
specter-srvc-1    | 2022-08-10T21:44:54.273Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 118605669798269, "peer": "address:\"seed:1113\" unknown:true", "remote": "172.22.0.7:1113", "local": "[::]:40104"}
104
specter-srvc-1    | 2022-08-10T21:44:54.273Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "address:\"seed:1113\" unknown:true", "remote": "172.22.0.7:1113", "local": "[::]:40104", "pov": "transport_dial"}
105
specter-srvd-1    | 2022-08-10T21:44:54.273Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 76056495571947, "direction": "outgoing", "key": "seed:1113/272898810982308"}
106
specter-srvd-1    | 2022-08-10T21:44:54.273Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 76056495571947, "direction": "outgoing", "key": "seed:1113/272898810982308"}
107
specter-srvd-1    | 2022-08-10T21:44:54.273Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 76056495571947, "peer": "address:\"seed:1113\" unknown:true", "remote": "172.22.0.7:1113", "local": "[::]:45994"}
108
specter-srvd-1    | 2022-08-10T21:44:54.273Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "address:\"seed:1113\" unknown:true", "remote": "172.22.0.7:1113", "local": "[::]:45994", "pov": "transport_dial"}
109
specter-seed-1    | 2022-08-10T21:44:54.274Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 272898810982308, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:40104", "local": "172.22.0.7:1113"}
110
specter-seed-1    | 2022-08-10T21:44:54.275Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:40104", "local": "172.22.0.7:1113", "pov": "local_rpc"}
111
specter-seed-1    | 2022-08-10T21:44:54.275Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 272898810982308, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:45994", "local": "172.22.0.7:1113"}
112
specter-seed-1    | 2022-08-10T21:44:54.275Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:45994", "local": "172.22.0.7:1113", "pov": "local_rpc"}
113
specter-srvc-1    | 2022-08-10T21:44:54.276Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 118605669798269, "attempt": 1, "via": "seed:1113"}
114
specter-seed-1    | 2022-08-10T21:44:54.276Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "srvb:1113/84671371534117"}
115
specter-seed-1    | 2022-08-10T21:44:54.277Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "srvb:1113/84671371534117"}
116
specter-seed-1    | 2022-08-10T21:44:54.277Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 272898810982308, "key": "srvc:1113/118605669798269"}
117
specter-seed-1    | 2022-08-10T21:44:54.277Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "srva:1113/37795961421988"}
118
specter-seed-1    | 2022-08-10T21:44:54.277Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "srva:1113/37795961421988"}
119
specter-srvb-1    | 2022-08-10T21:44:54.277Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 84671371534117, "direction": "outgoing", "key": "seed:1113/272898810982308"}
120
specter-srvb-1    | 2022-08-10T21:44:54.277Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 84671371534117, "direction": "outgoing", "key": "seed:1113/272898810982308"}
121
specter-srvd-1    | 2022-08-10T21:44:54.277Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 76056495571947, "attempt": 1, "via": "seed:1113"}
122
specter-seed-1    | 2022-08-10T21:44:54.277Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 272898810982308, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:40104", "local": "172.22.0.7:1113"}
123
specter-seed-1    | 2022-08-10T21:44:54.278Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:40104", "local": "172.22.0.7:1113", "pov": "transport_dial"}
124
specter-srvb-1    | 2022-08-10T21:44:54.278Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 84671371534117, "peer": "address:\"seed:1113\" unknown:true", "remote": "172.22.0.7:1113", "local": "[::]:50905"}
125
specter-srva-1    | 2022-08-10T21:44:54.278Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 37795961421988, "direction": "outgoing", "key": "seed:1113/272898810982308"}
126
specter-seed-1    | 2022-08-10T21:44:54.278Z    INFO    chord/local_membership.go:106   incoming join request   {"component": "chord", "node": 272898810982308, "joiner": 118605669798269}
127
specter-srvb-1    | 2022-08-10T21:44:54.278Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "address:\"seed:1113\" unknown:true", "remote": "172.22.0.7:1113", "local": "[::]:50905", "pov": "transport_dial"}
128
specter-srva-1    | 2022-08-10T21:44:54.278Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 37795961421988, "direction": "outgoing", "key": "seed:1113/272898810982308"}
129
specter-seed-1    | 2022-08-10T21:44:54.278Z    INFO    chord/local_chord.go:220        transferring keys to new predecessor    {"component": "chord", "node": 272898810982308, "predecessor": 118605669798269, "num_keys": 2}
130
specter-srva-1    | 2022-08-10T21:44:54.278Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 37795961421988, "peer": "address:\"seed:1113\" unknown:true", "remote": "172.22.0.7:1113", "local": "[::]:48724"}
131
specter-srva-1    | 2022-08-10T21:44:54.278Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "address:\"seed:1113\" unknown:true", "remote": "172.22.0.7:1113", "local": "[::]:48724", "pov": "transport_dial"}
132
specter-seed-1    | 2022-08-10T21:44:54.278Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 272898810982308, "key": "srvd:1113/76056495571947"}
133
specter-seed-1    | 2022-08-10T21:44:54.278Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 272898810982308, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:50905", "local": "172.22.0.7:1113"}
134
specter-seed-1    | 2022-08-10T21:44:54.279Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:50905", "local": "172.22.0.7:1113", "pov": "local_rpc"}
135
specter-seed-1    | 2022-08-10T21:44:54.279Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 272898810982308, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:45994", "local": "172.22.0.7:1113"}
136
specter-seed-1    | 2022-08-10T21:44:54.279Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:45994", "local": "172.22.0.7:1113", "pov": "transport_dial"}
137
specter-seed-1    | 2022-08-10T21:44:54.279Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 272898810982308, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:48724", "local": "172.22.0.7:1113"}
138
specter-seed-1    | 2022-08-10T21:44:54.279Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:48724", "local": "172.22.0.7:1113", "pov": "local_rpc"}
139
specter-srvc-1    | 2022-08-10T21:44:54.279Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 118605669798269, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:40104"}
140
specter-srvc-1    | 2022-08-10T21:44:54.280Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:40104", "pov": "local_rpc"}
141
specter-srvc-1    | 2022-08-10T21:44:54.281Z    DEBUG   chord/local_kv.go:154   KV Import       {"component": "chord", "node": 118605669798269, "num_keys": 2}
142
specter-srvb-1    | 2022-08-10T21:44:54.281Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 84671371534117, "attempt": 1, "via": "seed:1113"}
143
specter-srva-1    | 2022-08-10T21:44:54.281Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 37795961421988, "attempt": 1, "via": "seed:1113"}
144
specter-srvd-1    | 2022-08-10T21:44:54.281Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 76056495571947, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:45994"}
145
specter-srvd-1    | 2022-08-10T21:44:54.281Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:45994", "pov": "local_rpc"}
146
specter-seed-1    | 2022-08-10T21:44:54.281Z    INFO    chord/local_membership.go:93    rejecting join request because current state is not Active      {"component": "chord", "node": 272898810982308, "joiner": 76056495571947}
147
specter-seed-1    | 2022-08-10T21:44:54.282Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 272898810982308, "key": "srvb:1113/84671371534117"}
148
specter-srvc-1    | 2022-08-10T21:44:54.282Z    INFO    chord/local_membership.go:46    Successfully joined Chord ring  {"component": "chord", "node": 118605669798269, "predecessor": 272898810982308, "successor": 272898810982308}
149
specter-seed-1    | 2022-08-10T21:44:54.282Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 272898810982308, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:50905", "local": "172.22.0.7:1113"}
150
specter-seed-1    | 2022-08-10T21:44:54.282Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:50905", "local": "172.22.0.7:1113", "pov": "transport_dial"}
151
specter-seed-1    | 2022-08-10T21:44:54.282Z    INFO    chord/local_membership.go:93    rejecting join request because current state is not Active      {"component": "chord", "node": 272898810982308, "joiner": 84671371534117}
152
specter-seed-1    | 2022-08-10T21:44:54.282Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 272898810982308, "key": "srva:1113/37795961421988"}
153
specter-srvd-1    | 2022-08-10T21:44:54.283Z    ERROR   chord/local_membership.go:73    error trying to join ring, retrying     {"component": "chord", "node": 76056495571947, "error": "node cannot handle join request at the moment"}
154
specter-srvd-1    | kon.nect.sh/specter/chord.(*LocalNode).executeJoin
155
specter-srvd-1    |     /app/chord/local_membership.go:73
156
specter-srvd-1    | kon.nect.sh/specter/chord.(*LocalNode).Join
157
specter-seed-1    | 2022-08-10T21:44:54.283Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 272898810982308, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:48724", "local": "172.22.0.7:1113"}
158
specter-srvd-1    |     /app/chord/local_membership.go:35
159
specter-seed-1    | 2022-08-10T21:44:54.283Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:48724", "local": "172.22.0.7:1113", "pov": "transport_dial"}
160
specter-srvd-1    | kon.nect.sh/specter/cmd/server.cmdServer
161
specter-srvd-1    |     /app/cmd/server/server.go:365
162
specter-srvd-1    | github.com/urfave/cli/v2.(*Command).Run
163
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
164
specter-srvd-1    | github.com/urfave/cli/v2.(*App).RunContext
165
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
166
specter-srvd-1    | main.main
167
specter-srvd-1    |     /app/main.go:66
168
specter-srvd-1    | runtime.main
169
specter-seed-1    | 2022-08-10T21:44:54.283Z    INFO    chord/local_membership.go:93    rejecting join request because current state is not Active      {"component": "chord", "node": 272898810982308, "joiner": 37795961421988}
170
specter-srvd-1    |     /usr/local/go/src/runtime/proc.go:250
171
specter-srvb-1    | 2022-08-10T21:44:54.283Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 84671371534117, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:50905"}
172
specter-srvb-1    | 2022-08-10T21:44:54.283Z    ERROR   chord/local_membership.go:73    error trying to join ring, retrying     {"component": "chord", "node": 84671371534117, "error": "node cannot handle join request at the moment"}
173
specter-srvb-1    | kon.nect.sh/specter/chord.(*LocalNode).executeJoin
174
specter-srvb-1    |     /app/chord/local_membership.go:73
175
specter-srvb-1    | kon.nect.sh/specter/chord.(*LocalNode).Join
176
specter-srvb-1    |     /app/chord/local_membership.go:35
177
specter-srvb-1    | kon.nect.sh/specter/cmd/server.cmdServer
178
specter-srvb-1    |     /app/cmd/server/server.go:365
179
specter-srvb-1    | github.com/urfave/cli/v2.(*Command).Run
180
specter-srvb-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
181
specter-srvb-1    | github.com/urfave/cli/v2.(*App).RunContext
182
specter-srvb-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
183
specter-srvb-1    | main.main
184
specter-srvb-1    |     /app/main.go:66
185
specter-srvb-1    | runtime.main
186
specter-srvb-1    |     /usr/local/go/src/runtime/proc.go:250
187
specter-srvb-1    | 2022-08-10T21:44:54.283Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:50905", "pov": "local_rpc"}
188
specter-srva-1    | 2022-08-10T21:44:54.283Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 37795961421988, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:48724"}
189
specter-srva-1    | 2022-08-10T21:44:54.283Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:48724", "pov": "local_rpc"}
190
specter-srvc-1    | 2022-08-10T21:44:54.284Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 118605669798269, "peer": "id:118605669798269 address:\"srvc:1113\""}
191
specter-srva-1    | 2022-08-10T21:44:54.284Z    ERROR   chord/local_membership.go:73    error trying to join ring, retrying     {"component": "chord", "node": 37795961421988, "error": "node cannot handle join request at the moment"}
192
specter-srva-1    | kon.nect.sh/specter/chord.(*LocalNode).executeJoin
193
specter-srva-1    |     /app/chord/local_membership.go:73
194
specter-srva-1    | kon.nect.sh/specter/chord.(*LocalNode).Join
195
specter-srva-1    |     /app/chord/local_membership.go:35
196
specter-srva-1    | kon.nect.sh/specter/cmd/server.cmdServer
197
specter-srva-1    |     /app/cmd/server/server.go:365
198
specter-srva-1    | github.com/urfave/cli/v2.(*Command).Run
199
specter-srva-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
200
specter-srva-1    | github.com/urfave/cli/v2.(*App).RunContext
201
specter-srva-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
202
specter-srva-1    | main.main
203
specter-srva-1    |     /app/main.go:66
204
specter-srva-1    | runtime.main
205
specter-srva-1    |     /usr/local/go/src/runtime/proc.go:250
206
specter-srvc-1    | 2022-08-10T21:44:54.298Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 118605669798269, "direction": "incoming"}
207
specter-srvc-1    | 2022-08-10T21:44:54.298Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 118605669798269, "direction": "incoming", "key": "srvc:1113/118605669798269"}
208
specter-srvc-1    | 2022-08-10T21:44:54.299Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 118605669798269, "direction": "outgoing"}
209
specter-srvc-1    | 2022-08-10T21:44:54.299Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 118605669798269, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:1113", "local": "[::]:48888"}
210
specter-srvc-1    | 2022-08-10T21:44:54.299Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:1113", "local": "[::]:48888", "pov": "transport_dial"}
211
specter-srvc-1    | 2022-08-10T21:44:54.300Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 118605669798269, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:48888", "local": "172.22.0.6:1113"}
212
specter-srvc-1    | 2022-08-10T21:44:54.300Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:48888", "local": "172.22.0.6:1113", "pov": "local_rpc"}
213
specter-srvc-1    | 2022-08-10T21:44:54.304Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 118605669798269, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48]}
214
specter-seed-1    | 2022-08-10T21:44:54.305Z    INFO    chord/local_membership.go:128   Join completed, joiner has requested to update pointers {"component": "chord", "node": 272898810982308}
215
specter-seed-1    | 2022-08-10T21:44:54.307Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 272898810982308, "peer": "id:272898810982308 address:\"seed:1113\""}
216
specter-seed-1    | 2022-08-10T21:44:54.320Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 272898810982308, "direction": "incoming"}
217
specter-seed-1    | 2022-08-10T21:44:54.321Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 272898810982308, "direction": "incoming", "key": "seed:1113/272898810982308"}
218
specter-seed-1    | 2022-08-10T21:44:54.321Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 272898810982308, "direction": "outgoing"}
219
specter-seed-1    | 2022-08-10T21:44:54.321Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 272898810982308, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:46326"}
220
specter-seed-1    | 2022-08-10T21:44:54.321Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:1113", "local": "[::]:46326", "pov": "transport_dial"}
221
specter-seed-1    | 2022-08-10T21:44:54.321Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 272898810982308, "successors": [118605669798269, 272898810982308]}
222
specter-seed-1    | 2022-08-10T21:44:54.322Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 272898810982308, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:46326", "local": "172.22.0.7:1113"}
223
specter-seed-1    | 2022-08-10T21:44:54.322Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 272898810982308, "peer": "id:272898810982308 address:\"seed:1113\"", "remote": "172.22.0.7:46326", "local": "172.22.0.7:1113", "pov": "local_rpc"}
224
specter-seed-1    | 2022-08-10T21:44:54.324Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 272898810982308, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47]}
225
specter-seed-1    | 2022-08-10T21:44:54.325Z    INFO    chord/local_membership.go:133   Join completed, joiner has requested to release membership lock {"component": "chord", "node": 272898810982308}
226
specter-seed-1    | 2022-08-10T21:44:54.327Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
227
specter-srvc-1    | 2022-08-10T21:44:54.328Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key"}
228
specter-srvc-1    | 2022-08-10T21:44:54.329Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
229
specter-srvc-1    | 2022-08-10T21:44:54.330Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key"}
230
specter-srvc-1    | 2022-08-10T21:44:54.330Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
231
specter-srvc-1    | 2022-08-10T21:44:54.331Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "exists": false}
232
specter-srvc-1    | 2022-08-10T21:44:54.331Z    INFO    server/server.go:47     publishing identities to chord  {"component": "tun", "node": 39139998456636}
233
specter-srvc-1    | 2022-08-10T21:44:54.331Z    INFO    gateway/gateway.go:114  gateway server started  {"component": "gateway"}
234
specter-srvc-1    | 2022-08-10T21:44:54.332Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "tun", "node": 39139998456636, "listen": "172.22.0.6:1113"}
235
specter-seed-1    | 2022-08-10T21:44:54.333Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/identities/chord/srvc:1113/118605669798269", "id": 156688365253593}
236
specter-seed-1    | 2022-08-10T21:44:54.334Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_3357026795434388694", "id": 233274510560744}
237
specter-seed-1    | 2022-08-10T21:44:54.334Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
238
specter-seed-1    | 2022-08-10T21:44:54.334Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/identities/tunnel/srvc:1113/39139998456636", "id": 118707640652433}
239
specter-srvc-1    | 2022-08-10T21:44:54.335Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "exists": false}
240
specter-seed-1    | 2022-08-10T21:44:54.336Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_3357026795434388694", "id": 233274510560744}
241
specter-srvc-1    | 2022-08-10T21:44:54.336Z    INFO    server/resolve.go:45    identities published on chord   {"component": "tun", "node": 39139998456636, "chord": "/identities/chord/srvc:1113/118605669798269", "tun": "/identities/tunnel/srvc:1113/39139998456636"}
242
specter-srvc-1    | 2022-08-10T21:44:54.336Z    INFO    server/server.go:52     specter server started  {"component": "tun", "node": 39139998456636}
243
specter-srvc-1    | 2022-08-10T21:44:54.336Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/rw_test_3681851601800274235", "id": 24279433460816}
244
specter-srvc-1    | 2022-08-10T21:44:54.336Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/rw_test_3681851601800274235", "id": 24279433460816}
245
specter-srvc-1    | 2022-08-10T21:44:54.336Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "rw_test_3681851601800274235", "val_length": 10240}
246
specter-srvc-1    | 2022-08-10T21:44:54.336Z    DEBUG   chord/local_kv.go:75    KV Delete       {"component": "chord", "node": 118605669798269, "key": "/acme-storage/rw_test_3681851601800274235", "id": 24279433460816}
247
specter-srvc-1    | 2022-08-10T21:44:54.337Z    INFO    obtain  certmagic@v0.16.2/config.go:466 acquiring lock  {"component": "acme", "identifier": "*.dev.con.nect.sh"}
248
specter-srvc-1    | 2022-08-10T21:44:54.337Z    DEBUG   chord/local_kv.go:118   KV Acquire      {"component": "chord", "node": 118605669798269, "lease": "/acme-storage/issue_cert_*.dev.con.nect.sh", "id": 1553179569973}
249
specter-srvc-1    | 2022-08-10T21:44:54.337Z    DEBUG   storage/chord.go:58     Lease acquire conflict, retrying        {"component": "storage", "key": "issue_cert_*.dev.con.nect.sh"}
250
specter-srvc-1    | 2022-08-10T21:44:54.337Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "rw_test_3357026795434388694", "val_length": 10240}
251
specter-seed-1    | 2022-08-10T21:44:54.338Z    DEBUG   chord/local_kv.go:75    KV Delete       {"component": "chord", "node": 272898810982308, "key": "/acme-storage/rw_test_3357026795434388694", "id": 233274510560744}
252
specter-srvc-1    | 2022-08-10T21:44:54.339Z    INFO    obtain  certmagic@v0.16.2/config.go:466 acquiring lock  {"component": "acme", "identifier": "dev.con.nect.sh"}
253
specter-seed-1    | 2022-08-10T21:44:54.340Z    DEBUG   chord/local_kv.go:118   KV Acquire      {"component": "chord", "node": 272898810982308, "lease": "/acme-storage/issue_cert_dev.con.nect.sh", "id": 158622818693899}
254
specter-srvc-1    | 2022-08-10T21:44:54.341Z    ERROR   chord/remote.go:342     remote KV Acquire RPC   {"component": "chord", "node": 118605669798269, "peer": "id:272898810982308 address:\"seed:1113\"", "error": "lease has not expired or was acquired by a different requester"}
255
specter-srvc-1    | kon.nect.sh/specter/chord.(*RemoteNode).Acquire
256
specter-srvc-1    |     /app/chord/remote.go:342
257
specter-srvc-1    | kon.nect.sh/specter/chord.(*LocalNode).Acquire.func1
258
specter-srvc-1    |     /app/chord/local_kv.go:120
259
specter-srvc-1    | kon.nect.sh/specter/chord.kvMiddleware[...]
260
specter-srvc-1    |     /app/chord/local_kv.go:47
261
specter-srvc-1    | kon.nect.sh/specter/chord.(*LocalNode).Acquire
262
specter-srvc-1    |     /app/chord/local_kv.go:115
263
specter-srvc-1    | kon.nect.sh/specter/acme/storage.(*ChordStorage).Lock.func1
264
specter-srvc-1    |     /app/acme/storage/chord.go:54
265
specter-srvc-1    | kon.nect.sh/specter/acme/storage.retrier[...]
266
specter-srvc-1    |     /app/acme/storage/chord.go:197
267
specter-srvc-1    | kon.nect.sh/specter/acme/storage.(*ChordStorage).Lock
268
specter-srvc-1    |     /app/acme/storage/chord.go:53
269
specter-srvc-1    | github.com/caddyserver/certmagic.acquireLock
270
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/storage.go:237
271
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).obtainCert
272
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:471
273
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).ObtainCertAsync
274
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:443
275
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).manageOne.func1
276
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:340
277
specter-srvc-1    | github.com/caddyserver/certmagic.(*jobManager).worker
278
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/async.go:73
279
specter-srvc-1    | 2022-08-10T21:44:54.341Z    DEBUG   storage/chord.go:58     Lease acquire conflict, retrying        {"component": "storage", "key": "issue_cert_dev.con.nect.sh"}
280
specter-pebble-1  | Pebble 2022/08/10 21:44:54 GET /dir -> calling handler()
281
specter-seed-1    | 2022-08-10T21:44:54.360Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "GET", "url": "https://pebble:14000/dir", "headers": {"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["391"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"]}, "status_code": 200}
282
specter-pebble-1  | Pebble 2022/08/10 21:44:54 HEAD /nonce-plz -> calling handler()
283
specter-pebble-1  | Pebble 2022/08/10 21:44:54 HEAD /nonce-plz -> calling handler()
284
specter-seed-1    | 2022-08-10T21:44:54.362Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "HEAD", "url": "https://pebble:14000/nonce-plz", "headers": {"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["baY2_KuxqWkmrf2JCr5CUA"]}, "status_code": 200}
285
specter-seed-1    | 2022-08-10T21:44:54.362Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "HEAD", "url": "https://pebble:14000/nonce-plz", "headers": {"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["9DwRJfIxvyVTrPBBa1WwKw"]}, "status_code": 200}
286
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /sign-me-up -> calling handler()
287
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /sign-me-up -> calling handler()
288
specter-pebble-1  | Pebble 2022/08/10 21:44:54 There are now 1 accounts in memory
289
specter-pebble-1  | Pebble 2022/08/10 21:44:54 There are now 2 accounts in memory
290
specter-seed-1    | 2022-08-10T21:44:54.364Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/sign-me-up", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["304"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Location":["https://pebble:14000/my-account/1"],"Replay-Nonce":["T4YIp3HBhdI73rv8iZmYWQ"]}, "status_code": 201}
291
specter-seed-1    | 2022-08-10T21:44:54.365Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/sign-me-up", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["304"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Location":["https://pebble:14000/my-account/2"],"Replay-Nonce":["az2uYQCsvLaBvsz2YXb-IQ"]}, "status_code": 201}
292
specter-seed-1    | 2022-08-10T21:44:54.366Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/acme/pebble-14000-dir/users/admin@example.com/admin.json", "id": 120038001843607}
293
specter-seed-1    | 2022-08-10T21:44:54.366Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/acme/pebble-14000-dir/users/admin@example.com/admin.json", "id": 120038001843607}
294
specter-srvc-1    | 2022-08-10T21:44:54.367Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/acme/pebble-14000-dir/users/admin@example.com/admin.key", "id": 78087505213661}
295
specter-srvc-1    | 2022-08-10T21:44:54.367Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/acme/pebble-14000-dir/users/admin@example.com/admin.key", "id": 78087505213661}
296
specter-seed-1    | 2022-08-10T21:44:54.367Z    INFO    certmagic@v0.16.2/acmeclient.go:264     waiting on internal rate limiter        {"component": "issuer", "identifiers": ["dev.con.nect.sh"], "ca": "https://pebble:14000/dir", "account": "admin@example.com"}
297
specter-seed-1    | 2022-08-10T21:44:54.368Z    INFO    certmagic@v0.16.2/acmeclient.go:275     done waiting on internal rate limiter   {"component": "issuer", "identifiers": ["dev.con.nect.sh"], "ca": "https://pebble:14000/dir", "account": "admin@example.com"}
298
specter-seed-1    | 2022-08-10T21:44:54.368Z    INFO    certmagic@v0.16.2/acmeclient.go:264     waiting on internal rate limiter        {"component": "issuer", "identifiers": ["*.dev.con.nect.sh"], "ca": "https://pebble:14000/dir", "account": "admin@example.com"}
299
specter-seed-1    | 2022-08-10T21:44:54.368Z    INFO    certmagic@v0.16.2/acmeclient.go:275     done waiting on internal rate limiter   {"component": "issuer", "identifiers": ["*.dev.con.nect.sh"], "ca": "https://pebble:14000/dir", "account": "admin@example.com"}
300
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /order-plz -> calling handler()
301
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /order-plz -> calling handler()
302
specter-pebble-1  | Pebble 2022/08/10 21:44:54 There are now 1 authorizations in the db
303
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Added order "TnG_Krv-_uu2L33IhdNQgFOZ74xAKwZmBgFa2hf8_2Y" to the db
304
specter-pebble-1  | Pebble 2022/08/10 21:44:54 There are now 1 orders in the db
305
specter-pebble-1  | Pebble 2022/08/10 21:44:54 There are now 2 authorizations in the db
306
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Added order "g9sBG5fa9ZlZWy5Xis-tNGrbZPyzMRFRYlyMVj3Qr_g" to the db
307
specter-pebble-1  | Pebble 2022/08/10 21:44:54 There are now 2 orders in the db
308
specter-seed-1    | 2022-08-10T21:44:54.370Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/order-plz", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["372"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Location":["https://pebble:14000/my-order/TnG_Krv-_uu2L33IhdNQgFOZ74xAKwZmBgFa2hf8_2Y"],"Replay-Nonce":["Bmt6KgqLJVu3n7DJBkJoAw"]}, "status_code": 201}
309
specter-seed-1    | 2022-08-10T21:44:54.371Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/order-plz", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["374"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Location":["https://pebble:14000/my-order/g9sBG5fa9ZlZWy5Xis-tNGrbZPyzMRFRYlyMVj3Qr_g"],"Replay-Nonce":["3D9WwfJJIeg2B2rWwvD_ng"]}, "status_code": 201}
310
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /authZ/ -> calling handler()
311
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /authZ/ -> calling handler()
312
specter-seed-1    | 2022-08-10T21:44:54.373Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/authZ/2kaN2IMcuSwGh1uwxQDUXAUYwmo3ZF49TTk6grmb_Oc", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["857"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["eUlA1Nc8FcYTeJCsp9r97A"]}, "status_code": 200}
313
specter-seed-1    | 2022-08-10T21:44:54.373Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/authZ/lmo2PRPdt0AUJGfd2LpS5jfM4Cwt-w75SvOo11ncV2M", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["416"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["uRIODJvsm3tWswHr0ZEejw"]}, "status_code": 200}
314
specter-seed-1    | 2022-08-10T21:44:54.374Z    DEBUG   acme_client     acmez@v1.0.4/client.go:473      no solver configured    {"component": "issuer", "challenge_type": "http-01"}
315
specter-seed-1    | 2022-08-10T21:44:54.374Z    INFO    acme_client     acmez@v1.0.4/client.go:391      trying to solve challenge       {"component": "issuer", "identifier": "dev.con.nect.sh", "challenge_type": "dns-01", "ca": "https://pebble:14000/dir"}
316
specter-seed-1    | 2022-08-10T21:44:54.374Z    INFO    acme_client     acmez@v1.0.4/client.go:391      trying to solve challenge       {"component": "issuer", "identifier": "*.dev.con.nect.sh", "challenge_type": "dns-01", "ca": "https://pebble:14000/dir"}
317
specter-seed-1    | 2022-08-10T21:44:54.374Z    DEBUG   server/server.go:37     solver present challenge        {"challenge": {"type":"dns-01","url":"https://pebble:14000/chalZ/ctKCu6ZpgoxYaDKT8ZCexWO2xLRo1YmqdTomuqvVl9w","status":"pending","token":"20v3UYR0yN_vR3MOk8dXhkAuBXTQsabG3kOFdynroCE","keyAuthorization":"20v3UYR0yN_vR3MOk8dXhkAuBXTQsabG3kOFdynroCE.6OcYnmN1prPEKH2iLPo_Vf8LkvwxFq1w5IycaT31mVc","identifier":{"type":"dns","value":"dev.con.nect.sh"}}}
318
specter-seed-1    | 2022-08-10T21:44:54.374Z    DEBUG   acme_client     acmez@v1.0.4/client.go:422      waiting for solver before continuing    {"component": "issuer", "identifier": "dev.con.nect.sh", "challenge_type": "dns-01"}
319
specter-seed-1    | 2022-08-10T21:44:54.374Z    DEBUG   server/server.go:37     solver present challenge        {"challenge": {"type":"dns-01","url":"https://pebble:14000/chalZ/P7H-MueOyrRVBchqxwwapsjbDAU_eNQWtB8Rq2QkMXI","status":"pending","token":"Ea5hI2kIzZ7N6mKKmWpZ291ZSxjyMzPM8k9fCl17hOs","keyAuthorization":"Ea5hI2kIzZ7N6mKKmWpZ291ZSxjyMzPM8k9fCl17hOs.76WOGII2iNU29e4Z2xLX02HF2Npi4_P0ZWqNV9cNOGc","identifier":{"type":"dns","value":"dev.con.nect.sh"}}}
320
specter-seed-1    | 2022-08-10T21:44:54.374Z    DEBUG   acme_client     acmez@v1.0.4/client.go:428      done waiting for solver {"component": "issuer", "identifier": "dev.con.nect.sh", "challenge_type": "dns-01"}
321
specter-seed-1    | 2022-08-10T21:44:54.374Z    DEBUG   acme_client     acmez@v1.0.4/client.go:422      waiting for solver before continuing    {"component": "issuer", "identifier": "*.dev.con.nect.sh", "challenge_type": "dns-01"}
322
specter-seed-1    | 2022-08-10T21:44:54.374Z    DEBUG   acme_client     acmez@v1.0.4/client.go:428      done waiting for solver {"component": "issuer", "identifier": "*.dev.con.nect.sh", "challenge_type": "dns-01"}
323
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /chalZ/ -> calling handler()
324
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /chalZ/ -> calling handler()
325
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Pulled a task from the Tasks queue: &va.vaTask{Identifier:acme.Identifier{Type:"dns", Value:"dev.con.nect.sh"}, Challenge:(*core.Challenge)(0xc0002ba3c0), Account:(*core.Account)(0xc00007c300)}
326
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Starting 3 validations.
327
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Pulled a task from the Tasks queue: &va.vaTask{Identifier:acme.Identifier{Type:"dns", Value:"dev.con.nect.sh"}, Challenge:(*core.Challenge)(0xc0004fe5a0), Account:(*core.Account)(0xc000502360)}
328
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Starting 3 validations.
329
specter-pebble-1  | Pebble 2022/08/10 21:44:54 PEBBLE_VA_ALWAYS_VALID is enabled. Skipping real validation of challenge ctKCu6ZpgoxYaDKT8ZCexWO2xLRo1YmqdTomuqvVl9w
330
specter-pebble-1  | Pebble 2022/08/10 21:44:54 PEBBLE_VA_ALWAYS_VALID is enabled. Skipping real validation of challenge ctKCu6ZpgoxYaDKT8ZCexWO2xLRo1YmqdTomuqvVl9w
331
specter-pebble-1  | Pebble 2022/08/10 21:44:54 PEBBLE_VA_ALWAYS_VALID is enabled. Skipping real validation of challenge ctKCu6ZpgoxYaDKT8ZCexWO2xLRo1YmqdTomuqvVl9w
332
specter-pebble-1  | Pebble 2022/08/10 21:44:54 authz 2kaN2IMcuSwGh1uwxQDUXAUYwmo3ZF49TTk6grmb_Oc set VALID by completed challenge ctKCu6ZpgoxYaDKT8ZCexWO2xLRo1YmqdTomuqvVl9w
333
specter-pebble-1  | Pebble 2022/08/10 21:44:54 PEBBLE_VA_ALWAYS_VALID is enabled. Skipping real validation of challenge P7H-MueOyrRVBchqxwwapsjbDAU_eNQWtB8Rq2QkMXI
334
specter-pebble-1  | Pebble 2022/08/10 21:44:54 PEBBLE_VA_ALWAYS_VALID is enabled. Skipping real validation of challenge P7H-MueOyrRVBchqxwwapsjbDAU_eNQWtB8Rq2QkMXI
335
specter-pebble-1  | Pebble 2022/08/10 21:44:54 PEBBLE_VA_ALWAYS_VALID is enabled. Skipping real validation of challenge P7H-MueOyrRVBchqxwwapsjbDAU_eNQWtB8Rq2QkMXI
336
specter-pebble-1  | Pebble 2022/08/10 21:44:54 authz lmo2PRPdt0AUJGfd2LpS5jfM4Cwt-w75SvOo11ncV2M set VALID by completed challenge P7H-MueOyrRVBchqxwwapsjbDAU_eNQWtB8Rq2QkMXI
337
specter-seed-1    | 2022-08-10T21:44:54.376Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/chalZ/ctKCu6ZpgoxYaDKT8ZCexWO2xLRo1YmqdTomuqvVl9w", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["190"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\"","<https://pebble:14000/authZ/2kaN2IMcuSwGh1uwxQDUXAUYwmo3ZF49TTk6grmb_Oc>;rel=\"up\""],"Replay-Nonce":["zviCwIqsGI-MmBDYyZyICA"]}, "status_code": 200}
338
specter-seed-1    | 2022-08-10T21:44:54.376Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/chalZ/P7H-MueOyrRVBchqxwwapsjbDAU_eNQWtB8Rq2QkMXI", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["190"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\"","<https://pebble:14000/authZ/lmo2PRPdt0AUJGfd2LpS5jfM4Cwt-w75SvOo11ncV2M>;rel=\"up\""],"Replay-Nonce":["k95dBt_h7OqcXN1WMh__AA"]}, "status_code": 200}
339
specter-seed-1    | 2022-08-10T21:44:54.376Z    DEBUG   acme_client     acmez@v1.0.4/client.go:445      challenge accepted      {"component": "issuer", "identifier": "dev.con.nect.sh", "challenge_type": "dns-01"}
340
specter-seed-1    | 2022-08-10T21:44:54.377Z    DEBUG   acme_client     acmez@v1.0.4/client.go:445      challenge accepted      {"component": "issuer", "identifier": "*.dev.con.nect.sh", "challenge_type": "dns-01"}
341
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /authZ/ -> calling handler()
342
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /authZ/ -> calling handler()
343
specter-seed-1    | 2022-08-10T21:44:54.630Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/authZ/lmo2PRPdt0AUJGfd2LpS5jfM4Cwt-w75SvOo11ncV2M", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["458"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["Ma5MNkohy_e-UAyA8FqOXg"]}, "status_code": 200}
344
specter-seed-1    | 2022-08-10T21:44:54.630Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/authZ/2kaN2IMcuSwGh1uwxQDUXAUYwmo3ZF49TTk6grmb_Oc", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["437"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["ouOfiDC6oYmkyPB9DoVrhg"]}, "status_code": 200}
345
specter-seed-1    | 2022-08-10T21:44:54.631Z    DEBUG   server/server.go:42     solver cleanup challenge        {"challenge": {"type":"dns-01","url":"https://pebble:14000/chalZ/ctKCu6ZpgoxYaDKT8ZCexWO2xLRo1YmqdTomuqvVl9w","status":"pending","token":"20v3UYR0yN_vR3MOk8dXhkAuBXTQsabG3kOFdynroCE","keyAuthorization":"20v3UYR0yN_vR3MOk8dXhkAuBXTQsabG3kOFdynroCE.6OcYnmN1prPEKH2iLPo_Vf8LkvwxFq1w5IycaT31mVc","identifier":{"type":"dns","value":"dev.con.nect.sh"}}}
346
specter-seed-1    | 2022-08-10T21:44:54.631Z    INFO    acme_client     acmez@v1.0.4/client.go:548      authorization finalized {"component": "issuer", "identifier": "dev.con.nect.sh", "authz_status": "valid"}
347
specter-seed-1    | 2022-08-10T21:44:54.631Z    DEBUG   server/server.go:42     solver cleanup challenge        {"challenge": {"type":"dns-01","url":"https://pebble:14000/chalZ/P7H-MueOyrRVBchqxwwapsjbDAU_eNQWtB8Rq2QkMXI","status":"pending","token":"Ea5hI2kIzZ7N6mKKmWpZ291ZSxjyMzPM8k9fCl17hOs","keyAuthorization":"Ea5hI2kIzZ7N6mKKmWpZ291ZSxjyMzPM8k9fCl17hOs.76WOGII2iNU29e4Z2xLX02HF2Npi4_P0ZWqNV9cNOGc","identifier":{"type":"dns","value":"dev.con.nect.sh"}}}
348
specter-seed-1    | 2022-08-10T21:44:54.631Z    INFO    acme_client     acmez@v1.0.4/client.go:161      validations succeeded; finalizing order {"component": "issuer", "order": "https://pebble:14000/my-order/TnG_Krv-_uu2L33IhdNQgFOZ74xAKwZmBgFa2hf8_2Y"}
349
specter-seed-1    | 2022-08-10T21:44:54.631Z    INFO    acme_client     acmez@v1.0.4/client.go:548      authorization finalized {"component": "issuer", "identifier": "*.dev.con.nect.sh", "authz_status": "valid"}
350
specter-seed-1    | 2022-08-10T21:44:54.632Z    INFO    acme_client     acmez@v1.0.4/client.go:161      validations succeeded; finalizing order {"component": "issuer", "order": "https://pebble:14000/my-order/g9sBG5fa9ZlZWy5Xis-tNGrbZPyzMRFRYlyMVj3Qr_g"}
351
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /finalize-order/ -> calling handler()
352
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /finalize-order/ -> calling handler()
353
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Order TnG_Krv-_uu2L33IhdNQgFOZ74xAKwZmBgFa2hf8_2Y is fully authorized. Processing finalization
354
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Order g9sBG5fa9ZlZWy5Xis-tNGrbZPyzMRFRYlyMVj3Qr_g is fully authorized. Processing finalization
355
specter-seed-1    | 2022-08-10T21:44:54.635Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/finalize-order/TnG_Krv-_uu2L33IhdNQgFOZ74xAKwZmBgFa2hf8_2Y", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["375"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Location":["https://pebble:14000/my-order/TnG_Krv-_uu2L33IhdNQgFOZ74xAKwZmBgFa2hf8_2Y"],"Replay-Nonce":["VTldRNnK7sXzOgzQxygpFg"]}, "status_code": 200}
356
specter-seed-1    | 2022-08-10T21:44:54.635Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/finalize-order/g9sBG5fa9ZlZWy5Xis-tNGrbZPyzMRFRYlyMVj3Qr_g", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["377"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Location":["https://pebble:14000/my-order/g9sBG5fa9ZlZWy5Xis-tNGrbZPyzMRFRYlyMVj3Qr_g"],"Replay-Nonce":["d4FFaHV78M4xtglIaqNh-g"]}, "status_code": 200}
357
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Issued certificate serial 608a266feb64d81c for order TnG_Krv-_uu2L33IhdNQgFOZ74xAKwZmBgFa2hf8_2Y
358
specter-pebble-1  | Pebble 2022/08/10 21:44:54 Issued certificate serial 1a7320f4ed427dc1 for order g9sBG5fa9ZlZWy5Xis-tNGrbZPyzMRFRYlyMVj3Qr_g
359
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /my-order/ -> calling handler()
360
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /my-order/ -> calling handler()
361
specter-seed-1    | 2022-08-10T21:44:54.890Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/my-order/g9sBG5fa9ZlZWy5Xis-tNGrbZPyzMRFRYlyMVj3Qr_g", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["437"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["3wzYP5ES-T-1rgBxatNSKA"]}, "status_code": 200}
362
specter-seed-1    | 2022-08-10T21:44:54.890Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/my-order/TnG_Krv-_uu2L33IhdNQgFOZ74xAKwZmBgFa2hf8_2Y", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["435"],"Content-Type":["application/json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["LRcSLoCg15iZfcdbhOa3-g"]}, "status_code": 200}
363
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /certZ/ -> calling handler()
364
specter-pebble-1  | Pebble 2022/08/10 21:44:54 POST /certZ/ -> calling handler()
365
specter-seed-1    | 2022-08-10T21:44:54.893Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/certZ/1a7320f4ed427dc1", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["2172"],"Content-Type":["application/pem-certificate-chain; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["Gogw6it3p49bnhU_pCe7ow"]}, "status_code": 200}
366
specter-seed-1    | 2022-08-10T21:44:54.893Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/certZ/608a266feb64d81c", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["147"],"Content-Type":["application/problem+json; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:54 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["uic6vxRfu8NqiY2lCWii9g"]}, "status_code": 400}
367
specter-seed-1    | 2022-08-10T21:44:54.894Z    INFO    acme_client     acmez@v1.0.4/client.go:181      successfully downloaded available certificate chains    {"component": "issuer", "count": 1, "first_url": "https://pebble:14000/certZ/1a7320f4ed427dc1"}
368
specter-seed-1    | 2022-08-10T21:44:54.894Z    DEBUG   acme_client     acme/http.go:99 server rejected our nonce; retrying     {"component": "issuer", "detail": "JWS has an invalid anti-replay nonce: LRcSLoCg15iZfcdbhOa3-g", "error": "HTTP 400 urn:ietf:params:acme:error:badNonce - JWS has an invalid anti-replay nonce: LRcSLoCg15iZfcdbhOa3-g"}
369
specter-srvc-1    | 2022-08-10T21:44:54.896Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
370
specter-seed-1    | 2022-08-10T21:44:54.897Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
371
specter-seed-1    | 2022-08-10T21:44:54.897Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "id": 264402947476177}
372
specter-seed-1    | 2022-08-10T21:44:54.897Z    INFO    obtain  certmagic@v0.16.2/config.go:583 certificate obtained successfully       {"component": "acme", "identifier": "*.dev.con.nect.sh"}
373
specter-seed-1    | 2022-08-10T21:44:54.897Z    INFO    obtain  certmagic@v0.16.2/config.go:477 releasing lock  {"component": "acme", "identifier": "*.dev.con.nect.sh"}
374
specter-srvc-1    | 2022-08-10T21:44:54.899Z    DEBUG   chord/local_kv.go:138   KV Release      {"component": "chord", "node": 118605669798269, "lease": "/acme-storage/issue_cert_*.dev.con.nect.sh", "id": 1553179569973}
375
specter-srvc-1    | 2022-08-10T21:44:54.901Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
376
specter-seed-1    | 2022-08-10T21:44:54.902Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "val_length": 227}
377
specter-seed-1    | 2022-08-10T21:44:54.903Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
378
specter-seed-1    | 2022-08-10T21:44:54.903Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "val_length": 2172}
379
specter-seed-1    | 2022-08-10T21:44:54.904Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "id": 264402947476177}
380
specter-seed-1    | 2022-08-10T21:44:54.905Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "val_length": 116}
381
specter-seed-1    | 2022-08-10T21:44:54.905Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/wildcard_.dev.con.nect.sh-5b1526fa", "id": 235326812376913}
382
specter-seed-1    | 2022-08-10T21:44:54.906Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/wildcard_.dev.con.nect.sh-5b1526fa"}
383
specter-seed-1    | 2022-08-10T21:44:54.906Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [*.dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["*.dev.con.nect.sh"]}
384
specter-seed-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
385
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
386
specter-seed-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
387
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
388
specter-seed-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
389
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
390
specter-seed-1    | github.com/caddyserver/certmagic.(*Config).manageOne.func1
391
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:347
392
specter-seed-1    | github.com/caddyserver/certmagic.(*jobManager).worker
393
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/async.go:73
394
specter-pebble-1  | Pebble 2022/08/10 21:44:55 POST /certZ/ -> calling handler()
395
specter-seed-1    | 2022-08-10T21:44:55.147Z    DEBUG   acme_client     acme/http.go:270        http request    {"component": "issuer", "method": "POST", "url": "https://pebble:14000/certZ/608a266feb64d81c", "headers": {"Content-Type":["application/jose+json"],"User-Agent":["CertMagic acmez (linux; amd64)"]}, "response_headers": {"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["2164"],"Content-Type":["application/pem-certificate-chain; charset=utf-8"],"Date":["Wed, 10 Aug 2022 21:44:55 GMT"],"Link":["<https://pebble:14000/dir>;rel=\"index\""],"Replay-Nonce":["WH3RamnYqIi-kl-uH26dVQ"]}, "status_code": 200}
396
specter-seed-1    | 2022-08-10T21:44:55.148Z    INFO    acme_client     acmez@v1.0.4/client.go:181      successfully downloaded available certificate chains    {"component": "issuer", "count": 1, "first_url": "https://pebble:14000/certZ/608a266feb64d81c"}
397
specter-seed-1    | 2022-08-10T21:44:55.150Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
398
specter-srvc-1    | 2022-08-10T21:44:55.152Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
399
specter-seed-1    | 2022-08-10T21:44:55.153Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "id": 272673322735340}
400
specter-seed-1    | 2022-08-10T21:44:55.154Z    INFO    obtain  certmagic@v0.16.2/config.go:583 certificate obtained successfully       {"component": "acme", "identifier": "dev.con.nect.sh"}
401
specter-seed-1    | 2022-08-10T21:44:55.154Z    INFO    obtain  certmagic@v0.16.2/config.go:477 releasing lock  {"component": "acme", "identifier": "dev.con.nect.sh"}
402
specter-seed-1    | 2022-08-10T21:44:55.154Z    DEBUG   chord/local_kv.go:138   KV Release      {"component": "chord", "node": 272898810982308, "lease": "/acme-storage/issue_cert_dev.con.nect.sh", "id": 158622818693899}
403
specter-seed-1    | 2022-08-10T21:44:55.154Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
404
specter-seed-1    | 2022-08-10T21:44:55.155Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "val_length": 227}
405
specter-srvc-1    | 2022-08-10T21:44:55.156Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
406
specter-seed-1    | 2022-08-10T21:44:55.158Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "val_length": 2164}
407
specter-seed-1    | 2022-08-10T21:44:55.159Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "id": 272673322735340}
408
specter-seed-1    | 2022-08-10T21:44:55.159Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "val_length": 114}
409
specter-seed-1    | 2022-08-10T21:44:55.161Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/dev.con.nect.sh-dba4b941", "id": 159017762380566}
410
specter-seed-1    | 2022-08-10T21:44:55.162Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/dev.con.nect.sh-dba4b941"}
411
specter-seed-1    | 2022-08-10T21:44:55.162Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["dev.con.nect.sh"]}
412
specter-seed-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
413
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
414
specter-seed-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
415
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
416
specter-seed-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
417
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
418
specter-seed-1    | github.com/caddyserver/certmagic.(*Config).manageOne.func1
419
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:347
420
specter-seed-1    | github.com/caddyserver/certmagic.(*jobManager).worker
421
specter-seed-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/async.go:73
422
specter-srvb-1    | 2022-08-10T21:44:59.284Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 84671371534117, "attempt": 2, "via": "seed:1113"}
423
specter-srvd-1    | 2022-08-10T21:44:59.285Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 76056495571947, "attempt": 2, "via": "seed:1113"}
424
specter-srva-1    | 2022-08-10T21:44:59.284Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 37795961421988, "attempt": 2, "via": "seed:1113"}
425
specter-srvc-1    | 2022-08-10T21:44:59.289Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 118605669798269, "peer": "id:76056495571947 address:\"srvd:1113\""}
426
specter-srvc-1    | 2022-08-10T21:44:59.289Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 118605669798269, "peer": "id:37795961421988 address:\"srva:1113\""}
427
specter-srvc-1    | 2022-08-10T21:44:59.289Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 118605669798269, "peer": "id:84671371534117 address:\"srvb:1113\""}
428
specter-srva-1    | 2022-08-10T21:44:59.311Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 37795961421988, "direction": "incoming", "key": "srvc:1113/118605669798269"}
429
specter-srva-1    | 2022-08-10T21:44:59.311Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 37795961421988, "direction": "incoming", "key": "srvc:1113/118605669798269"}
430
specter-srvd-1    | 2022-08-10T21:44:59.311Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 76056495571947, "direction": "incoming", "key": "srvc:1113/118605669798269"}
431
specter-srvd-1    | 2022-08-10T21:44:59.311Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 76056495571947, "direction": "incoming", "key": "srvc:1113/118605669798269"}
432
specter-srvb-1    | 2022-08-10T21:44:59.311Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 84671371534117, "direction": "incoming", "key": "srvc:1113/118605669798269"}
433
specter-srvb-1    | 2022-08-10T21:44:59.311Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 84671371534117, "direction": "incoming", "key": "srvc:1113/118605669798269"}
434
specter-srvc-1    | 2022-08-10T21:44:59.311Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 118605669798269, "direction": "outgoing", "key": "srva:1113/37795961421988"}
435
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 118605669798269, "direction": "outgoing", "key": "srva:1113/37795961421988"}
436
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 118605669798269, "direction": "outgoing", "key": "srvd:1113/76056495571947"}
437
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 118605669798269, "direction": "outgoing", "key": "srvd:1113/76056495571947"}
438
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 118605669798269, "direction": "outgoing", "key": "srvb:1113/84671371534117"}
439
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 118605669798269, "direction": "outgoing", "key": "srvb:1113/84671371534117"}
440
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 118605669798269, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:59629"}
441
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:59629", "pov": "transport_dial"}
442
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 118605669798269, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:39301"}
443
specter-srvc-1    | 2022-08-10T21:44:59.312Z    INFO    chord/local_membership.go:106   incoming join request   {"component": "chord", "node": 118605669798269, "joiner": 37795961421988}
444
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 118605669798269, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:1113", "local": "[::]:57845"}
445
specter-srvc-1    | 2022-08-10T21:44:59.312Z    INFO    chord/local_chord.go:220        transferring keys to new predecessor    {"component": "chord", "node": 118605669798269, "predecessor": 37795961421988, "num_keys": 2}
446
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:39301", "pov": "transport_dial"}
447
specter-srvc-1    | 2022-08-10T21:44:59.312Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:1113", "local": "[::]:57845", "pov": "transport_dial"}
448
specter-srvc-1    | 2022-08-10T21:44:59.312Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 118605669798269, "successors": [272898810982308, 118605669798269]}
449
specter-srva-1    | 2022-08-10T21:44:59.313Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 37795961421988, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:59629", "local": "172.22.0.3:1113"}
450
specter-srva-1    | 2022-08-10T21:44:59.313Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:59629", "local": "172.22.0.3:1113", "pov": "local_rpc"}
451
specter-srvd-1    | 2022-08-10T21:44:59.313Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 76056495571947, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:39301", "local": "172.22.0.5:1113"}
452
specter-srvb-1    | 2022-08-10T21:44:59.313Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 84671371534117, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:57845", "local": "172.22.0.4:1113"}
453
specter-srvd-1    | 2022-08-10T21:44:59.313Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:39301", "local": "172.22.0.5:1113", "pov": "local_rpc"}
454
specter-srvb-1    | 2022-08-10T21:44:59.313Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:57845", "local": "172.22.0.4:1113", "pov": "local_rpc"}
455
specter-srva-1    | 2022-08-10T21:44:59.313Z    DEBUG   chord/local_kv.go:154   KV Import       {"component": "chord", "node": 37795961421988, "num_keys": 2}
456
specter-srvc-1    | 2022-08-10T21:44:59.314Z    INFO    chord/local_membership.go:93    rejecting join request because current state is not Active      {"component": "chord", "node": 118605669798269, "joiner": 76056495571947}
457
specter-srvc-1    | 2022-08-10T21:44:59.315Z    INFO    chord/local_membership.go:93    rejecting join request because current state is not Active      {"component": "chord", "node": 118605669798269, "joiner": 84671371534117}
458
specter-srva-1    | 2022-08-10T21:44:59.316Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 37795961421988, "key": "srvc:1113/118605669798269"}
459
specter-srvd-1    | 2022-08-10T21:44:59.316Z    ERROR   chord/local_membership.go:73    error trying to join ring, retrying     {"component": "chord", "node": 76056495571947, "error": "node cannot handle join request at the moment"}
460
specter-srvd-1    | kon.nect.sh/specter/chord.(*LocalNode).executeJoin
461
specter-srvd-1    |     /app/chord/local_membership.go:73
462
specter-srvd-1    | kon.nect.sh/specter/chord.(*LocalNode).Join
463
specter-srvd-1    |     /app/chord/local_membership.go:35
464
specter-srvd-1    | kon.nect.sh/specter/cmd/server.cmdServer
465
specter-srvb-1    | 2022-08-10T21:44:59.316Z    ERROR   chord/local_membership.go:73    error trying to join ring, retrying     {"component": "chord", "node": 84671371534117, "error": "node cannot handle join request at the moment"}
466
specter-srva-1    | 2022-08-10T21:44:59.316Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 37795961421988, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:59629", "local": "172.22.0.3:1113"}
467
specter-srva-1    | 2022-08-10T21:44:59.317Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:59629", "local": "172.22.0.3:1113", "pov": "transport_dial"}
468
specter-srvd-1    |     /app/cmd/server/server.go:365
469
specter-srvb-1    | kon.nect.sh/specter/chord.(*LocalNode).executeJoin
470
specter-srvb-1    |     /app/chord/local_membership.go:73
471
specter-srvb-1    | kon.nect.sh/specter/chord.(*LocalNode).Join
472
specter-srvd-1    | github.com/urfave/cli/v2.(*Command).Run
473
specter-srvb-1    |     /app/chord/local_membership.go:35
474
specter-srvb-1    | kon.nect.sh/specter/cmd/server.cmdServer
475
specter-srvb-1    |     /app/cmd/server/server.go:365
476
specter-srvb-1    | github.com/urfave/cli/v2.(*Command).Run
477
specter-srvb-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
478
specter-srvb-1    | github.com/urfave/cli/v2.(*App).RunContext
479
specter-srvb-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
480
specter-srvb-1    | main.main
481
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
482
specter-srvb-1    |     /app/main.go:66
483
specter-srvb-1    | runtime.main
484
specter-srvb-1    |     /usr/local/go/src/runtime/proc.go:250
485
specter-srvd-1    | github.com/urfave/cli/v2.(*App).RunContext
486
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
487
specter-srvd-1    | main.main
488
specter-srvd-1    |     /app/main.go:66
489
specter-srvd-1    | runtime.main
490
specter-srvd-1    |     /usr/local/go/src/runtime/proc.go:250
491
specter-srva-1    | 2022-08-10T21:44:59.317Z    INFO    chord/local_membership.go:46    Successfully joined Chord ring  {"component": "chord", "node": 37795961421988, "predecessor": 272898810982308, "successor": 118605669798269}
492
specter-srvc-1    | 2022-08-10T21:44:59.317Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 118605669798269, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:59629"}
493
specter-srvc-1    | 2022-08-10T21:44:59.317Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:59629", "pov": "local_rpc"}
494
specter-srva-1    | 2022-08-10T21:44:59.319Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 37795961421988, "peer": "id:37795961421988 address:\"srva:1113\""}
495
specter-srva-1    | 2022-08-10T21:44:59.333Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 37795961421988, "direction": "incoming"}
496
specter-srva-1    | 2022-08-10T21:44:59.333Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 37795961421988, "direction": "incoming", "key": "srva:1113/37795961421988"}
497
specter-srva-1    | 2022-08-10T21:44:59.334Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 37795961421988, "direction": "outgoing"}
498
specter-srva-1    | 2022-08-10T21:44:59.334Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 37795961421988, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:41221"}
499
specter-srva-1    | 2022-08-10T21:44:59.334Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:41221", "pov": "transport_dial"}
500
specter-srva-1    | 2022-08-10T21:44:59.335Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 37795961421988, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:41221", "local": "172.22.0.3:1113"}
501
specter-srva-1    | 2022-08-10T21:44:59.335Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:41221", "local": "172.22.0.3:1113", "pov": "local_rpc"}
502
specter-srva-1    | 2022-08-10T21:44:59.340Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 37795961421988, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48]}
503
specter-seed-1    | 2022-08-10T21:44:59.341Z    INFO    chord/local_membership.go:128   Join completed, joiner has requested to update pointers {"component": "chord", "node": 272898810982308}
504
specter-seed-1    | 2022-08-10T21:44:59.345Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 272898810982308, "successors": [37795961421988, 118605669798269, 272898810982308]}
505
specter-seed-1    | 2022-08-10T21:44:59.348Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 272898810982308, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46]}
506
specter-srvc-1    | 2022-08-10T21:44:59.350Z    INFO    chord/local_membership.go:133   Join completed, joiner has requested to release membership lock {"component": "chord", "node": 118605669798269}
507
specter-seed-1    | 2022-08-10T21:44:59.353Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
508
specter-srva-1    | 2022-08-10T21:44:59.353Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "val_length": 227}
509
specter-srvc-1    | 2022-08-10T21:44:59.354Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 118605669798269, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
510
specter-srva-1    | 2022-08-10T21:44:59.355Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "val_length": 2164}
511
specter-seed-1    | 2022-08-10T21:44:59.357Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "id": 272673322735340}
512
specter-srva-1    | 2022-08-10T21:44:59.358Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "val_length": 114}
513
specter-seed-1    | 2022-08-10T21:44:59.361Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/dev.con.nect.sh-dba4b941", "id": 159017762380566}
514
specter-srva-1    | 2022-08-10T21:44:59.362Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/dev.con.nect.sh-dba4b941"}
515
specter-srva-1    | 2022-08-10T21:44:59.363Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["dev.con.nect.sh"]}
516
specter-srva-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
517
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
518
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
519
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
520
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
521
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
522
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).manageOne
523
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:331
524
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).manageAll
525
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:320
526
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).ManageAsync
527
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:279
528
specter-srva-1    | kon.nect.sh/specter/cmd/server.configCertProvider.func1
529
specter-srva-1    |     /app/cmd/server/server.go:228
530
specter-srva-1    | kon.nect.sh/specter/cmd/server.(*ACMEProvider).Initialize
531
specter-srva-1    |     /app/cmd/server/server.go:393
532
specter-srva-1    | kon.nect.sh/specter/cmd/server.cmdServer
533
specter-srva-1    |     /app/cmd/server/server.go:370
534
specter-srva-1    | github.com/urfave/cli/v2.(*Command).Run
535
specter-srva-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
536
specter-srva-1    | github.com/urfave/cli/v2.(*App).RunContext
537
specter-srva-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
538
specter-srva-1    | main.main
539
specter-srva-1    |     /app/main.go:66
540
specter-srva-1    | runtime.main
541
specter-srva-1    |     /usr/local/go/src/runtime/proc.go:250
542
specter-srva-1    | 2022-08-10T21:44:59.363Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 37795961421988, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
543
specter-srva-1    | 2022-08-10T21:44:59.363Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "val_length": 227}
544
specter-seed-1    | 2022-08-10T21:44:59.365Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
545
specter-srva-1    | 2022-08-10T21:44:59.366Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "val_length": 2172}
546
specter-seed-1    | 2022-08-10T21:44:59.368Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "id": 264402947476177}
547
specter-srva-1    | 2022-08-10T21:44:59.369Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "val_length": 116}
548
specter-seed-1    | 2022-08-10T21:44:59.372Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/wildcard_.dev.con.nect.sh-5b1526fa", "id": 235326812376913}
549
specter-srva-1    | 2022-08-10T21:44:59.373Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/wildcard_.dev.con.nect.sh-5b1526fa"}
550
specter-srva-1    | 2022-08-10T21:44:59.373Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [*.dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["*.dev.con.nect.sh"]}
551
specter-srva-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
552
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
553
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
554
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
555
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
556
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
557
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).manageOne
558
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:331
559
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).manageAll
560
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:320
561
specter-srva-1    | github.com/caddyserver/certmagic.(*Config).ManageAsync
562
specter-srva-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:279
563
specter-srva-1    | kon.nect.sh/specter/cmd/server.configCertProvider.func1
564
specter-srva-1    |     /app/cmd/server/server.go:228
565
specter-srva-1    | kon.nect.sh/specter/cmd/server.(*ACMEProvider).Initialize
566
specter-srva-1    |     /app/cmd/server/server.go:393
567
specter-srva-1    | kon.nect.sh/specter/cmd/server.cmdServer
568
specter-srva-1    |     /app/cmd/server/server.go:370
569
specter-srva-1    | github.com/urfave/cli/v2.(*Command).Run
570
specter-srva-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
571
specter-srva-1    | github.com/urfave/cli/v2.(*App).RunContext
572
specter-srva-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
573
specter-srva-1    | main.main
574
specter-srva-1    |     /app/main.go:66
575
specter-srva-1    | runtime.main
576
specter-srva-1    |     /usr/local/go/src/runtime/proc.go:250
577
specter-srva-1    | 2022-08-10T21:44:59.374Z    INFO    server/server.go:47     publishing identities to chord  {"component": "tun", "node": 62009066160596}
578
specter-srva-1    | 2022-08-10T21:44:59.374Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "tun", "node": 62009066160596, "listen": "172.22.0.3:1113"}
579
specter-srva-1    | 2022-08-10T21:44:59.374Z    INFO    gateway/gateway.go:114  gateway server started  {"component": "gateway"}
580
specter-seed-1    | 2022-08-10T21:44:59.376Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/identities/chord/srva:1113/37795961421988", "id": 199074408259398}
581
specter-srva-1    | 2022-08-10T21:44:59.377Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 37795961421988, "key": "/identities/tunnel/srva:1113/62009066160596", "id": 31061415177225}
582
specter-srva-1    | 2022-08-10T21:44:59.377Z    INFO    server/resolve.go:45    identities published on chord   {"component": "tun", "node": 62009066160596, "chord": "/identities/chord/srva:1113/37795961421988", "tun": "/identities/tunnel/srva:1113/62009066160596"}
583
specter-srva-1    | 2022-08-10T21:44:59.377Z    INFO    server/server.go:52     specter server started  {"component": "tun", "node": 62009066160596}
584
specter-srvb-1    | 2022-08-10T21:45:04.317Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 84671371534117, "attempt": 3, "via": "seed:1113"}
585
specter-srvd-1    | 2022-08-10T21:45:04.317Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 76056495571947, "attempt": 3, "via": "seed:1113"}
586
specter-srvc-1    | 2022-08-10T21:45:04.321Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 118605669798269, "successors": [272898810982308, 37795961421988, 118605669798269]}
587
specter-srvc-1    | 2022-08-10T21:45:04.321Z    INFO    chord/local_membership.go:106   incoming join request   {"component": "chord", "node": 118605669798269, "joiner": 84671371534117}
588
specter-srvc-1    | 2022-08-10T21:45:04.322Z    INFO    chord/local_chord.go:220        transferring keys to new predecessor    {"component": "chord", "node": 118605669798269, "predecessor": 84671371534117, "num_keys": 2}
589
specter-srvb-1    | 2022-08-10T21:45:04.325Z    DEBUG   chord/local_kv.go:154   KV Import       {"component": "chord", "node": 84671371534117, "num_keys": 2}
590
specter-srvb-1    | 2022-08-10T21:45:04.330Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 84671371534117, "peer": "id:37795961421988 address:\"srva:1113\""}
591
specter-srvc-1    | 2022-08-10T21:45:04.332Z    INFO    chord/local_membership.go:93    rejecting join request because current state is not Active      {"component": "chord", "node": 118605669798269, "joiner": 76056495571947}
592
specter-srvd-1    | 2022-08-10T21:45:04.334Z    ERROR   chord/local_membership.go:73    error trying to join ring, retrying     {"component": "chord", "node": 76056495571947, "error": "node cannot handle join request at the moment"}
593
specter-srvd-1    | kon.nect.sh/specter/chord.(*LocalNode).executeJoin
594
specter-srvd-1    |     /app/chord/local_membership.go:73
595
specter-srvd-1    | kon.nect.sh/specter/chord.(*LocalNode).Join
596
specter-srvd-1    |     /app/chord/local_membership.go:35
597
specter-srvd-1    | kon.nect.sh/specter/cmd/server.cmdServer
598
specter-srvd-1    |     /app/cmd/server/server.go:365
599
specter-srvd-1    | github.com/urfave/cli/v2.(*Command).Run
600
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
601
specter-srvd-1    | github.com/urfave/cli/v2.(*App).RunContext
602
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
603
specter-srvd-1    | main.main
604
specter-srvd-1    |     /app/main.go:66
605
specter-srvd-1    | runtime.main
606
specter-srvd-1    |     /usr/local/go/src/runtime/proc.go:250
607
specter-srva-1    | 2022-08-10T21:45:04.346Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 37795961421988, "peer": "id:84671371534117 address:\"srvb:1113\""}
608
specter-srva-1    | 2022-08-10T21:45:04.350Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 37795961421988, "direction": "incoming", "key": "srvb:1113/84671371534117"}
609
specter-srva-1    | 2022-08-10T21:45:04.350Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 37795961421988, "direction": "incoming", "key": "srvb:1113/84671371534117"}
610
specter-srvb-1    | 2022-08-10T21:45:04.350Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 84671371534117, "direction": "outgoing", "key": "srva:1113/37795961421988"}
611
specter-srvb-1    | 2022-08-10T21:45:04.350Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 84671371534117, "direction": "outgoing", "key": "srva:1113/37795961421988"}
612
specter-srvb-1    | 2022-08-10T21:45:04.351Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 84671371534117, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:55060"}
613
specter-srvb-1    | 2022-08-10T21:45:04.351Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:55060", "pov": "transport_dial"}
614
specter-srvb-1    | 2022-08-10T21:45:04.351Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 84671371534117, "key": "srvc:1113/118605669798269"}
615
specter-srvb-1    | 2022-08-10T21:45:04.352Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 84671371534117, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:57845", "local": "172.22.0.4:1113"}
616
specter-srvb-1    | 2022-08-10T21:45:04.352Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:57845", "local": "172.22.0.4:1113", "pov": "transport_dial"}
617
specter-srva-1    | 2022-08-10T21:45:04.352Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 37795961421988, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:55060", "local": "172.22.0.3:1113"}
618
specter-srva-1    | 2022-08-10T21:45:04.352Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:55060", "local": "172.22.0.3:1113", "pov": "local_rpc"}
619
specter-srvb-1    | 2022-08-10T21:45:04.352Z    INFO    chord/local_membership.go:46    Successfully joined Chord ring  {"component": "chord", "node": 84671371534117, "predecessor": 37795961421988, "successor": 118605669798269}
620
specter-srvc-1    | 2022-08-10T21:45:04.353Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 118605669798269, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:1113", "local": "[::]:57845"}
621
specter-srvc-1    | 2022-08-10T21:45:04.353Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:1113", "local": "[::]:57845", "pov": "local_rpc"}
622
specter-srvb-1    | 2022-08-10T21:45:04.354Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 84671371534117, "peer": "id:84671371534117 address:\"srvb:1113\""}
623
specter-srvb-1    | 2022-08-10T21:45:04.360Z    DEBUG   overlay/transport.go:295        reusing quic connection {"component": "chord", "node": 84671371534117, "direction": "incoming", "key": "srva:1113/37795961421988"}
624
specter-srva-1    | 2022-08-10T21:45:04.361Z    DEBUG   overlay/transport.go:295        reusing quic connection {"component": "chord", "node": 37795961421988, "direction": "outgoing", "key": "srvb:1113/84671371534117"}
625
specter-srva-1    | 2022-08-10T21:45:04.362Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 37795961421988, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:55060", "local": "172.22.0.3:1113"}
626
specter-srva-1    | 2022-08-10T21:45:04.362Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:55060", "local": "172.22.0.3:1113", "pov": "transport_dial"}
627
specter-srvb-1    | 2022-08-10T21:45:04.363Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 84671371534117, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:55060"}
628
specter-srvb-1    | 2022-08-10T21:45:04.363Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:55060", "pov": "local_rpc"}
629
specter-srva-1    | 2022-08-10T21:45:04.365Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 37795961421988, "successors": [84671371534117, 118605669798269, 272898810982308, 37795961421988]}
630
specter-srvb-1    | 2022-08-10T21:45:04.368Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 84671371534117, "direction": "incoming"}
631
specter-srvb-1    | 2022-08-10T21:45:04.368Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 84671371534117, "direction": "incoming", "key": "srvb:1113/84671371534117"}
632
specter-srvb-1    | 2022-08-10T21:45:04.368Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 84671371534117, "direction": "outgoing"}
633
specter-srvb-1    | 2022-08-10T21:45:04.369Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 84671371534117, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:1113", "local": "[::]:57442"}
634
specter-srvb-1    | 2022-08-10T21:45:04.369Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:1113", "local": "[::]:57442", "pov": "transport_dial"}
635
specter-srvb-1    | 2022-08-10T21:45:04.369Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 84671371534117, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:57442", "local": "172.22.0.4:1113"}
636
specter-srvb-1    | 2022-08-10T21:45:04.369Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:57442", "local": "172.22.0.4:1113", "pov": "local_rpc"}
637
specter-srvb-1    | 2022-08-10T21:45:04.377Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 84671371534117, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48]}
638
specter-srva-1    | 2022-08-10T21:45:04.379Z    INFO    chord/local_membership.go:128   Join completed, joiner has requested to update pointers {"component": "chord", "node": 37795961421988}
639
specter-srva-1    | 2022-08-10T21:45:04.386Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 37795961421988, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46]}
640
specter-srvc-1    | 2022-08-10T21:45:04.388Z    INFO    chord/local_membership.go:133   Join completed, joiner has requested to release membership lock {"component": "chord", "node": 118605669798269}
641
specter-seed-1    | 2022-08-10T21:45:04.391Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
642
specter-srvb-1    | 2022-08-10T21:45:04.392Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "val_length": 227}
643
specter-srvb-1    | 2022-08-10T21:45:04.392Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 84671371534117, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
644
specter-srvb-1    | 2022-08-10T21:45:04.392Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "val_length": 2164}
645
specter-seed-1    | 2022-08-10T21:45:04.395Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "id": 272673322735340}
646
specter-srvb-1    | 2022-08-10T21:45:04.396Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "val_length": 114}
647
specter-seed-1    | 2022-08-10T21:45:04.399Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/dev.con.nect.sh-dba4b941", "id": 159017762380566}
648
specter-srvb-1    | 2022-08-10T21:45:04.400Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/dev.con.nect.sh-dba4b941"}
649
specter-srvb-1    | 2022-08-10T21:45:04.401Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["dev.con.nect.sh"]}
650
specter-srvb-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
651
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
652
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
653
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
654
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
655
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
656
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).manageOne
657
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:331
658
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).manageAll
659
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:320
660
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).ManageAsync
661
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:279
662
specter-srvb-1    | kon.nect.sh/specter/cmd/server.configCertProvider.func1
663
specter-srvb-1    |     /app/cmd/server/server.go:228
664
specter-srvb-1    | kon.nect.sh/specter/cmd/server.(*ACMEProvider).Initialize
665
specter-srvb-1    |     /app/cmd/server/server.go:393
666
specter-srvb-1    | kon.nect.sh/specter/cmd/server.cmdServer
667
specter-srvb-1    |     /app/cmd/server/server.go:370
668
specter-srvb-1    | github.com/urfave/cli/v2.(*Command).Run
669
specter-srvb-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
670
specter-srvb-1    | github.com/urfave/cli/v2.(*App).RunContext
671
specter-srvb-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
672
specter-srvb-1    | main.main
673
specter-srvb-1    |     /app/main.go:66
674
specter-srvb-1    | runtime.main
675
specter-srvb-1    |     /usr/local/go/src/runtime/proc.go:250
676
specter-srva-1    | 2022-08-10T21:45:04.404Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 37795961421988, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
677
specter-srvb-1    | 2022-08-10T21:45:04.404Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "val_length": 227}
678
specter-seed-1    | 2022-08-10T21:45:04.407Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
679
specter-srvb-1    | 2022-08-10T21:45:04.407Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "val_length": 2172}
680
specter-seed-1    | 2022-08-10T21:45:04.410Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "id": 264402947476177}
681
specter-srvb-1    | 2022-08-10T21:45:04.410Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "val_length": 116}
682
specter-seed-1    | 2022-08-10T21:45:04.414Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/wildcard_.dev.con.nect.sh-5b1526fa", "id": 235326812376913}
683
specter-srvb-1    | 2022-08-10T21:45:04.414Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/wildcard_.dev.con.nect.sh-5b1526fa"}
684
specter-srvb-1    | 2022-08-10T21:45:04.415Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [*.dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["*.dev.con.nect.sh"]}
685
specter-srvb-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
686
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
687
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
688
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
689
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
690
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
691
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).manageOne
692
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:331
693
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).manageAll
694
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:320
695
specter-srvb-1    | github.com/caddyserver/certmagic.(*Config).ManageAsync
696
specter-srvb-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:279
697
specter-srvb-1    | kon.nect.sh/specter/cmd/server.configCertProvider.func1
698
specter-srvb-1    |     /app/cmd/server/server.go:228
699
specter-srvb-1    | kon.nect.sh/specter/cmd/server.(*ACMEProvider).Initialize
700
specter-srvb-1    |     /app/cmd/server/server.go:393
701
specter-srvb-1    | kon.nect.sh/specter/cmd/server.cmdServer
702
specter-srvb-1    |     /app/cmd/server/server.go:370
703
specter-srvb-1    | github.com/urfave/cli/v2.(*Command).Run
704
specter-srvb-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
705
specter-srvb-1    | github.com/urfave/cli/v2.(*App).RunContext
706
specter-srvb-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
707
specter-srvb-1    | main.main
708
specter-srvb-1    |     /app/main.go:66
709
specter-srvb-1    | runtime.main
710
specter-srvb-1    |     /usr/local/go/src/runtime/proc.go:250
711
specter-srvb-1    | 2022-08-10T21:45:04.415Z    INFO    server/server.go:47     publishing identities to chord  {"component": "tun", "node": 263818634048197}
712
specter-srvb-1    | 2022-08-10T21:45:04.415Z    INFO    gateway/gateway.go:114  gateway server started  {"component": "gateway"}
713
specter-srvb-1    | 2022-08-10T21:45:04.415Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "tun", "node": 263818634048197, "listen": "172.22.0.4:1113"}
714
specter-seed-1    | 2022-08-10T21:45:04.419Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/identities/chord/srvb:1113/84671371534117", "id": 223804790890153}
715
specter-srvb-1    | 2022-08-10T21:45:04.419Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 84671371534117, "key": "/identities/tunnel/srvb:1113/263818634048197", "id": 53649091253522}
716
specter-srvb-1    | 2022-08-10T21:45:04.420Z    INFO    server/resolve.go:45    identities published on chord   {"component": "tun", "node": 263818634048197, "chord": "/identities/chord/srvb:1113/84671371534117", "tun": "/identities/tunnel/srvb:1113/263818634048197"}
717
specter-srvb-1    | 2022-08-10T21:45:04.420Z    INFO    server/server.go:52     specter server started  {"component": "tun", "node": 263818634048197}
718
specter-seed-1    | 2022-08-10T21:45:06.253Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 272898810982308, "fixed": [47]}
719
specter-seed-1    | 2022-08-10T21:45:09.262Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 272898810982308, "successors": [37795961421988, 84671371534117, 118605669798269, 272898810982308]}
720
specter-srvc-1    | 2022-08-10T21:45:09.331Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 118605669798269, "successors": [272898810982308, 37795961421988, 84671371534117, 118605669798269]}
721
specter-srvd-1    | 2022-08-10T21:45:09.338Z    INFO    chord/local_membership.go:64    Joining Chord ring      {"component": "chord", "node": 76056495571947, "attempt": 4, "via": "seed:1113"}
722
specter-srvb-1    | 2022-08-10T21:45:09.343Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 84671371534117, "peer": "id:76056495571947 address:\"srvd:1113\""}
723
specter-srvd-1    | 2022-08-10T21:45:09.357Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 76056495571947, "direction": "incoming", "key": "srvb:1113/84671371534117"}
724
specter-srvd-1    | 2022-08-10T21:45:09.357Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 76056495571947, "direction": "incoming", "key": "srvb:1113/84671371534117"}
725
specter-srvb-1    | 2022-08-10T21:45:09.357Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 84671371534117, "direction": "outgoing", "key": "srvd:1113/76056495571947"}
726
specter-srvb-1    | 2022-08-10T21:45:09.358Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 84671371534117, "direction": "outgoing", "key": "srvd:1113/76056495571947"}
727
specter-srvb-1    | 2022-08-10T21:45:09.358Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 84671371534117, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:60950"}
728
specter-srvb-1    | 2022-08-10T21:45:09.358Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:60950", "pov": "transport_dial"}
729
specter-srvb-1    | 2022-08-10T21:45:09.358Z    INFO    chord/local_membership.go:106   incoming join request   {"component": "chord", "node": 84671371534117, "joiner": 76056495571947}
730
specter-srvb-1    | 2022-08-10T21:45:09.358Z    INFO    chord/local_chord.go:220        transferring keys to new predecessor    {"component": "chord", "node": 84671371534117, "predecessor": 76056495571947, "num_keys": 2}
731
specter-srvd-1    | 2022-08-10T21:45:09.359Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 76056495571947, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:60950", "local": "172.22.0.5:1113"}
732
specter-srvd-1    | 2022-08-10T21:45:09.359Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:60950", "local": "172.22.0.5:1113", "pov": "local_rpc"}
733
specter-srvd-1    | 2022-08-10T21:45:09.360Z    DEBUG   chord/local_kv.go:154   KV Import       {"component": "chord", "node": 76056495571947, "num_keys": 2}
734
specter-srvd-1    | 2022-08-10T21:45:09.362Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 76056495571947, "peer": "id:37795961421988 address:\"srva:1113\""}
735
specter-srva-1    | 2022-08-10T21:45:09.369Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 37795961421988, "peer": "id:76056495571947 address:\"srvd:1113\""}
736
specter-srva-1    | 2022-08-10T21:45:09.378Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 37795961421988, "direction": "incoming", "key": "srvd:1113/76056495571947"}
737
specter-srvd-1    | 2022-08-10T21:45:09.379Z    DEBUG   overlay/transport.go:299        saving quic connection for reuse        {"component": "chord", "node": 76056495571947, "direction": "outgoing", "key": "srva:1113/37795961421988"}
738
specter-srvd-1    | 2022-08-10T21:45:09.379Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 76056495571947, "direction": "outgoing", "key": "srva:1113/37795961421988"}
739
specter-srva-1    | 2022-08-10T21:45:09.379Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 37795961421988, "direction": "incoming", "key": "srvd:1113/76056495571947"}
740
specter-srvd-1    | 2022-08-10T21:45:09.380Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 76056495571947, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:46805"}
741
specter-srvd-1    | 2022-08-10T21:45:09.380Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:46805", "pov": "transport_dial"}
742
specter-srvd-1    | 2022-08-10T21:45:09.380Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 76056495571947, "key": "srvb:1113/84671371534117"}
743
specter-srvd-1    | 2022-08-10T21:45:09.380Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 76056495571947, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:60950", "local": "172.22.0.5:1113"}
744
specter-srvd-1    | 2022-08-10T21:45:09.380Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:84671371534117 address:\"srvb:1113\"", "remote": "172.22.0.4:60950", "local": "172.22.0.5:1113", "pov": "transport_dial"}
745
specter-srva-1    | 2022-08-10T21:45:09.380Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 37795961421988, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:46805", "local": "172.22.0.3:1113"}
746
specter-srva-1    | 2022-08-10T21:45:09.381Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:46805", "local": "172.22.0.3:1113", "pov": "local_rpc"}
747
specter-srvd-1    | 2022-08-10T21:45:09.381Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 76056495571947, "key": "srvc:1113/118605669798269"}
748
specter-srvd-1    | 2022-08-10T21:45:09.381Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 76056495571947, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:39301", "local": "172.22.0.5:1113"}
749
specter-srvd-1    | 2022-08-10T21:45:09.381Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:118605669798269 address:\"srvc:1113\"", "remote": "172.22.0.6:39301", "local": "172.22.0.5:1113", "pov": "transport_dial"}
750
specter-srvd-1    | 2022-08-10T21:45:09.381Z    INFO    chord/local_membership.go:46    Successfully joined Chord ring  {"component": "chord", "node": 76056495571947, "predecessor": 37795961421988, "successor": 84671371534117}
751
specter-srvb-1    | 2022-08-10T21:45:09.381Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 84671371534117, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:60950"}
752
specter-srvb-1    | 2022-08-10T21:45:09.382Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 84671371534117, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:60950", "pov": "local_rpc"}
753
specter-srvc-1    | 2022-08-10T21:45:09.382Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 118605669798269, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:39301"}
754
specter-srvc-1    | 2022-08-10T21:45:09.382Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 118605669798269, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:39301", "pov": "local_rpc"}
755
specter-srvd-1    | 2022-08-10T21:45:09.383Z    DEBUG   overlay/transport.go:83 Creating new QUIC connection    {"component": "chord", "node": 76056495571947, "peer": "id:76056495571947 address:\"srvd:1113\""}
756
specter-srvd-1    | 2022-08-10T21:45:09.385Z    DEBUG   overlay/transport.go:295        reusing quic connection {"component": "chord", "node": 76056495571947, "direction": "incoming", "key": "srva:1113/37795961421988"}
757
specter-srva-1    | 2022-08-10T21:45:09.386Z    ERROR   chord/remote.go:207     creating new RemoteNode {"component": "chord", "node": 37795961421988, "peer": "id:76056495571947 address:\"srvd:1113\"", "error": "dialing stream: creating quic connection: reading RPC message buffer size: Application error 0x0: A previous connection was reused"}
758
specter-srva-1    | kon.nect.sh/specter/chord.(*RemoteNode).GetPredecessor
759
specter-srva-1    |     /app/chord/remote.go:207
760
specter-srva-1    | kon.nect.sh/specter/chord.(*LocalNode).stabilize
761
specter-srva-1    |     /app/chord/local_tasks.go:69
762
specter-srva-1    | kon.nect.sh/specter/chord.(*LocalNode).periodicStablize
763
specter-srva-1    |     /app/chord/local_tasks.go:171
764
specter-srvb-1    | 2022-08-10T21:45:09.388Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 84671371534117, "successors": [118605669798269, 272898810982308, 37795961421988, 84671371534117]}
765
specter-srva-1    | 2022-08-10T21:45:09.388Z    DEBUG   chord/local_tasks.go:84 Skipping over successor {"component": "chord", "node": 37795961421988, "head": 84671371534117, "succ": [84671371534117, 118605669798269, 272898810982308, 37795961421988]}
766
specter-srvd-1    | 2022-08-10T21:45:09.397Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 76056495571947, "direction": "incoming"}
767
specter-srvd-1    | 2022-08-10T21:45:09.397Z    DEBUG   overlay/transport.go:361        Starting goroutines to handle streams and datagrams     {"component": "chord", "node": 76056495571947, "direction": "incoming", "key": "srvd:1113/76056495571947"}
768
specter-srvd-1    | 2022-08-10T21:45:09.397Z    DEBUG   overlay/transport.go:274        connecting to ourself, skipping connection reuse        {"component": "chord", "node": 76056495571947, "direction": "outgoing"}
769
specter-srvd-1    | 2022-08-10T21:45:09.398Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 76056495571947, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:58010"}
770
specter-srvd-1    | 2022-08-10T21:45:09.398Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:1113", "local": "[::]:58010", "pov": "transport_dial"}
771
specter-srvd-1    | 2022-08-10T21:45:09.399Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 76056495571947, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:58010", "local": "172.22.0.5:1113"}
772
specter-srvd-1    | 2022-08-10T21:45:09.399Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:58010", "local": "172.22.0.5:1113", "pov": "local_rpc"}
773
specter-srvd-1    | 2022-08-10T21:45:09.408Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 76056495571947, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48]}
774
specter-srva-1    | 2022-08-10T21:45:09.409Z    INFO    chord/local_membership.go:128   Join completed, joiner has requested to update pointers {"component": "chord", "node": 37795961421988}
775
specter-srva-1    | 2022-08-10T21:45:09.410Z    DEBUG   overlay/transport.go:74 Reusing quic connection from reuseMap   {"component": "chord", "node": 37795961421988, "key": "srvd:1113/76056495571947"}
776
specter-srva-1    | 2022-08-10T21:45:09.411Z    DEBUG   overlay/transport.go:177        Created new RPC Stream  {"component": "chord", "node": 37795961421988, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:46805", "local": "172.22.0.3:1113"}
777
specter-srva-1    | 2022-08-10T21:45:09.411Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 37795961421988, "peer": "id:76056495571947 address:\"srvd:1113\"", "remote": "172.22.0.5:46805", "local": "172.22.0.3:1113", "pov": "transport_dial"}
778
specter-srvd-1    | 2022-08-10T21:45:09.411Z    DEBUG   chord/local_rpc.go:26   New incoming RPC Stream {"component": "chord", "node": 76056495571947, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:46805"}
779
specter-srvd-1    | 2022-08-10T21:45:09.411Z    DEBUG   rpc/rpc.go:65   Creating new RPC handler        {"component": "chord", "node": 76056495571947, "peer": "id:37795961421988 address:\"srva:1113\"", "remote": "172.22.0.3:1113", "local": "[::]:46805", "pov": "local_rpc"}
780
specter-srva-1    | 2022-08-10T21:45:09.413Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 37795961421988, "successors": [76056495571947, 84671371534117, 118605669798269, 272898810982308]}
781
specter-srva-1    | 2022-08-10T21:45:09.419Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 37795961421988, "fixed": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46]}
782
specter-srvb-1    | 2022-08-10T21:45:09.421Z    INFO    chord/local_membership.go:133   Join completed, joiner has requested to release membership lock {"component": "chord", "node": 84671371534117}
783
specter-seed-1    | 2022-08-10T21:45:09.423Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
784
specter-srvd-1    | 2022-08-10T21:45:09.424Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "val_length": 227}
785
specter-srvd-1    | 2022-08-10T21:45:09.424Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 76056495571947, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
786
specter-srvd-1    | 2022-08-10T21:45:09.424Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "val_length": 2164}
787
specter-seed-1    | 2022-08-10T21:45:09.426Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "id": 272673322735340}
788
specter-srvd-1    | 2022-08-10T21:45:09.427Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "val_length": 114}
789
specter-seed-1    | 2022-08-10T21:45:09.430Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/dev.con.nect.sh-dba4b941", "id": 159017762380566}
790
specter-srvd-1    | 2022-08-10T21:45:09.431Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/dev.con.nect.sh-dba4b941"}
791
specter-srvd-1    | 2022-08-10T21:45:09.431Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["dev.con.nect.sh"]}
792
specter-srvd-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
793
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
794
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
795
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
796
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
797
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
798
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).manageOne
799
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:331
800
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).manageAll
801
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:320
802
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).ManageAsync
803
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:279
804
specter-srvd-1    | kon.nect.sh/specter/cmd/server.configCertProvider.func1
805
specter-srvd-1    |     /app/cmd/server/server.go:228
806
specter-srvd-1    | kon.nect.sh/specter/cmd/server.(*ACMEProvider).Initialize
807
specter-srvd-1    |     /app/cmd/server/server.go:393
808
specter-srvd-1    | kon.nect.sh/specter/cmd/server.cmdServer
809
specter-srvd-1    |     /app/cmd/server/server.go:370
810
specter-srvd-1    | github.com/urfave/cli/v2.(*Command).Run
811
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
812
specter-srvd-1    | github.com/urfave/cli/v2.(*App).RunContext
813
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
814
specter-srvd-1    | main.main
815
specter-srvd-1    |     /app/main.go:66
816
specter-srvd-1    | runtime.main
817
specter-srvd-1    |     /usr/local/go/src/runtime/proc.go:250
818
specter-srva-1    | 2022-08-10T21:45:09.434Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 37795961421988, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
819
specter-srvd-1    | 2022-08-10T21:45:09.434Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "val_length": 227}
820
specter-seed-1    | 2022-08-10T21:45:09.436Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
821
specter-srvd-1    | 2022-08-10T21:45:09.437Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "val_length": 2172}
822
specter-seed-1    | 2022-08-10T21:45:09.439Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "id": 264402947476177}
823
specter-srvd-1    | 2022-08-10T21:45:09.440Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "val_length": 116}
824
specter-seed-1    | 2022-08-10T21:45:09.443Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/wildcard_.dev.con.nect.sh-5b1526fa", "id": 235326812376913}
825
specter-srvd-1    | 2022-08-10T21:45:09.444Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/wildcard_.dev.con.nect.sh-5b1526fa"}
826
specter-srvd-1    | 2022-08-10T21:45:09.444Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [*.dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["*.dev.con.nect.sh"]}
827
specter-srvd-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
828
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
829
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
830
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
831
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
832
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
833
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).manageOne
834
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:331
835
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).manageAll
836
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:320
837
specter-srvd-1    | github.com/caddyserver/certmagic.(*Config).ManageAsync
838
specter-srvd-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:279
839
specter-srvd-1    | kon.nect.sh/specter/cmd/server.configCertProvider.func1
840
specter-srvd-1    |     /app/cmd/server/server.go:228
841
specter-srvd-1    | kon.nect.sh/specter/cmd/server.(*ACMEProvider).Initialize
842
specter-srvd-1    |     /app/cmd/server/server.go:393
843
specter-srvd-1    | kon.nect.sh/specter/cmd/server.cmdServer
844
specter-srvd-1    |     /app/cmd/server/server.go:370
845
specter-srvd-1    | github.com/urfave/cli/v2.(*Command).Run
846
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/command.go:169
847
specter-srvd-1    | github.com/urfave/cli/v2.(*App).RunContext
848
specter-srvd-1    |     /go/pkg/mod/github.com/urfave/cli/v2@v2.11.1/app.go:378
849
specter-srvd-1    | main.main
850
specter-srvd-1    |     /app/main.go:66
851
specter-srvd-1    | runtime.main
852
specter-srvd-1    |     /usr/local/go/src/runtime/proc.go:250
853
specter-srvd-1    | 2022-08-10T21:45:09.445Z    INFO    server/server.go:47     publishing identities to chord  {"component": "tun", "node": 220377913337845}
854
specter-srvd-1    | 2022-08-10T21:45:09.445Z    INFO    overlay/transport.go:374        Accepting connections   {"component": "tun", "node": 220377913337845, "listen": "172.22.0.5:1113"}
855
specter-srvd-1    | 2022-08-10T21:45:09.445Z    INFO    gateway/gateway.go:114  gateway server started  {"component": "gateway"}
856
specter-seed-1    | 2022-08-10T21:45:09.447Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/identities/chord/srvd:1113/76056495571947", "id": 204256089064141}
857
specter-seed-1    | 2022-08-10T21:45:09.449Z    DEBUG   chord/local_kv.go:54    KV Put  {"component": "chord", "node": 272898810982308, "key": "/identities/tunnel/srvd:1113/220377913337845", "id": 217967739459279}
858
specter-srvd-1    | 2022-08-10T21:45:09.450Z    INFO    server/resolve.go:45    identities published on chord   {"component": "tun", "node": 220377913337845, "chord": "/identities/chord/srvd:1113/76056495571947", "tun": "/identities/tunnel/srvd:1113/220377913337845"}
859
specter-srvd-1    | 2022-08-10T21:45:09.450Z    INFO    server/server.go:52     specter server started  {"component": "tun", "node": 220377913337845}
860
specter-seed-1    | 2022-08-10T21:45:12.259Z    INFO    chord/local_tasks.go:140        FingerTable entries updated     {"component": "chord", "node": 272898810982308, "fixed": [47]}
861
specter-seed-1    | 2022-08-10T21:45:14.271Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 272898810982308, "successors": [37795961421988, 76056495571947, 84671371534117, 118605669798269]}
862
specter-srvc-1    | 2022-08-10T21:45:14.341Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 118605669798269, "successors": [272898810982308, 37795961421988, 76056495571947, 84671371534117]}
863
specter-srvb-1    | 2022-08-10T21:45:14.396Z    INFO    chord/local_tasks.go:95 Discovered new successors via Stablize  {"component": "chord", "node": 84671371534117, "successors": [118605669798269, 272898810982308, 37795961421988, 76056495571947]}
864
specter-srva-1    | 2022-08-10T21:45:24.341Z    DEBUG   chord/local_kv.go:118   KV Acquire      {"component": "chord", "node": 37795961421988, "lease": "/acme-storage/issue_cert_*.dev.con.nect.sh", "id": 1553179569973}
865
specter-srvc-1    | 2022-08-10T21:45:24.343Z    DEBUG   storage/chord.go:62     Lease acquired  {"component": "storage", "key": "issue_cert_*.dev.con.nect.sh", "lease": 1660167984341888156}
866
specter-srvc-1    | 2022-08-10T21:45:24.343Z    INFO    obtain  certmagic@v0.16.2/config.go:489 lock acquired   {"component": "acme", "identifier": "*.dev.con.nect.sh"}
867
specter-seed-1    | 2022-08-10T21:45:24.343Z    DEBUG   chord/local_kv.go:118   KV Acquire      {"component": "chord", "node": 272898810982308, "lease": "/acme-storage/issue_cert_dev.con.nect.sh", "id": 158622818693899}
868
specter-srvc-1    | 2022-08-10T21:45:24.344Z    DEBUG   storage/chord.go:62     Lease acquired  {"component": "storage", "key": "issue_cert_dev.con.nect.sh", "lease": 1660167984343630359}
869
specter-srvc-1    | 2022-08-10T21:45:24.345Z    INFO    obtain  certmagic@v0.16.2/config.go:489 lock acquired   {"component": "acme", "identifier": "dev.con.nect.sh"}
870
specter-seed-1    | 2022-08-10T21:45:24.345Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
871
specter-srvc-1    | 2022-08-10T21:45:24.346Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "exists": true}
872
specter-srva-1    | 2022-08-10T21:45:24.349Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 37795961421988, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
873
specter-srvc-1    | 2022-08-10T21:45:24.350Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "exists": true}
874
specter-srvd-1    | 2022-08-10T21:45:24.351Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 76056495571947, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
875
specter-seed-1    | 2022-08-10T21:45:24.352Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "id": 264402947476177}
876
specter-srvc-1    | 2022-08-10T21:45:24.352Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "exists": true}
877
specter-srvc-1    | 2022-08-10T21:45:24.352Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "exists": true}
878
specter-srvc-1    | 2022-08-10T21:45:24.353Z    INFO    obtain  certmagic@v0.16.2/config.go:496 certificate already exists in storage   {"component": "acme", "identifier": "*.dev.con.nect.sh"}
879
specter-srvc-1    | 2022-08-10T21:45:24.353Z    INFO    obtain  certmagic@v0.16.2/config.go:477 releasing lock  {"component": "acme", "identifier": "*.dev.con.nect.sh"}
880
specter-seed-1    | 2022-08-10T21:45:24.353Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
881
specter-srvc-1    | 2022-08-10T21:45:24.355Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "exists": true}
882
specter-srva-1    | 2022-08-10T21:45:24.356Z    DEBUG   chord/local_kv.go:138   KV Release      {"component": "chord", "node": 37795961421988, "lease": "/acme-storage/issue_cert_*.dev.con.nect.sh", "id": 1553179569973}
883
specter-seed-1    | 2022-08-10T21:45:24.356Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "id": 272673322735340}
884
specter-srvc-1    | 2022-08-10T21:45:24.357Z    DEBUG   storage/chord.go:152    Exists  {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "exists": true}
885
specter-srvc-1    | 2022-08-10T21:45:24.357Z    INFO    obtain  certmagic@v0.16.2/config.go:496 certificate already exists in storage   {"component": "acme", "identifier": "dev.con.nect.sh"}
886
specter-srvc-1    | 2022-08-10T21:45:24.357Z    INFO    obtain  certmagic@v0.16.2/config.go:477 releasing lock  {"component": "acme", "identifier": "dev.con.nect.sh"}
887
specter-seed-1    | 2022-08-10T21:45:24.358Z    DEBUG   chord/local_kv.go:138   KV Release      {"component": "chord", "node": 272898810982308, "lease": "/acme-storage/issue_cert_dev.con.nect.sh", "id": 158622818693899}
888
specter-seed-1    | 2022-08-10T21:45:24.359Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "id": 179364425046919}
889
specter-srva-1    | 2022-08-10T21:45:24.360Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 37795961421988, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "id": 37624296909630}
890
specter-srvc-1    | 2022-08-10T21:45:24.360Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.key", "val_length": 227}
891
specter-srvc-1    | 2022-08-10T21:45:24.361Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.key", "val_length": 227}
892
specter-seed-1    | 2022-08-10T21:45:24.361Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "id": 169844222509893}
893
specter-srvc-1    | 2022-08-10T21:45:24.362Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.crt", "val_length": 2172}
894
specter-seed-1    | 2022-08-10T21:45:24.363Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "id": 264402947476177}
895
specter-srvd-1    | 2022-08-10T21:45:24.364Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 76056495571947, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "id": 53321444973030}
896
specter-srvc-1    | 2022-08-10T21:45:24.364Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/wildcard_.dev.con.nect.sh/wildcard_.dev.con.nect.sh.json", "val_length": 116}
897
specter-srvc-1    | 2022-08-10T21:45:24.365Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.crt", "val_length": 2164}
898
specter-seed-1    | 2022-08-10T21:45:24.366Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "id": 272673322735340}
899
specter-seed-1    | 2022-08-10T21:45:24.366Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/wildcard_.dev.con.nect.sh-5b1526fa", "id": 235326812376913}
900
specter-srvc-1    | 2022-08-10T21:45:24.366Z    DEBUG   storage/chord.go:131    Load returned something {"component": "storage", "key": "certificates/pebble-14000-dir/dev.con.nect.sh/dev.con.nect.sh.json", "val_length": 114}
901
specter-srvc-1    | 2022-08-10T21:45:24.367Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/wildcard_.dev.con.nect.sh-5b1526fa"}
902
specter-srvc-1    | 2022-08-10T21:45:24.368Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [*.dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["*.dev.con.nect.sh"]}
903
specter-srvc-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
904
specter-seed-1    | 2022-08-10T21:45:24.368Z    DEBUG   chord/local_kv.go:65    KV Get  {"component": "chord", "node": 272898810982308, "key": "/acme-storage/ocsp/dev.con.nect.sh-dba4b941", "id": 159017762380566}
905
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
906
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
907
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
908
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
909
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
910
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).manageOne.func1
911
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:347
912
specter-srvc-1    | github.com/caddyserver/certmagic.(*jobManager).worker
913
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/async.go:73
914
specter-srvc-1    | 2022-08-10T21:45:24.368Z    DEBUG   storage/chord.go:128    Load returned not found {"component": "storage", "key": "ocsp/dev.con.nect.sh-dba4b941"}
915
specter-srvc-1    | 2022-08-10T21:45:24.369Z    WARN    certmagic@v0.16.2/certificates.go:222   stapling OCSP   {"component": "acme", "error": "no OCSP stapling for [dev.con.nect.sh]: no OCSP server specified in certificate", "identifiers": ["dev.con.nect.sh"]}
916
specter-srvc-1    | github.com/caddyserver/certmagic.Config.makeCertificateWithOCSP
917
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:222
918
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).loadManagedCertificate
919
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:137
920
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).CacheManagedCertificate
921
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/certificates.go:120
922
specter-srvc-1    | github.com/caddyserver/certmagic.(*Config).manageOne.func1
923
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/config.go:347
924
specter-srvc-1    | github.com/caddyserver/certmagic.(*jobManager).worker
925
specter-srvc-1    |     /go/pkg/mod/github.com/caddyserver/certmagic@v0.16.2/async.go:73
926
specter-seed-1    | 2022-08-10T21:45:46.273Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:170      choosing certificate    {"component": "acme", "identifier": "dev.con.nect.sh", "num_choices": 1}
927
specter-seed-1    | 2022-08-10T21:45:46.273Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:177      default certificate selection results   {"component": "acme", "identifier": "dev.con.nect.sh", "subjects": ["dev.con.nect.sh"], "managed": true, "issuer_key": "pebble:14000-dir", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
928
specter-seed-1    | 2022-08-10T21:45:46.273Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:246      matched certificate in cache    {"component": "acme", "subjects": ["dev.con.nect.sh"], "managed": true, "expiration": "2027-08-10T21:44:54.000Z", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
929
specter-seed-1    | 2022-08-10T21:45:46.276Z    DEBUG   gateway/gateway.go:204  forwarding apex connection      {"component": "gateway", "via-quic": false, "proto": "", "hostname": "dev.con.nect.sh"}
930
specter-srva-1    | 2022-08-10T21:45:46.279Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:170      choosing certificate    {"component": "acme", "identifier": "dev.con.nect.sh", "num_choices": 1}
931
specter-srva-1    | 2022-08-10T21:45:46.279Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:177      default certificate selection results   {"component": "acme", "identifier": "dev.con.nect.sh", "subjects": ["dev.con.nect.sh"], "managed": true, "issuer_key": "pebble:14000-dir", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
932
specter-srva-1    | 2022-08-10T21:45:46.279Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:246      matched certificate in cache    {"component": "acme", "subjects": ["dev.con.nect.sh"], "managed": true, "expiration": "2027-08-10T21:44:54.000Z", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
933
specter-srva-1    | 2022-08-10T21:45:46.281Z    DEBUG   gateway/gateway.go:204  forwarding apex connection      {"component": "gateway", "via-quic": false, "proto": "", "hostname": "dev.con.nect.sh"}
934
specter-srvb-1    | 2022-08-10T21:45:46.285Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:170      choosing certificate    {"component": "acme", "identifier": "dev.con.nect.sh", "num_choices": 1}
935
specter-srvb-1    | 2022-08-10T21:45:46.285Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:177      default certificate selection results   {"component": "acme", "identifier": "dev.con.nect.sh", "subjects": ["dev.con.nect.sh"], "managed": true, "issuer_key": "pebble:14000-dir", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
936
specter-srvb-1    | 2022-08-10T21:45:46.286Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:246      matched certificate in cache    {"component": "acme", "subjects": ["dev.con.nect.sh"], "managed": true, "expiration": "2027-08-10T21:44:54.000Z", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
937
specter-srvb-1    | 2022-08-10T21:45:46.289Z    DEBUG   gateway/gateway.go:204  forwarding apex connection      {"component": "gateway", "via-quic": false, "proto": "", "hostname": "dev.con.nect.sh"}
938
specter-srvc-1    | 2022-08-10T21:45:46.293Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:170      choosing certificate    {"component": "acme", "identifier": "dev.con.nect.sh", "num_choices": 1}
939
specter-srvc-1    | 2022-08-10T21:45:46.293Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:177      default certificate selection results   {"component": "acme", "identifier": "dev.con.nect.sh", "subjects": ["dev.con.nect.sh"], "managed": true, "issuer_key": "pebble:14000-dir", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
940
specter-srvc-1    | 2022-08-10T21:45:46.293Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:246      matched certificate in cache    {"component": "acme", "subjects": ["dev.con.nect.sh"], "managed": true, "expiration": "2027-08-10T21:44:54.000Z", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
941
specter-srvc-1    | 2022-08-10T21:45:46.295Z    DEBUG   gateway/gateway.go:204  forwarding apex connection      {"component": "gateway", "via-quic": false, "proto": "", "hostname": "dev.con.nect.sh"}
942
specter-srvd-1    | 2022-08-10T21:45:46.298Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:170      choosing certificate    {"component": "acme", "identifier": "dev.con.nect.sh", "num_choices": 1}
943
specter-srvd-1    | 2022-08-10T21:45:46.299Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:177      default certificate selection results   {"component": "acme", "identifier": "dev.con.nect.sh", "subjects": ["dev.con.nect.sh"], "managed": true, "issuer_key": "pebble:14000-dir", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
944
specter-srvd-1    | 2022-08-10T21:45:46.299Z    DEBUG   handshake       certmagic@v0.16.2/handshake.go:246      matched certificate in cache    {"component": "acme", "subjects": ["dev.con.nect.sh"], "managed": true, "expiration": "2027-08-10T21:44:54.000Z", "hash": "f22c171626df87089536371a4215bee92d01527061481dcf67c4a9a2c2252d68"}
945
specter-srvd-1    | 2022-08-10T21:45:46.300Z    DEBUG   gateway/gateway.go:204  forwarding apex connection      {"component": "gateway", "via-quic": false, "proto": "", "hostname": "dev.con.nect.sh"}