-
Notifications
You must be signed in to change notification settings - Fork 5
/
Copy path1.5.0-DEV-86ee57cdd7.log
320 lines (305 loc) · 20.8 KB
/
1.5.0-DEV-86ee57cdd7.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
Julia Version 1.5.0-DEV.689
Commit 86ee57cdd7 (2020-04-25 20:17 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
CPU: Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-9.0.1 (ORCJIT, skylake)
Environment:
JULIA_DEPOT_PATH = ::/usr/local/share/julia
JULIA_NUM_THREADS = 2
Resolving package versions...
Installed CpuId ────────────────────── v0.2.2
Installed BenchmarkCI ──────────────── v0.1.2
Installed Parsers ──────────────────── v1.0.2
Installed MacroTools ───────────────── v0.5.5
Installed TerminalLoggers ──────────── v0.1.1
Installed AbstractTrees ────────────── v0.3.3
Installed PkgBenchmark ─────────────── v0.2.8
Installed JSON ─────────────────────── v0.21.0
Installed Setfield ─────────────────── v0.6.0
Installed ProgressLogging ──────────── v0.1.2
Installed ConstructionBase ─────────── v1.0.0
Installed LeftChildRightSiblingTrees ─ v0.1.2
Installed Requires ─────────────────── v1.0.1
Installed BenchmarkTools ───────────── v0.5.0
Updating `~/.julia/environments/v1.5/Project.toml`
[20533458] + BenchmarkCI v0.1.2
Updating `~/.julia/environments/v1.5/Manifest.toml`
[1520ce14] + AbstractTrees v0.3.3
[20533458] + BenchmarkCI v0.1.2
[6e4b80f9] + BenchmarkTools v0.5.0
[187b0558] + ConstructionBase v1.0.0
[adafc99b] + CpuId v0.2.2
[682c06a0] + JSON v0.21.0
[1d6d02ad] + LeftChildRightSiblingTrees v0.1.2
[1914dd2f] + MacroTools v0.5.5
[69de0a69] + Parsers v1.0.2
[32113eaa] + PkgBenchmark v0.2.8
[33c8b6b6] + ProgressLogging v0.1.2
[ae029012] + Requires v1.0.1
[efcf1570] + Setfield v0.6.0
[5d786b92] + TerminalLoggers v0.1.1
[2a0f44e3] + Base64
[ade2ca70] + Dates
[8ba89e20] + Distributed
[9fa8497b] + Future
[b77e0a4c] + InteractiveUtils
[76f85450] + LibGit2
[8f399da3] + Libdl
[37e2e46d] + LinearAlgebra
[56ddb016] + Logging
[d6f4376e] + Markdown
[a63ad114] + Mmap
[44cfe95a] + Pkg
[de0858da] + Printf
[3fa0cd96] + REPL
[9a3f8284] + Random
[ea8e919c] + SHA
[9e88b42a] + Serialization
[6462fe0b] + Sockets
[2f01184e] + SparseArrays
[10745b16] + Statistics
[8dfed614] + Test
[cf7118a7] + UUIDs
[4ec0a83e] + Unicode
Building PkgBenchmark → `~/.julia/packages/PkgBenchmark/dU6Mj/deps/build.log`
Testing BenchmarkCI
Status `/tmp/jl_pyqDB4/Project.toml`
[20533458] BenchmarkCI v0.1.2
[adafc99b] CpuId v0.2.2
[682c06a0] JSON v0.21.0
[32113eaa] PkgBenchmark v0.2.8
[efcf1570] Setfield v0.6.0
[37e2e46d] LinearAlgebra
[56ddb016] Logging
[d6f4376e] Markdown
[8dfed614] Test
Status `/tmp/jl_pyqDB4/Manifest.toml`
[1520ce14] AbstractTrees v0.3.3
[20533458] BenchmarkCI v0.1.2
[6e4b80f9] BenchmarkTools v0.5.0
[187b0558] ConstructionBase v1.0.0
[adafc99b] CpuId v0.2.2
[682c06a0] JSON v0.21.0
[1d6d02ad] LeftChildRightSiblingTrees v0.1.2
[1914dd2f] MacroTools v0.5.5
[69de0a69] Parsers v1.0.2
[32113eaa] PkgBenchmark v0.2.8
[33c8b6b6] ProgressLogging v0.1.2
[ae029012] Requires v1.0.1
[efcf1570] Setfield v0.6.0
[5d786b92] TerminalLoggers v0.1.1
[2a0f44e3] Base64
[ade2ca70] Dates
[8ba89e20] Distributed
[9fa8497b] Future
[b77e0a4c] InteractiveUtils
[76f85450] LibGit2
[8f399da3] Libdl
[37e2e46d] LinearAlgebra
[56ddb016] Logging
[d6f4376e] Markdown
[a63ad114] Mmap
[44cfe95a] Pkg
[de0858da] Printf
[3fa0cd96] REPL
[9a3f8284] Random
[ea8e919c] SHA
[9e88b42a] Serialization
[6462fe0b] Sockets
[2f01184e] SparseArrays
[10745b16] Statistics
[8dfed614] Test
[cf7118a7] UUIDs
[4ec0a83e] Unicode
Cloning into 'BenchmarkCIExample.jl'...
[ Info: Testing with target = testcase/0000-with-manifest
Note: checking out 'testcase/0000-with-manifest'.
You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.
If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:
git checkout -b <new-branch-name>
HEAD is now at 4f8cbb1 Add benchmark/{Project,Manifest}.toml
[ Info: Using existing manifest file.
PkgBenchmark: Running benchmarks...
testcase/0000-with-manifest: Error During Test at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:34
Got exception outside of a @test
TypeError: non-boolean (Nothing) used in boolean context
Stacktrace:
[1] _runbenchmark(::String, ::String, ::PkgBenchmark.BenchmarkConfig, ::String; retune::Bool, custom_loadpath::String, runoptions::NamedTuple{(:verbose,),Tuple{Bool}}, logger_factory::Type{T} where T) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/runbenchmark.jl:209
[2] (::PkgBenchmark.var"#21#23"{Bool,Bool,DataType,String,String})(::String) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/runbenchmark.jl:108
[3] _withtemp(::PkgBenchmark.var"#21#23"{Bool,Bool,DataType,String,String}, ::String) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/util.jl:2
[4] (::PkgBenchmark.var"#do_benchmark#22"{Nothing,Bool,Bool,DataType,String,String,String,Bool})() at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/runbenchmark.jl:106
[5] benchmarkpkg(::String, ::PkgBenchmark.BenchmarkConfig; script::String, postprocess::Nothing, resultfile::String, retune::Bool, verbose::Bool, logger_factory::Type{T} where T, progressoptions::Nothing, custom_loadpath::String) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/runbenchmark.jl:138
[6] macro expansion at ./timing.jl:233 [inlined]
[7] (::BenchmarkCI.var"#14#15"{PkgBenchmark.BenchmarkConfig,PkgBenchmark.BenchmarkConfig,String,String,NamedTuple{(:logger_factory, :script),Tuple{DataType,String}}})() at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:178
[8] noisily(::BenchmarkCI.var"#14#15"{PkgBenchmark.BenchmarkConfig,PkgBenchmark.BenchmarkConfig,String,String,NamedTuple{(:logger_factory, :script),Tuple{DataType,String}}}, ::Bool; interval::Int64) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:166
[9] noisily at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:159 [inlined] (repeats 2 times)
[10] #_judge#13 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:177 [inlined]
[11] (::BenchmarkCI.var"#8#9"{String,String,String,DataType,String})(::String, ::Bool) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:145
[12] maybe_with_merged_project(::BenchmarkCI.var"#8#9"{String,String,String,DataType,String}, ::String, ::String) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:66
[13] judge(::Nothing, ::String; workspace::String, pkgdir::String, script::String, project::String, logger_factory::Type{T} where T) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:143
[14] judge(::Nothing, ::String) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:131
[15] #judge#6 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:119 [inlined]
[16] judge at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:119 [inlined]
[17] runall(; kwargs::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:340
[18] runall at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:340 [inlined]
[19] #3 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:38 [inlined]
[20] withenv(::var"#3#9", ::Pair{String,String}, ::Vararg{Pair{String,B} where B,N} where N) at ./env.jl:161
[21] macro expansion at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:37 [inlined]
[22] macro expansion at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Test/src/Test.jl:1114 [inlined]
[23] (::var"#runtests#8"{var"#flushall#4",var"#printlns#5"{var"#flushall#4"}})(::String) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:35
[24] (::var"#2#7"{String,var"#flushall#4",var"#printlns#5"{var"#flushall#4"}})() at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:44
[25] cd(::var"#2#7"{String,var"#flushall#4",var"#printlns#5"{var"#flushall#4"}}, ::String) at ./file.jl:104
[26] #1 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:24 [inlined]
[27] mktempdir(::var"#1#6"{var"#flushall#4",var"#printlns#5"{var"#flushall#4"}}, ::String; prefix::String) at ./file.jl:682
[28] top-level scope at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:23
[29] top-level scope at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Test/src/Test.jl:1114
[30] top-level scope at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:7
[31] include(::String) at ./client.jl:457
[32] top-level scope at none:6
[33] eval(::Module, ::Any) at ./boot.jl:331
[34] exec_options(::Base.JLOptions) at ./client.jl:272
[35] _start() at ./client.jl:506
[ Info: Testing with target = testcase/0001-without-manifest
Previous HEAD position was 4f8cbb1 Add benchmark/{Project,Manifest}.toml
HEAD is now at 5e619c2 Use BenchmarkCI without benchmark/Manifest.toml
Removing .benchmarkci/
Path `/tmp/BenchmarkCI_jl_test_Y1oekw/BenchmarkCIExample.jl` exists and looks like the correct package. Using existing path.
Resolving package versions...
Cloning default registries into `~/.julia`
#=#=# ###################### 31.8%#################################################################### 94.6%######################################################################## 100.0%
Added registry `General` to `~/.julia/registries/General`
Updating `/tmp/BenchmarkCI_jl_8Sc8bv/Project.toml`
[d70a8896] + BenchmarkCIExample v0.1.0 `/tmp/BenchmarkCI_jl_test_Y1oekw/BenchmarkCIExample.jl`
[6e4b80f9] + BenchmarkTools v0.5.0
[32113eaa] + PkgBenchmark v0.2.8
Updating `/tmp/BenchmarkCI_jl_8Sc8bv/Manifest.toml`
[1520ce14] + AbstractTrees v0.3.3
[d70a8896] + BenchmarkCIExample v0.1.0 `/tmp/BenchmarkCI_jl_test_Y1oekw/BenchmarkCIExample.jl`
[6e4b80f9] + BenchmarkTools v0.5.0
[682c06a0] + JSON v0.21.0
[1d6d02ad] + LeftChildRightSiblingTrees v0.1.2
[69de0a69] + Parsers v1.0.2
[32113eaa] + PkgBenchmark v0.2.8
[33c8b6b6] + ProgressLogging v0.1.2
[5d786b92] + TerminalLoggers v0.1.1
[2a0f44e3] + Base64
[ade2ca70] + Dates
[8ba89e20] + Distributed
[b77e0a4c] + InteractiveUtils
[76f85450] + LibGit2
[8f399da3] + Libdl
[37e2e46d] + LinearAlgebra
[56ddb016] + Logging
[d6f4376e] + Markdown
[a63ad114] + Mmap
[44cfe95a] + Pkg
[de0858da] + Printf
[3fa0cd96] + REPL
[9a3f8284] + Random
[ea8e919c] + SHA
[9e88b42a] + Serialization
[6462fe0b] + Sockets
[2f01184e] + SparseArrays
[10745b16] + Statistics
[8dfed614] + Test
[cf7118a7] + UUIDs
[4ec0a83e] + Unicode
[ Info: Using temporary project `/tmp/BenchmarkCI_jl_8Sc8bv`.
PkgBenchmark: Running benchmarks...
testcase/0001-without-manifest: Error During Test at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:34
Got exception outside of a @test
TypeError: non-boolean (Nothing) used in boolean context
Stacktrace:
[1] _runbenchmark(::String, ::String, ::PkgBenchmark.BenchmarkConfig, ::String; retune::Bool, custom_loadpath::String, runoptions::NamedTuple{(:verbose,),Tuple{Bool}}, logger_factory::Type{T} where T) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/runbenchmark.jl:209
[2] (::PkgBenchmark.var"#21#23"{Bool,Bool,DataType,String,String})(::String) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/runbenchmark.jl:108
[3] _withtemp(::PkgBenchmark.var"#21#23"{Bool,Bool,DataType,String,String}, ::String) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/util.jl:2
[4] (::PkgBenchmark.var"#do_benchmark#22"{Nothing,Bool,Bool,DataType,String,String,String,Bool})() at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/runbenchmark.jl:106
[5] benchmarkpkg(::String, ::PkgBenchmark.BenchmarkConfig; script::String, postprocess::Nothing, resultfile::String, retune::Bool, verbose::Bool, logger_factory::Type{T} where T, progressoptions::Nothing, custom_loadpath::String) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/runbenchmark.jl:138
[6] macro expansion at ./timing.jl:233 [inlined]
[7] (::BenchmarkCI.var"#14#15"{PkgBenchmark.BenchmarkConfig,PkgBenchmark.BenchmarkConfig,String,String,NamedTuple{(:logger_factory, :script),Tuple{DataType,String}}})() at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:178
[8] noisily(::BenchmarkCI.var"#14#15"{PkgBenchmark.BenchmarkConfig,PkgBenchmark.BenchmarkConfig,String,String,NamedTuple{(:logger_factory, :script),Tuple{DataType,String}}}, ::Bool; interval::Int64) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:166
[9] noisily at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:159 [inlined] (repeats 2 times)
[10] #_judge#13 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:177 [inlined]
[11] (::BenchmarkCI.var"#8#9"{String,String,String,DataType,String})(::String, ::Bool) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:145
[12] (::BenchmarkCI.var"#4#5"{BenchmarkCI.var"#8#9"{String,String,String,DataType,String},String})(::String) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:90
[13] mktempdir(::BenchmarkCI.var"#4#5"{BenchmarkCI.var"#8#9"{String,String,String,DataType,String},String}, ::String; prefix::String) at ./file.jl:682
[14] maybe_with_merged_project(::BenchmarkCI.var"#8#9"{String,String,String,DataType,String}, ::String, ::String) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:78
[15] judge(::Nothing, ::String; workspace::String, pkgdir::String, script::String, project::String, logger_factory::Type{T} where T) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:143
[16] judge(::Nothing, ::String) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:131
[17] #judge#6 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:119 [inlined]
[18] judge at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:119 [inlined]
[19] runall(; kwargs::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:340
[20] runall at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:340 [inlined]
[21] #3 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:38 [inlined]
[22] withenv(::var"#3#9", ::Pair{String,String}, ::Vararg{Pair{String,B} where B,N} where N) at ./env.jl:161
[23] macro expansion at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:37 [inlined]
[24] macro expansion at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Test/src/Test.jl:1114 [inlined]
[25] (::var"#runtests#8"{var"#flushall#4",var"#printlns#5"{var"#flushall#4"}})(::String) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:35
[26] (::var"#2#7"{String,var"#flushall#4",var"#printlns#5"{var"#flushall#4"}})() at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:45
[27] cd(::var"#2#7"{String,var"#flushall#4",var"#printlns#5"{var"#flushall#4"}}, ::String) at ./file.jl:104
[28] #1 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:24 [inlined]
[29] mktempdir(::var"#1#6"{var"#flushall#4",var"#printlns#5"{var"#flushall#4"}}, ::String; prefix::String) at ./file.jl:682
[30] top-level scope at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:23
[31] top-level scope at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Test/src/Test.jl:1114
[32] top-level scope at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:7
[33] include(::String) at ./client.jl:457
[34] top-level scope at none:6
[35] eval(::Module, ::Any) at ./boot.jl:331
[36] exec_options(::Base.JLOptions) at ./client.jl:272
[37] _start() at ./client.jl:506
BenchmarkCI.jl: Error During Test at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:6
Got exception outside of a @test
SystemError: opening file ".benchmarkci/result-target.json": No such file or directory
Stacktrace:
[1] systemerror(::String, ::Int32; extrainfo::Nothing) at ./error.jl:168
[2] #systemerror#50 at ./error.jl:167 [inlined]
[3] systemerror at ./error.jl:167 [inlined]
[4] open(::String; lock::Bool, read::Nothing, write::Nothing, create::Nothing, truncate::Nothing, append::Nothing) at ./iostream.jl:284
[5] open at ./iostream.jl:273 [inlined]
[6] open(::JSON.Parser.var"#4#5"{DataType,DataType,Nothing,Bool,Bool,Int64}, ::String; kwargs::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}) at ./io.jl:296
[7] open at ./io.jl:296 [inlined]
[8] #parsefile#3 at /home/pkgeval/.julia/packages/JSON/d89fA/src/Parser.jl:522 [inlined]
[9] parsefile at /home/pkgeval/.julia/packages/JSON/d89fA/src/Parser.jl:521 [inlined]
[10] readresults(::String) at /home/pkgeval/.julia/packages/PkgBenchmark/dU6Mj/src/benchmarkresults.jl:75
[11] _loadjudge(::String) at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:206
[12] _loadciresult at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/src/BenchmarkCI.jl:212 [inlined] (repeats 2 times)
[13] (::var"#2#7"{String,var"#flushall#4",var"#printlns#5"{var"#flushall#4"}})() at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:57
[14] cd(::var"#2#7"{String,var"#flushall#4",var"#printlns#5"{var"#flushall#4"}}, ::String) at ./file.jl:104
[15] #1 at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:24 [inlined]
[16] mktempdir(::var"#1#6"{var"#flushall#4",var"#printlns#5"{var"#flushall#4"}}, ::String; prefix::String) at ./file.jl:682
[17] top-level scope at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:23
[18] top-level scope at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Test/src/Test.jl:1114
[19] top-level scope at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:7
[20] include(::String) at ./client.jl:457
[21] top-level scope at none:6
[22] eval(::Module, ::Any) at ./boot.jl:331
[23] exec_options(::Base.JLOptions) at ./client.jl:272
[24] _start() at ./client.jl:506
Test Summary: | Pass Error Total
BenchmarkCI.jl | 4 3 7
testcase/0000-with-manifest | 1 1
testcase/0001-without-manifest | 1 1
ERROR: LoadError: Some tests did not pass: 4 passed, 0 failed, 3 errored, 0 broken.
in expression starting at /home/pkgeval/.julia/packages/BenchmarkCI/XOLVZ/test/runtests.jl:6
ERROR: Package BenchmarkCI errored during testing
Stacktrace:
[1] pkgerror(::String, ::Vararg{String,N} where N) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/Types.jl:52
[2] test(::Pkg.Types.Context, ::Array{Pkg.Types.PackageSpec,1}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/Operations.jl:1515
[3] test(::Pkg.Types.Context, ::Array{Pkg.Types.PackageSpec,1}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, kwargs::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:316
[4] test(::Pkg.Types.Context, ::Array{Pkg.Types.PackageSpec,1}) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:303
[5] #test#68 at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:297 [inlined]
[6] test at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:297 [inlined]
[7] #test#67 at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:296 [inlined]
[8] test at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:296 [inlined]
[9] test(::String; kwargs::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:295
[10] test(::String) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:295
[11] top-level scope at none:16