PTC and ITC formulation #77

sallyrobson · 2023-02-28T19:02:54Z

Creating the PTC and ITC Modification types and writing example policies to test.

sallyrobson · 2023-02-28T19:06:22Z

create/test method for getting PTC and ITC values from table instead of directly inputted to config

github-actions · 2023-03-01T19:13:22Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmarks:
- Target: 1 Mar 2023 - 19:11
- Baseline: 1 Mar 2023 - 19:13
Package commits:
- Target: 3c4b02
- Baseline: 1d3c66
Julia commits:
- Target: 17cfb8
- Baseline: 17cfb8
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["get_generator"]`	1.16 (5%) ❌	1.00 (1%)
`["load_data"]`	0.00 (5%) ✅	0.01 (1%) ✅
`["setup_model"]`	0.27 (5%) ✅	0.81 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       2706 s          0 s        176 s        911 s          0 s
       #2  2793 MHz       1430 s          0 s        146 s       2189 s          0 s
  Memory: 6.781215667724609 GB (4119.16796875 MB free)
  Uptime: 384.36 sec
  Load Avg:  1.06  1.03  0.54
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       2770 s          0 s        179 s       1868 s          0 s
       #2  2793 MHz       2373 s          0 s        170 s       2251 s          0 s
  Memory: 6.781215667724609 GB (4514.33984375 MB free)
  Uptime: 487.25 sec
  Load Avg:  1.01  1.02  0.59
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 1 Mar 2023 - 19:11
Package commit: 3c4b02
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	94.376 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	58.341 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	99.286 ns (5%)		48 bytes (1%)	3
`["load_data"]`	30.161 ms (5%)		8.85 MiB (1%)	312677
`["setup_model"]`	2.450 s (5%)	900.291 ms	1.87 GiB (1%)	17694921

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       2706 s          0 s        176 s        911 s          0 s
       #2  2793 MHz       1430 s          0 s        146 s       2189 s          0 s
  Memory: 6.781215667724609 GB (4119.16796875 MB free)
  Uptime: 384.36 sec
  Load Avg:  1.06  1.03  0.54
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 1 Mar 2023 - 19:13
Package commit: 1d3c66
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	91.400 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	50.461 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	101.663 ns (5%)		48 bytes (1%)	3
`["load_data"]`	26.437 s (5%)	486.385 ms	1.55 GiB (1%)	30346814
`["setup_model"]`	9.136 s (5%)	1.067 s	2.31 GiB (1%)	26194924

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       2770 s          0 s        179 s       1868 s          0 s
       #2  2793 MHz       2373 s          0 s        170 s       2251 s          0 s
  Memory: 6.781215667724609 GB (4514.33984375 MB free)
  Uptime: 487.25 sec
  Load Avg:  1.01  1.02  0.59
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads	1
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Address sizes:                   46 bits physical, 48 bits virtual
Byte Order:                      Little Endian
CPU(s):                          2
On-line CPU(s) list:             0,1
Vendor ID:                       GenuineIntel
Model name:                      Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family:                      6
Model:                           106
Thread(s) per core:              1
Core(s) per socket:              2
Socket(s):                       1
Stepping:                        6
BogoMIPS:                        5586.87
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor:               Microsoft
Virtualization type:             full
L1d cache:                       96 KiB (2 instances)
L1i cache:                       64 KiB (2 instances)
L2 cache:                        2.5 MiB (2 instances)
L3 cache:                        48 MiB (1 instance)
NUMA node(s):                    1
NUMA node0 CPU(s):               0,1
Vulnerability Itlb multihit:     KVM: Mitigation: VMX unsupported
Vulnerability L1tf:              Mitigation; PTE Inversion
Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Mmio stale data:   Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed:          Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor	:Intel
Architecture	:UnknownIntel
Model	Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (48, 1280, 49152) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

codecov · 2023-03-01T19:22:13Z

Codecov Report

Patch coverage: 100.00% and project coverage change: +0.55 🎉

Comparison is base (1d3c667) 84.09% compared to head (fb1e943) 84.65%.

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #77      +/-   ##
==========================================
+ Coverage   84.09%   84.65%   +0.55%     
==========================================
  Files          17       19       +2     
  Lines        1622     1668      +46     
==========================================
+ Hits         1364     1412      +48     
+ Misses        258      256       -2

Impacted Files	Coverage Δ
src/E4ST.jl	`86.30% <ø> (ø)`
src/model/dcopf.jl	`90.09% <ø> (+1.80%)`	⬆️
src/types/Unit.jl	`100.00% <ø> (ø)`
src/io/data.jl	`88.30% <100.00%> (+0.35%)`	⬆️
src/io/util.jl	`76.88% <100.00%> (+0.55%)`	⬆️
src/types/policies/ITC.jl	`100.00% <100.00%> (ø)`
src/types/policies/PTC.jl	`100.00% <100.00%> (ø)`

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

sallyrobson · 2023-03-01T19:44:11Z

@Ethan-Russell If you want to take a look at this it is in a pretty good place. I still need to add in loading the policy values from a CSV but if you have any comments on the current code please let me know.

github-actions · 2023-03-01T22:37:15Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmarks:
- Target: 1 Mar 2023 - 22:35
- Baseline: 1 Mar 2023 - 22:37
Package commits:
- Target: 5f815f
- Baseline: 1d3c66
Julia commits:
- Target: 17cfb8
- Baseline: 17cfb8
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["load_data"]`	0.00 (5%) ✅	0.01 (1%) ✅
`["setup_model"]`	0.27 (5%) ✅	0.81 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       2432 s          0 s        164 s       2474 s          0 s
       #2  2793 MHz       1656 s          0 s        160 s       3236 s          0 s
  Memory: 6.781219482421875 GB (4114.70703125 MB free)
  Uptime: 513.23 sec
  Load Avg:  1.05  0.98  0.51
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       2482 s          0 s        169 s       3431 s          0 s
       #2  2793 MHz       2598 s          0 s        183 s       3285 s          0 s
  Memory: 6.781219482421875 GB (4466.9375 MB free)
  Uptime: 614.77 sec
  Load Avg:  1.01  0.99  0.57
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 1 Mar 2023 - 22:35
Package commit: 5f815f
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	89.857 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	50.513 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	105.747 ns (5%)		48 bytes (1%)	3
`["load_data"]`	29.622 ms (5%)		8.85 MiB (1%)	312677
`["setup_model"]`	2.402 s (5%)	879.892 ms	1.87 GiB (1%)	17694921

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       2432 s          0 s        164 s       2474 s          0 s
       #2  2793 MHz       1656 s          0 s        160 s       3236 s          0 s
  Memory: 6.781219482421875 GB (4114.70703125 MB free)
  Uptime: 513.23 sec
  Load Avg:  1.05  0.98  0.51
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 1 Mar 2023 - 22:37
Package commit: 1d3c66
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	92.945 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	50.205 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	100.978 ns (5%)		48 bytes (1%)	3
`["load_data"]`	25.984 s (5%)	412.412 ms	1.55 GiB (1%)	30346743
`["setup_model"]`	9.021 s (5%)	1.067 s	2.31 GiB (1%)	26195582

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       2482 s          0 s        169 s       3431 s          0 s
       #2  2793 MHz       2598 s          0 s        183 s       3285 s          0 s
  Memory: 6.781219482421875 GB (4466.9375 MB free)
  Uptime: 614.77 sec
  Load Avg:  1.01  0.99  0.57
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads	1
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Address sizes:                   46 bits physical, 48 bits virtual
Byte Order:                      Little Endian
CPU(s):                          2
On-line CPU(s) list:             0,1
Vendor ID:                       GenuineIntel
Model name:                      Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family:                      6
Model:                           106
Thread(s) per core:              1
Core(s) per socket:              2
Socket(s):                       1
Stepping:                        6
BogoMIPS:                        5586.87
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor:               Microsoft
Virtualization type:             full
L1d cache:                       96 KiB (2 instances)
L1i cache:                       64 KiB (2 instances)
L2 cache:                        2.5 MiB (2 instances)
L3 cache:                        48 MiB (1 instance)
NUMA node(s):                    1
NUMA node0 CPU(s):               0,1
Vulnerability Itlb multihit:     KVM: Mitigation: VMX unsupported
Vulnerability L1tf:              Mitigation; PTE Inversion
Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Mmio stale data:   Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed:          Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor	:Intel
Architecture	:UnknownIntel
Model	Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (48, 1280, 49152) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

Ethan-Russell

Overall looking pretty good! A couple small things, and we can talk over in our next rewrite meeting.

Edit: Another thing I thought of.

I'm wondering if we might want to make a subfolder within types so we would have:

types

policies
- PTC.jl
- ITC.jl
modifications
Modification.jl
Policy.jl
...

src/io/data.jl

src/types/Policy.jl

test/testpoltypes.jl

src/io/data.jl

test/testpoltypes.jl

github-actions · 2023-03-03T16:53:55Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmarks:
- Target: 3 Mar 2023 - 16:52
- Baseline: 3 Mar 2023 - 16:53
Package commits:
- Target: 4a47ea
- Baseline: 1d3c66
Julia commits:
- Target: 17cfb8
- Baseline: 17cfb8
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["load_data"]`	0.00 (5%) ✅	0.01 (1%) ✅
`["setup_model"]`	0.29 (5%) ✅	0.81 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz       2491 s          0 s        206 s       4489 s          0 s
       #2  2593 MHz       1738 s          0 s        179 s       5251 s          0 s
  Memory: 6.781219482421875 GB (4035.12890625 MB free)
  Uptime: 724.84 sec
  Load Avg:  1.04  0.9  0.49
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512)
  Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz       2538 s          0 s        212 s       5484 s          0 s
       #2  2593 MHz       2711 s          0 s        212 s       5298 s          0 s
  Memory: 6.781219482421875 GB (4520.2421875 MB free)
  Uptime: 830.1 sec
  Load Avg:  1.0  0.93  0.55
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512)
  Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 3 Mar 2023 - 16:52
Package commit: 4a47ea
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	102.879 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	60.537 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	103.301 ns (5%)		48 bytes (1%)	3
`["load_data"]`	32.395 ms (5%)		8.97 MiB (1%)	315198
`["setup_model"]`	2.852 s (5%)	1.076 s	1.87 GiB (1%)	17699921

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz       2491 s          0 s        206 s       4489 s          0 s
       #2  2593 MHz       1738 s          0 s        179 s       5251 s          0 s
  Memory: 6.781219482421875 GB (4035.12890625 MB free)
  Uptime: 724.84 sec
  Load Avg:  1.04  0.9  0.49
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512)
  Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 3 Mar 2023 - 16:53
Package commit: 1d3c66
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	100.112 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	57.851 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	106.093 ns (5%)		48 bytes (1%)	3
`["load_data"]`	27.379 s (5%)	561.442 ms	1.55 GiB (1%)	30343498
`["setup_model"]`	9.708 s (5%)	1.286 s	2.31 GiB (1%)	26194325

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz       2538 s          0 s        212 s       5484 s          0 s
       #2  2593 MHz       2711 s          0 s        212 s       5298 s          0 s
  Memory: 6.781219482421875 GB (4520.2421875 MB free)
  Uptime: 830.1 sec
  Load Avg:  1.0  0.93  0.55
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512)
  Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads	1
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Address sizes:                   46 bits physical, 48 bits virtual
Byte Order:                      Little Endian
CPU(s):                          2
On-line CPU(s) list:             0,1
Vendor ID:                       GenuineIntel
Model name:                      Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
CPU family:                      6
Model:                           85
Thread(s) per core:              1
Core(s) per socket:              2
Socket(s):                       1
Stepping:                        7
BogoMIPS:                        5187.80
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor:               Microsoft
Virtualization type:             full
L1d cache:                       64 KiB (2 instances)
L1i cache:                       64 KiB (2 instances)
L2 cache:                        2 MiB (2 instances)
L3 cache:                        35.8 MiB (1 instance)
NUMA node(s):                    1
NUMA node0 CPU(s):               0,1
Vulnerability Itlb multihit:     KVM: Mitigation: VMX unsupported
Vulnerability L1tf:              Mitigation; PTE Inversion
Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Mmio stale data:   Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed:          Vulnerable
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

github-actions · 2023-03-03T18:34:06Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmarks:
- Target: 3 Mar 2023 - 18:32
- Baseline: 3 Mar 2023 - 18:33
Package commits:
- Target: 361c18
- Baseline: 1d3c66
Julia commits:
- Target: 17cfb8
- Baseline: 17cfb8
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["get_af"]`	1.09 (5%) ❌	1.00 (1%)
`["load_data"]`	0.00 (5%) ✅	0.01 (1%) ✅
`["setup_model"]`	0.27 (5%) ✅	0.81 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       1042 s          0 s        128 s       3685 s          0 s
       #2  2793 MHz       2897 s          0 s        187 s       1764 s          0 s
  Memory: 6.781219482421875 GB (4026.32421875 MB free)
  Uptime: 491.69 sec
  Load Avg:  1.07  1.0  0.52
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       1087 s          0 s        133 s       4602 s          0 s
       #2  2793 MHz       3803 s          0 s        209 s       1807 s          0 s
  Memory: 6.781219482421875 GB (4499.2578125 MB free)
  Uptime: 588.77 sec
  Load Avg:  1.05  1.01  0.58
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 3 Mar 2023 - 18:32
Package commit: 361c18
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	98.365 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	50.510 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	93.430 ns (5%)		48 bytes (1%)	3
`["load_data"]`	29.334 ms (5%)		8.97 MiB (1%)	315198
`["setup_model"]`	2.359 s (5%)	857.073 ms	1.87 GiB (1%)	17699921

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       1042 s          0 s        128 s       3685 s          0 s
       #2  2793 MHz       2897 s          0 s        187 s       1764 s          0 s
  Memory: 6.781219482421875 GB (4026.32421875 MB free)
  Uptime: 491.69 sec
  Load Avg:  1.07  1.0  0.52
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 3 Mar 2023 - 18:33
Package commit: 1d3c66
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	90.086 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	48.672 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	93.430 ns (5%)		48 bytes (1%)	3
`["load_data"]`	25.490 s (5%)	487.330 ms	1.55 GiB (1%)	30281552
`["setup_model"]`	8.727 s (5%)	1.001 s	2.31 GiB (1%)	26180519

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       1087 s          0 s        133 s       4602 s          0 s
       #2  2793 MHz       3803 s          0 s        209 s       1807 s          0 s
  Memory: 6.781219482421875 GB (4499.2578125 MB free)
  Uptime: 588.77 sec
  Load Avg:  1.05  1.01  0.58
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads	1
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Address sizes:                   46 bits physical, 48 bits virtual
Byte Order:                      Little Endian
CPU(s):                          2
On-line CPU(s) list:             0,1
Vendor ID:                       GenuineIntel
Model name:                      Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family:                      6
Model:                           106
Thread(s) per core:              1
Core(s) per socket:              2
Socket(s):                       1
Stepping:                        6
BogoMIPS:                        5586.87
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor:               Microsoft
Virtualization type:             full
L1d cache:                       96 KiB (2 instances)
L1i cache:                       64 KiB (2 instances)
L2 cache:                        2.5 MiB (2 instances)
L3 cache:                        48 MiB (1 instance)
NUMA node(s):                    1
NUMA node0 CPU(s):               0,1
Vulnerability Itlb multihit:     KVM: Mitigation: VMX unsupported
Vulnerability L1tf:              Mitigation; PTE Inversion
Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Mmio stale data:   Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed:          Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor	:Intel
Architecture	:UnknownIntel
Model	Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (48, 1280, 49152) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

Ethan-Russell

Looking really good! Just a couple of tiny things to resolve. None of them are super important either.

src/io/util.jl

src/types/Unit.jl

src/types/policies/ITC.jl

test/testpoltypes.jl

src/io/data.jl

github-actions · 2023-03-06T19:54:16Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmarks:
- Target: 6 Mar 2023 - 19:52
- Baseline: 6 Mar 2023 - 19:54
Package commits:
- Target: 816497
- Baseline: 1d3c66
Julia commits:
- Target: 17cfb8
- Baseline: 17cfb8
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["get_af"]`	1.09 (5%) ❌	1.00 (1%)
`["get_pdem"]`	0.92 (5%) ✅	1.00 (1%)
`["load_data"]`	0.00 (5%) ✅	0.01 (1%) ✅
`["setup_model"]`	0.27 (5%) ✅	0.81 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       1531 s          0 s        143 s       2958 s          0 s
       #2  2793 MHz       2531 s          0 s        183 s       1901 s          0 s
  Memory: 6.781219482421875 GB (4151.70703125 MB free)
  Uptime: 466.85 sec
  Load Avg:  1.1  0.97  0.5
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       1582 s          0 s        148 s       3909 s          0 s
       #2  2793 MHz       3466 s          0 s        206 s       1952 s          0 s
  Memory: 6.781219482421875 GB (4527.5 MB free)
  Uptime: 567.82 sec
  Load Avg:  1.02  0.98  0.55
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 6 Mar 2023 - 19:52
Package commit: 816497
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	97.767 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	50.461 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	94.970 ns (5%)		48 bytes (1%)	3
`["load_data"]`	29.572 ms (5%)		8.86 MiB (1%)	312398
`["setup_model"]`	2.377 s (5%)	863.213 ms	1.87 GiB (1%)	17699921

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       1531 s          0 s        143 s       2958 s          0 s
       #2  2793 MHz       2531 s          0 s        183 s       1901 s          0 s
  Memory: 6.781219482421875 GB (4151.70703125 MB free)
  Uptime: 466.85 sec
  Load Avg:  1.1  0.97  0.5
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 6 Mar 2023 - 19:54
Package commit: 1d3c66
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	89.954 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	48.310 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	103.199 ns (5%)		48 bytes (1%)	3
`["load_data"]`	25.810 s (5%)	450.722 ms	1.55 GiB (1%)	30313422
`["setup_model"]`	8.958 s (5%)	1.058 s	2.31 GiB (1%)	26189360

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
              speed         user         nice          sys         idle          irq
       #1  2793 MHz       1582 s          0 s        148 s       3909 s          0 s
       #2  2793 MHz       3466 s          0 s        206 s       1952 s          0 s
  Memory: 6.781219482421875 GB (4527.5 MB free)
  Uptime: 567.82 sec
  Load Avg:  1.02  0.98  0.55
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server)
  Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads	1
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Address sizes:                   46 bits physical, 48 bits virtual
Byte Order:                      Little Endian
CPU(s):                          2
On-line CPU(s) list:             0,1
Vendor ID:                       GenuineIntel
Model name:                      Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family:                      6
Model:                           106
Thread(s) per core:              1
Core(s) per socket:              2
Socket(s):                       1
Stepping:                        6
BogoMIPS:                        5586.87
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor:               Microsoft
Virtualization type:             full
L1d cache:                       96 KiB (2 instances)
L1i cache:                       64 KiB (2 instances)
L2 cache:                        2.5 MiB (2 instances)
L3 cache:                        48 MiB (1 instance)
NUMA node(s):                    1
NUMA node0 CPU(s):               0,1
Vulnerability Itlb multihit:     KVM: Mitigation: VMX unsupported
Vulnerability L1tf:              Mitigation; PTE Inversion
Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Mmio stale data:   Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed:          Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor	:Intel
Architecture	:UnknownIntel
Model	Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (48, 1280, 49152) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

github-actions · 2023-03-06T20:05:52Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmarks:
- Target: 6 Mar 2023 - 20:03
- Baseline: 6 Mar 2023 - 20:05
Package commits:
- Target: a0d927
- Baseline: 1d3c66
Julia commits:
- Target: 17cfb8
- Baseline: 17cfb8
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["get_pdem"]`	1.06 (5%) ❌	1.00 (1%)
`["load_data"]`	0.00 (5%) ✅	0.01 (1%) ✅
`["setup_model"]`	0.29 (5%) ✅	0.81 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz       3233 s          0 s        247 s       3233 s          0 s
       #2  2294 MHz       2416 s          0 s        246 s       3996 s          0 s
  Memory: 6.781219482421875 GB (4059.8203125 MB free)
  Uptime: 679.88 sec
  Load Avg:  1.02  1.09  0.68
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, broadwell)
  Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz       4359 s          0 s        277 s       3465 s          0 s
       #2  2294 MHz       2646 s          0 s        259 s       5137 s          0 s
  Memory: 6.781219482421875 GB (4413.34765625 MB free)
  Uptime: 819.06 sec
  Load Avg:  1.04  1.06  0.73
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, broadwell)
  Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 6 Mar 2023 - 20:3
Package commit: a0d927
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	111.333 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	63.724 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	112.000 ns (5%)		48 bytes (1%)	3
`["load_data"]`	41.091 ms (5%)		8.86 MiB (1%)	312398
`["setup_model"]`	4.049 s (5%)	1.482 s	1.87 GiB (1%)	17699921

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz       3233 s          0 s        247 s       3233 s          0 s
       #2  2294 MHz       2416 s          0 s        246 s       3996 s          0 s
  Memory: 6.781219482421875 GB (4059.8203125 MB free)
  Uptime: 679.88 sec
  Load Avg:  1.02  1.09  0.68
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, broadwell)
  Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Time of benchmark: 6 Mar 2023 - 20:5
Package commit: 1d3c66
Julia commit: 17cfb8
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["get_af"]`	109.468 ns (5%)		32 bytes (1%)	2
`["get_generator"]`	62.234 ns (5%)		48 bytes (1%)	1
`["get_pdem"]`	106.002 ns (5%)		48 bytes (1%)	3
`["load_data"]`	36.898 s (5%)	747.369 ms	1.55 GiB (1%)	30397703
`["setup_model"]`	13.952 s (5%)	1.806 s	2.31 GiB (1%)	26200578

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.5
Commit 17cfb8e65ea (2023-01-08 06:45 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.2 LTS
  uname: Linux 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz       4359 s          0 s        277 s       3465 s          0 s
       #2  2294 MHz       2646 s          0 s        259 s       5137 s          0 s
  Memory: 6.781219482421875 GB (4413.34765625 MB free)
  Uptime: 819.06 sec
  Load Avg:  1.04  1.06  0.73
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, broadwell)
  Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads	1
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Address sizes:                   46 bits physical, 48 bits virtual
Byte Order:                      Little Endian
CPU(s):                          2
On-line CPU(s) list:             0,1
Vendor ID:                       GenuineIntel
Model name:                      Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
CPU family:                      6
Model:                           79
Thread(s) per core:              1
Core(s) per socket:              2
Socket(s):                       1
Stepping:                        1
BogoMIPS:                        4589.37
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear
Hypervisor vendor:               Microsoft
Virtualization type:             full
L1d cache:                       64 KiB (2 instances)
L1i cache:                       64 KiB (2 instances)
L2 cache:                        512 KiB (2 instances)
L3 cache:                        50 MiB (1 instance)
NUMA node(s):                    1
NUMA node0 CPU(s):               0,1
Vulnerability Itlb multihit:     KVM: Mitigation: VMX unsupported
Vulnerability L1tf:              Mitigation; PTE Inversion
Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Mmio stale data:   Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed:          Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property	Value
Brand	Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Vendor	:Intel
Architecture	:Broadwell
Model	Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 256, 51200) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

sallyrobson added 5 commits February 16, 2023 11:24

drafted ITC and PTC Policies

75a2579

Merge branch 'main' into feat-14-basicpoltypes

874eef3

Merge branch 'main' into feat-14-basicpoltypes

e165c20

added age to gen and Years to unit, edited PTC, added tests

2eae9c6

debug and add PTC tests, start ITC, change capex_obj to Container ByYear

d1a3105

Getting ITC working and adding tests

5f2b97a

cleaning up and adding documentation

4d47b7b

Ethan-Russell reviewed Mar 2, 2023

View reviewed changes

test/testpoltypes.jl Outdated Show resolved Hide resolved

implemented comments from PR, added year2float, changed tests

0a60c46

made ITC and PTC files

0e7ea5d

Ethan-Russell reviewed Mar 4, 2023

View reviewed changes

Ethan-Russell added 2 commits March 6, 2023 14:46

Clean up, add PTC/ITC to docs

2242ee1

Make sure tests actually pass this time...

fb1e943

sallyrobson merged commit 2f8e580 into main Mar 6, 2023

PTC and ITC formulation #77

PTC and ITC formulation #77

Conversation

sallyrobson commented Feb 28, 2023

sallyrobson commented Feb 28, 2023

github-actions bot commented Mar 1, 2023

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

codecov bot commented Mar 1, 2023 • edited Loading

Codecov Report

sallyrobson commented Mar 1, 2023

github-actions bot commented Mar 1, 2023

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

Ethan-Russell left a comment • edited Loading

Choose a reason for hiding this comment

github-actions bot commented Mar 3, 2023

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

github-actions bot commented Mar 3, 2023

Judge result

Benchmark Report for /home/runner/work/E4ST.jl/E4ST.jl

Job Properties

codecov bot commented Mar 1, 2023 •

edited

Loading

Ethan-Russell left a comment •

edited

Loading