[WIP] Add modifier for affinity package

[rfhaque]

Description

[WIP] Adding a modifier that prints thread/core/gpu affinity for an experiment.

• Replace with: A short description of the change, including motivation and context.
• Replace with: A list of any dependencies.
• Replace with: Link(s) to relevant issue(s)
• Complete the checklist for a relevant section(s) below
• Delete sections below that are not relevant to this PR

Adding/modifying a system (docs: Adding a System)

• Add/modify systems/system_name/system.py file
• Add/modify a dry run unit test for system_name in .github/workflows/run.yml
• Add/modify systems/all_hardware_descriptions/hardware_name/hardware_description.yaml which will appear in the docs catalogue

Adding/modifying a benchmark (docs: Adding a Benchmark)

• (optional) If package upstreamed to Spack is insufficient, add/modify repo/benchmark_name/package.py
• (optional) If application upstreamed to Ramble is insufficient, add/modify repo/benchmark_name/application.py
• Tags in Ramble's application.py or in repo/benchmark_name/application.py will appear in the docs catalogue
• Add/modify an experiments/benchmark_name/experiment.py to define a single node and multi-node experiments
• Add/modify a dry run unit test in .github/workflows/run.yml

Adding/modifying core functionality, CI, or documentation:

• Update docs
• Update .github/workflows and .gitlab/ci unit tests (if needed)

[pearce8]

@dyokelson We want to use this modifier to record the affinity. Please let Riyaz know how the data should be output (json format - any more details?) and where the file should be written so that we can inject it into the .cali file.

[pearce8]

line 25 should be:

depends_on("cuda", when="+cuda")

[rfhaque]

@dyokelson The modifier can now generate the JSON output. Usage:

bin/benchpark system init --dest=tioga llnl-elcapitan rocm=5.5.1 +gtl compiler=cce
rm -rf saxpy; ../bin/benchpark experiment init --dest saxpy saxpy +rocm~cuda~openmp caliper=mpi affinity=rocm
benchpark setup saxpy tioga <workspace>
ramble setup ...
ramble on ...

The JSON file will be available at {experiment_dir}/affinity.rocm.json

@nhanford @pearce8 I have only tested this on lassen(cuda) and tioga(rocm). We need to test if the modes are output correctly, in particular there seems to be no mpi+openmp mode

[pearce8]

@dyokelson please take a look, does this work for injecting into Caliper attributes?