Skip to content

Commit

Permalink
Update stuff
Browse files Browse the repository at this point in the history
  • Loading branch information
charmoniumQ committed Oct 17, 2024
1 parent 5513df3 commit df9d219
Show file tree
Hide file tree
Showing 5 changed files with 47 additions and 18 deletions.
25 changes: 25 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
all:
mkdir -p experiments

# Process 14194128: bash -c cat flake.nix > test0; head test0 >tmp ; wc -l <tmp
mkdir -p process_14194128
# Run command for process 14194128
(bash -c cat flake.nix > test0; head test0 >tmp ; wc -l <tmp) > process_14194128/output.log 2>&1
# Process 14194128: cat flake.nix
mkdir -p process_14194128
# Copy input files for process 14194128
cp flake.nix_v0 process_14194128/
# Run command for process 14194128
(cd process_14194128 && cat flake.nix)
# Process 14194128: head test0
mkdir -p process_14194128
# Copy input files for process 14194128
cp test0_v0 process_14194128/
# Run command for process 14194128
(cd process_14194128 && head test0)
# Process 14194128: wc -l
mkdir -p process_14194128
# Copy input files for process 14194128
cp tmp_v0 process_14194128/
# Run command for process 14194128
(wc -l) > process_14194128/output.log 2>&1
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -66,7 +66,9 @@ If you need these you can either write a shell script and invoke `probe record`
probe record bash -c '<SHELL_CODE>'
```

(any flag after the first positional argument is treated as an argument to the command, not `probe`).
Any flag after the first positional argument is treated as an argument to the command, not `probe`.

This creates a file called `probe_log`. If you already have that file from a previous recording, give `probe record -f` to overwrite.

If you get tired of typing `probe record ...` in front of every command you wish to record, consider recording your entire shell session:

Expand Down
Binary file added docs/dataflow-graph.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
35 changes: 19 additions & 16 deletions docs/us-rse.html
Original file line number Diff line number Diff line change
Expand Up @@ -211,7 +211,7 @@ <h2>Prior works in record/replay</h2>
Sciunit (<a href="https://doi.org/10.1109/eScience.2017.51">Ton That et al. 2017</a>),
RR (<a href="http://arxiv.org/abs/1705.05937">O'Callahan et al. 2017</a>),
CARE (<a href="https://dl.acm.org/doi/10.1145/2618137.2618138">Yves et al. 2014</a>),
ReproZip (<a href="https://dl.acm.org/doi/10.1145/2882903.2899401">Chirigati et al. 2016</a>),
ReproZip (<a href="https://dl.acm.org/doi/10.1145/2882903.2899401">Chirigati et al. 2016</a>)
</li>
<li>Speed</li>
<li>Robustness of reproducibility</li>
Expand Down Expand Up @@ -242,7 +242,23 @@ <h2>Understand dataflow in your pile of scripts</h2>
</figure>
</section>
<section>
<h2>Create Makefile automatically</h2>
<img alt="example dataflow graph" src="dataflow-graph.svg" />
</section>
<section>
<h2>Create container automatically</h2>
<pre style="font-size: 5vh;"><code><span class="fragment">$ probe record ./plot.sh</span>
<span class="fragment">$ probe export docker-image experiment:1.0.1</span>
<span class="fragment">$ docker run experiment:1.0.1</span></code></pre>
<figure class="contributor">
<img
alt="Asif Zubayer Palak"
src="https://scholar.googleusercontent.com/citations?view_op=medium_photo&user=lwLSWCgAAAAJ&citpid=1"
/>
<figcaption>Contributed by Asif Zubayer Palak (new grad applying for PhD)</figcaption>
</figure>
</section>
<section>
<h2>Create Makefile automatically (planned feature)</h2>
<pre style="font-size: 5vh;"><code><span class="fragment">$ probe record ./plot.sh 42</span>
<span class="fragment">$ probe export makefile</span>
<span class="fragment">$ cat Makefile
Expand All @@ -259,19 +275,6 @@ <h2>Create Makefile automatically</h2>
<figcaption>Contributed by Kyrillos Ishak (new grad applying for PhD)</figcaption>
</figure>
</section>
<section>
<h2>Create container automatically (Planned feature)</h2>
<pre style="font-size: 5vh;"><code><span class="fragment">$ probe record ./plot.sh</span>
<span class="fragment">$ probe export docker-image experiment:1.0.1</span>
<span class="fragment">$ docker run experiment:1.0.1</span></code></pre>
<figure class="contributor">
<img
alt="Asif Zubayer Palak"
src="https://scholar.googleusercontent.com/citations?view_op=medium_photo&user=lwLSWCgAAAAJ&citpid=1"
/>
<figcaption>Contributed by Asif Zubayer Palak (new grad applying for PhD)</figcaption>
</figure>
</section>
<section>
<h2>What libraries does cmd use? (Planned feature)</h2>
<pre style="font-size: 5vh;"><code><span class="fragment">$ probe record ./plot.sh</span>
Expand All @@ -291,7 +294,7 @@ <h2>Performance and portability</h2>
<!-- <li>No standard benchmarks for system-level prov before <a href="https://dl.acm.org/doi/abs/10.1145/3641525.3663627">Grayson et al. 2023 ACM REP</a></li> -->
<li class="fragment">Rust record (statically-linked) + Python extras</li>
<!-- <li class="fragment">Less than 2x overhead on provenance benchmark suite (<a href="https://dl.acm.org/doi/abs/10.1145/3589806.3600037">Grayson et al. 2023 ACM REP</a>)</li> -->
<li class="fragment">Preliminary results show <code>LD_PRELOAD</code> beats <code>ptrace</code> by 2x to 1.1x</li>
<li class="fragment">Preliminary results show <code>LD_PRELOAD</code> (1.1x) faster than <code>ptrace</code> (2x)</li>
</ul>
<figure class="contributor">
<img
Expand Down
1 change: 0 additions & 1 deletion probe_src/python/probe_py/manual/analysis.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@
import shlex
import typing
from typing import Dict, Tuple
import networkx as nx # type: ignore
Expand Down

0 comments on commit df9d219

Please sign in to comment.