🛣️ The long and treacherous road to compliance with the ITF1788 test suite

[miguelraz]

I'm opening this issue as a roadmap in order to track what needs to be done in order to achieve compliance with the ITF1788 test suite. It'll update as PRs/issues get handled. This table was obtained by building the latest test suite (deps: python3, ply, yaml) and running the test suite manually.

Summary:

Road to compliance	Tracking issues/PRs?	No missing functionality?	No Missing tests?	Error Free?	Good to go?
abs_rev.jl	#13			✔️
atan2.jl	#15			✔️
c-xsc.jl					✔️
fi_lib.jl				❌
ieee1788-constructors.jl	#219,#221	❌
ieee1788-exceptions.jl	#222			❌
ieee1788-bool.jl	#219			❌
ieee1788-cancel.jl					✔️
ieee1788-class.jl			❌
ieee1788-elem.jl	#219, #223			❌
ieee1788-mul_rev.jl			❌
ieee1788-num.jl	#219		❌	❌
ieee1788-overlap.jl	#224			❌
ieee1788-rec_bool.jl					✔️
ieee1788-reduction.jl			❌
ieee1788-rev.jl			❌
ieee1788-set.jl					✔️
mpfi.jl			❌	❌
pow_rev.jl			❌	❌

[ignacio-vc]

Very handy, thank you. I'll make sure to contribute in short order

[dpsanders]

Thanks a lot for this @miguelraz!

[miguelraz]

No probs. 3 questions.

1. The PRs for contractors should go into IntervalContractors.jl, right?
2. Missing test sets - how should we generate those for stuff like atan2 and others? Ping the ITF1788 repo?
3. Non-ieee1788 files - are they part of the standard? Priority? There's some hairy bugs in the mpfi.jl file that seem to, at first glance, cause problems upstream with MPFI.jl. Should we look into those versions

Tomorrow I will upload the latest versions of the tests to a standalone repo.
Maybe a BinaryBuilder.jl solution is in order later to automatize pulling the test autogeneration script + dependencies, creating the files, and PRing into its own repo.

[ignacio-vc]

@miguelraz I could look into automating that, as well as this other issue in ValidatedNumerics I've been working on. I'll keep you posted on progress through incoming issues/PRs

[miguelraz]

Cool beans.
I uploaded the latest test files here and will be PRing my changes into that repo for the while being.

[miguelraz]

Pending a PR (oheim/ITF1788#15), atan2.jl should be good to go testwise.
Updated the table.

[lucaferranti]

superseeded by #465