Arabic file import fails pdf splitting

[laritakr]

Story

Work: https://bl.bl-staging.notch8.cloud/concern/books/8beed1ee-e4ef-412e-92b3-8718ca8e3e10

The arabic file on this work is just sitting in sidekiq during the pdf split process and not doing anything. It appears to be locking up on Open3.popen3(cmd) do |_stdin, stdout, _stderr, _wait_thr| line. Is there a better way to open the pdf file and run the ghostscript command on it?

See also:

• https://stackoverflow.com/questions/8952043/how-to-fix-hanging-popen3-in-ruby
• https://www.rubydoc.info/stdlib/open3/Open3.popen3

Acceptance Criteria

• Identify reason arabic PDF is unable to split and resolve if possible.

Screenshots

Testing Instructions and Sample Files

• Create a work and attach the Arabic pdf from the above-referenced work.
• Verify that PDF successfully splits into child pages and appears in UV (moved to UV manifest cannot handle large solr queries iiif_print#224)

Notes

[laritakr]

Requires IiifPrint gem update.

UV issue requires notch8/iiif_print#224 fix. Will come at a later point.

[jillpe]

IiifPrint update handled in #313

[DiemBTran]

This passes SoftServ QA: See attached screenshot.

tested on:

• https://bl.bl-staging.notch8.cloud/concern/books/823e2226-e64c-4a62-82de-026bcb4997c9?locale=en
• Remote_Capture_Arabic.pdf

testing instructions

• Verify that PDF successfully:
  • splits into child pages yes (screenshot) ✅
  • and appears in UV (moved to UV manifest cannot handle large solr queries iiif_print#224)

arabic PDFs are split into child pages

[grahamjevon]

Hi @laritakr - the specific test instructions are successful. However, when I replicated the real life scenario of uploading two pdf files (the English book and the Arabic translation) at the point of adding a new work, there was some unexpected behaviour. The most obvious sign of this is that the first split page displayed is page 039 (see screenshot below). This suggests that either some pages have not been split (yet?) or that something unexpected has happened to the ordering of the split pages.

I notice there are split pages still appearing on the recent works feed despite the fact that I added this work about 24 hours ago (I'm assuming these are from my upload and not a subsequent SoftServ test). Is there another backlog?

I wasn't sure whether to pass this ticket through QA and flag this unexpected behaviour as a different issue. I suspect you will know better whether this is related or distinct.

[laritakr]

Hi @grahamjevon This seems to be a completely separate issue, and also recently happened with another client as well. I'm really stumped on it but haven't had time yet to track down a cause - these randomly occurring issues are tough to duplicate and trace! (I checked and did not see anything remaining in sidekiq)

We definitely need a new ticket for this behavior.

[grahamjevon]

Thanks @laritakr - In that case I will pass this ticket through QA and I have created another ticket for this new issue #401.