Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Review and refinement of OpenRefine GREL script #506

Closed
AstridBVW opened this issue May 30, 2024 · 1 comment
Closed

Review and refinement of OpenRefine GREL script #506

AstridBVW opened this issue May 30, 2024 · 1 comment
Assignees
Labels
post-processing Specimen table export preparation for import using OpenRefine

Comments

@AstridBVW
Copy link
Collaborator

AstridBVW commented May 30, 2024

The OpenRefine post-processing GREL script needed to be reviewed and refined.

The following changes have been made:

  1. For the column Publish, I have changed the value from “yes” to “True”
  2. I have corrected the remark source and remark date columns so they only contain a value (“DaSSCo digitisation” and “catalogeddate”) if remarks contain a value (ticket Adding source name to the Specify Collection object table  #461 and ticket Tabular remarks - condition for setting the additional columns #492 )
  3. I have added a column for “storedunder” with value “True” for all records (ticket Add Store Under name = Yes to GREL script for NHMD Vascular Plants taxonomy #490 )
  4. I have added columns for “datafile_remark”, “datafile_source”, “datafile_date” with the following values for all records:
    1. datafile_remark: “insert filename”
    2. datafile_source: “DaSSCo data file”
    3. datafile_date: the value from catalogeddate
  5. I have added a step, you have to change the value in column “datafile_remark” from “insert filename” to the filename of the processed file (suffix “processed” and extension tsv)

The 4th and 5th change replace the monitoring script that Jan made for the time being (ticket #461 ).

@AstridBVW AstridBVW self-assigned this May 30, 2024
@AstridBVW AstridBVW added the post-processing Specimen table export preparation for import using OpenRefine label May 30, 2024
AstridBVW added a commit that referenced this issue Jun 13, 2024
Changes: yes changed to True for Publish, condition set for tabular remarks source and date, stored under added, metadata columns added (datafile, source, date)
@AstridBVW
Copy link
Collaborator Author

The new version of the GREL post-processing script is now available on Github.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
post-processing Specimen table export preparation for import using OpenRefine
Projects
None yet
Development

No branches or pull requests

1 participant