Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update UniData endpoint details #366

Closed
cessda-bitbucket-importer opened this issue Oct 5, 2021 · 12 comments
Closed

Update UniData endpoint details #366

cessda-bitbucket-importer opened this issue Oct 5, 2021 · 12 comments

Comments

@cessda-bitbucket-importer

Original report on BitBucket by John Shepherdson (GitHub: john-shepherdson).


UniData is still running a NESSTAR endpoint, but also has a Kuha2 endpoint at http://oai.unidata.unimib.it/v0/oai which will replace it, subject to testing

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


Initial tests using OAI-PMH Validator (https://validator.oaipmh.com/) passed, with one trivial exception - there is an empty set


@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


Endpoint details updated in dev and staging environments.

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


Endpoint checked via bulk validation. No constraint violations. All records fail schema validation with following error: ‘Invalid content was found starting with element '{\"ddi:codebook:2_5\":distrbtr}'. One of '{\"ddi:codebook:2_5\":distDate}' is expected."]’.

This is a Kuha2 issue.

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


From: UniData 
Date: Fri, 5 Nov 2021 at 08:25
Subject: Re: FW: CDC enpoint validation and PID checks
To: John Shepherdson
Cc: Taina Jääskeläinen (TAU)

Dear John,
I'm just writing to confirm that from today we've definitevely disabled our Nesstar endpoint so the Kuha2 endpoint is the only will be used.

Regards,
Carlo

--
UniData - Bicocca Data Archive

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


Subject: Re: FW: CDC endpoint validation and PID checks
To: UniData
Cc: Taina Jääskeläinen (TAU)

Carlo,

Yes, that is the case. We need to deploy a hotfix to the production site in order to make the change.

I will let you know when we have done that.

Regards,

John

On Mon, 15 Nov 2021 at 12:07, UniData wrote:

Dear John,
I noticed that the CDC is still harvesting our metadata from Nesstar instead of the new endpoint. Please, could you check it and let me know when you'll moving to the Kuha2 endpoint?
As soon as we'll receive your confirmation we'll shut down our Nesstar server.

Regards,
Carlo

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


@‌TainaFSD can you confirm that the new UniData endpoint should be used by the production version of CDC?

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


@matthew-morris-cessda Once Taina approve this change, please cherry pick cessda/cessda.cdc.osmh-indexer.cmm@f853588

@cessda-bitbucket-importer
Copy link
Author

Original comment by Taina Jääskeläinen.


I’ve reviewed UniData records in the staging version and confirm that the new endpoint can be used in production.

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


@matthew-morris-cessda time to gather some fruit!

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


Code has been modified and tested

@cessda-bitbucket-importer
Copy link
Author

Original comment by Matthew Morris (GitHub: matthew-morris-cessda).


I’ll apply the changes to the current production version.

@cessda-bitbucket-importer
Copy link
Author

Original comment by John Shepherdson (GitHub: john-shepherdson).


@matthew-morris-cessda Which commit applied this change?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants