CGDI Web Harvester

[indiciumx]

Work has been completed on the CGDI web harvestor, but permission to move this forward has not been granted.

[jvanulde]

Please add your planning poker estimate with Zenhub @elatsis

[elatsis]

Hey team! Please add your planning poker estimate with Zenhub @bo-lu @dennisfu @indiciumx @PVautour @sean-eagles @xinli-cai

[jvanulde]

@indiciumx @bo-lu in our Web Presence meeting on December 21st the deputy director want us to confirm that harvesting wouldn't result in duplication of records. Can you confirm?

[indiciumx]

All reasonable efforts have been made, ie - when a resource is harvested it checks to see if the same resource URL exists in our records, and if it doesn't it adds it. Unfortunately it's not bomb proof, and we have a caveat written into the records.

[indiciumx]

@jvanulde jvanulde when should we bring this up again?

[jvanulde]

Waiting on minimum metadata standard from TBS.