Generate catalog from datasets jsons

[hansmohrmann]

We have some data that's duplicated in a few places: things like tags and names are coded in the dataset jsons as well as the catalog jsons. The reasoning here is that a user should be able to use the dataset json independently. I think a good solution is that the catalog should be generated from the datasets programmatically, either on-the-fly (i.e. parse over all the dataset jsons when loading the catalog) if this is fast enough, or else on some kind of routine schedule/event trigger (if it's relatively slow to do). Hardcoding the catalog json is fine for now, but won't work once we start updating datasets.

[linear]

DAT-56 Generate catalog from datasets jsons

We have some data that's duplicated in a few places: things like tags and names are coded in the dataset jsons as well as the catalog jsons. The reasoning here is that a user should be able to use the dataset json independently. I think a good solution is that the catalog should be generated from the datasets programmatically, either on-the-fly (i.e. parse over all the dataset jsons when loading the catalog) if this is fast enough, or else on some kind of routine schedule/event trigger (if it's relatively slow to do). Hardcoding the catalog json is fine for now, but won't work once we start updating datasets.