You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on May 7, 2020. It is now read-only.
It would be great if data loaders were implemented in popular frameworks so that all the datasets here could be accessed with a provided adaptor. Instead of wrapping this data loader myself I could just call a function to generate a data loader for some dataset in some framework. For example these data loaders:
Hey Joseph!
I agree it would be a great addition. I don't have much time these days to work on this kind of stuff unfortunately, but contributions in this direction are more than welcome of course. If someone is willing to give it a try I can definitely join the design phase and I can also probably find some time to help with part of the implementation.
For what concerns TensorFlow, I wrote a "main loop" that feeds your model (that you can define easily in a separate project) with the data coming from the dataset loaders and takes care of some of the usual stuff (early stopping, logging, loss/gradients/samples in tensorboard, ..). It has an extensive parametrization accessible from the command line and, as a bonus, supports multigpu: https://github.com/fvisin/main_loop_tf/
It would be great if data loaders were implemented in popular frameworks so that all the datasets here could be accessed with a provided adaptor. Instead of wrapping this data loader myself I could just call a function to generate a data loader for some dataset in some framework. For example these data loaders:
MXNet: http://mxnet.io/api/python/io.html
PyTorch: http://pytorch.org/docs/torchvision/datasets.html
TensorFlow: https://www.tensorflow.org/extend/new_data_formats
Fuel: https://fuel.readthedocs.io/en/latest/h5py_dataset.html
The text was updated successfully, but these errors were encountered: