Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

error when DataLoader's num_workers is not 0 #13313

Closed
mengjiexu opened this issue Nov 17, 2018 · 4 comments
Closed

error when DataLoader's num_workers is not 0 #13313

mengjiexu opened this issue Nov 17, 2018 · 4 comments

Comments

@mengjiexu
Copy link

when I use:
train_data = gluon.data.DataLoader(
MyImageFolderDataset(label_len).transform_first(transform_train),
batch_size=batch_size,num_workers=4)
It shows error:
Can't pickle local object 'Dataset.transform_first..base_fn'

when I use:
train_data = gluon.data.DataLoader(
MyImageFolderDataset(label_len).transform_first(transform_train),
batch_size=batch_size,num_workers=0)
It is ok.

@zachgk
Copy link
Contributor

zachgk commented Nov 19, 2018

@mxnet-label-bot add [Bug, Python, Gluon, Data-loading]

Thank you for submitting the issue! I'm labeling it so the MXNet community members can help resolve it.

@intgogo
Copy link

intgogo commented Nov 26, 2018

Same problem in windows server 2016.

@gaomingnudt
Copy link

I got the same problem on Win10
mxnet is latest version
and the same code work fine on mac

@abhinavs95
Copy link
Contributor

@mengjiexu looks like #14541 is a duplicate issue of this. Acc @zhreshold comment there the issue is fixed in 1.4.0 and master

@nswamy nswamy closed this as completed Apr 8, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

7 participants