Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to load checkpoint #1

Open
Yaoming95 opened this issue Feb 26, 2018 · 4 comments
Open

Failed to load checkpoint #1

Yaoming95 opened this issue Feb 26, 2018 · 4 comments

Comments

@Yaoming95
Copy link

Yaoming95 commented Feb 26, 2018

Hi!
When I run python main.py with default settings, the console prints:

(/home/ymzhu/anaconda2/envs/tf3) ymzhu@yuncao-All-Series:~/Desktop/code/DPGAN-master$ python main.py 
INFO:tensorflow:Starting running in train mode...
max_size of vocab was specified as 50000; we now have 50000 words. Stopping reading.
Finished constructing vocabulary of 50000 total words. Last word added: westbrook
Start pre-training......
INFO:tensorflow:Building generator graph...
INFO:tensorflow:Tensor("seq2seq/embedding/concat:0", shape=(64, ?, 512), dtype=float32, device=/device:GPU:0)
INFO:tensorflow:Time to build graph: 22 seconds
2018-02-26 10:48:03.203934: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.1 instructions, but these are available on your machine and could speed up CPU computations.
2018-02-26 10:48:03.203959: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.2 instructions, but these are available on your machine and could speed up CPU computations.
2018-02-26 10:48:03.203965: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations.
2018-02-26 10:48:03.203970: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX2 instructions, but these are available on your machine and could speed up CPU computations.
2018-02-26 10:48:03.203976: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use FMA instructions, but these are available on your machine and could speed up CPU computations.
INFO:tensorflow:Failed to load checkpoint from myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...

Seems it won't stop. How could I solve it? Thank you!

@loretoparisi
Copy link

I have the same issue with a concatenation of string like that

INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...

I have changed in main.py:

tf.app.flags.DEFINE_string('log_root', './', 'Root directory for all logging.')

and added

if __name__ == '__main__':
    nltk.download('punkt')
    tf.app.run()

@jingjingxupku
Copy link
Collaborator

Thanks for your feedback! Problem was fixed. Please update the code and run it again.

@akhileshkumargangwar
Copy link

Hi,
I also got same problem.Did this code work properly.When I executed it is showing many problems. Is there any updated code?

INFO:tensorflow:Building graph...
WARNING:tensorflow:<tensorflow.python.ops.rnn_cell_impl.LSTMCell object at 0x7f5684060048>: Using a concatenated state is slower and will soon be deprecated. Use state_is_tuple=True.
INFO:tensorflow:Time to build graph: 2 seconds
2018-08-21 09:32:51.744436: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:0) -> (device: 0, name: Quadro P5000, pci bus id: 0000:02:00.0)
INFO:tensorflow:Failed to load checkpoint from ./myexperiment/train-discriminator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from ./myexperiment/./myexperiment/train-discriminator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from ./myexperiment/./myexperiment/./myexperiment/train-discriminator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from ./myexperiment/./myexperiment/./myexperiment/./myexperiment/train-discriminator. Sleeping for 10 secs...

@jingjingxupku
Copy link
Collaborator

I do not meet this problem at the latest version. Please download the latest version.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants