Not recognizing FFMPEG on windows

[ThomasEricB]

FFMPEG not working on Windows for some reason wtf

Compositing all frames of the video...: ETR=0:00:02.679026A=0:00ETA=0:00:02.9834610:00:0T=0:00:00.304435ProgressProgressCompositing all frames of the video...: ETR=0:00:02.464445      ETA=0:00:03.096354      T=0:00:00.631909        ProgressCompositing all frames of the video...: ETR=0:00:02.228091      ETA=0:00:03.211072      T=0:00:00.982981        ProgressCompositing all frames of the video...: ETR=0:00:01.882163      ETA=0:00:03.180207      T=0:00:01.298043        ProgressCompositing all frames of the video...: ETR=0:00:01.564844      ETA=0:00:03.194889      T=0:00:01.630046        ProgressCompositing all frames of the video...: ETR=0:00:01.359001      ETA=0:00:03.329553      T=0:00:01.970551        ProgressCompositing all frames of the video...: ETR=0:00:01.030708      ETA=0:00:03.366981      T=0:00:02.336272        ProgressCompositing all frames of the video...: ETR=0:00:00.685002      ETA=0:00:03.356511      T=0:00:02.671509        ProgressCompositing all frames of the video...: ETR=0:00:00.341598      ETA=0:00:03.347659      T=0:00:03.006061        ProgressCompositing all frames of the video...: COMPLETED IN 0:00:03.357236     Progress: 49/49
Traceback (most recent call last):
  File "C:\Users\Phoenix\Downloads\Go-with-the-Flow-main\cut_and_drag_gui.py", line 352, in <module>
    output_video_file=save_video_mp4(output_frames, output_folder+'/'+title + ".mp4", video_bitrate="max")
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Phoenix\AppData\Roaming\Python\Python312\site-packages\rp\r.py", line 28723, in save_video_mp4
    writer = VideoWriterMP4(path, framerate, video_bitrate=video_bitrate, height=height, width=width, show_progress=show_progress)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Phoenix\AppData\Roaming\Python\Python312\site-packages\rp\r.py", line 28603, in __init__
    _ensure_ffmpeg_installed()
  File "C:\Users\Phoenix\AppData\Roaming\Python\Python312\site-packages\rp\r.py", line 28816, in _ensure_ffmpeg_installed
    assert False, "Please install ffmpeg! sudo apt install ffmpeg"
           ^^^^^
AssertionError: Please install ffmpeg! sudo apt install ffmpeg

C:\Users\Phoenix\Downloads\Go-with-the-Flow-main>ffmpeg -version
ffmpeg version 7.0.2-full_build-www.gyan.dev Copyright (c) 2000-2024 the FFmpeg developers
built with gcc 13.2.0 (Rev5, Built by MSYS2 project)
configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libaribcaption --enable-libdav1d --enable-libdavs2 --enable-libuavs3d --enable-libxevd --enable-libzvbi --enable-librav1e --enable-libsvtav1 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxeve --enable-libxvid --enable-libaom --enable-libjxl --enable-libopenjpeg --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-libharfbuzz --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-dxva2 --enable-d3d11va --enable-d3d12va --enable-ffnvcodec --enable-libvpl --enable-nvdec --enable-nvenc --enable-vaapi --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libcodec2 --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint
libavutil      59.  8.100 / 59.  8.100
libavcodec     61.  3.100 / 61.  3.100
libavformat    61.  1.100 / 61.  1.100
libavdevice    61.  1.100 / 61.  1.100
libavfilter    10.  1.100 / 10.  1.100
libswscale      8.  1.100 /  8.  1.100
libswresample   5.  1.100 /  5.  1.100
libpostproc    58.  1.100 / 58.  1.100

[dissorial]

Same here.

You are currently working on layer #1 of 1
Creating frames for this layer...: ETR=0:00:00.012943   ETA=0:00:00.317115      T=0:00:00.304171        Progress: 47/49C:\Users\dissorial\Desktop\eye-warp-container\eye-warp\lib\site-packages\rp\r.py:27752: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray.
  try:return np.asarray(x)#For numpy arrays and python lists (and anything else that work with np.asarray)
Compositing all frames of the video...: ETR=0:00:00.291003      ETA=0:00:01.584347      T=0:00:01.293344        Progress: 40/49Traceback (most recent call last):
  File "C:\Users\dissorial\Desktop\Go-with-the-Flow\cut_and_drag_gui.py", line 352, in <module>
    output_video_file=save_video_mp4(output_frames, output_folder+'/'+title + ".mp4", video_bitrate="max")
  File "C:\Users\dissorial\Desktop\eye-warp-container\eye-warp\lib\site-packages\rp\r.py", line 28723, in save_video_mp4
    writer = VideoWriterMP4(path, framerate, video_bitrate=video_bitrate, height=height, width=width, show_progress=show_progress)
  File "C:\Users\dissorial\Desktop\eye-warp-container\eye-warp\lib\site-packages\rp\r.py", line 28603, in __init__
    _ensure_ffmpeg_installed()
  File "C:\Users\dissorial\Desktop\eye-warp-container\eye-warp\lib\site-packages\rp\r.py", line 28816, in _ensure_ffmpeg_installed
    assert False, "Please install ffmpeg! sudo apt install ffmpeg"
AssertionError: Please install ffmpeg! sudo apt install ffmpeg

I also ran ffmpeg alone in the terminal and can confirm it's installed, but is not being recognized by this repo's code.

(eye-warp)  ~\..\Go-with-the-Flow   main  ffmpeg
ffmpeg version 7.1-full_build-www.gyan.dev Copyright (c) 2000-2024 the FFmpeg developers
  built with gcc 14.2.0 (Rev1, Built by MSYS2 project)
  configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libaribcaption --enable-libdav1d --enable-libdavs2 --enable-libopenjpeg --enable-libquirc --enable-libuavs3d --enable-libxevd --enable-libzvbi --enable-libqrencode --enable-librav1e --enable-libsvtav1 --enable-libvvenc --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxeve --enable-libxvid --enable-libaom --enable-libjxl --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-libharfbuzz --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-dxva2 --enable-d3d11va --enable-d3d12va --enable-ffnvcodec --enable-libvpl --enable-nvdec --enable-nvenc --enable-vaapi --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libcodec2 --enable-libilbc --enable-libgsm --enable-liblc3 --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint
  libavutil      59. 39.100 / 59. 39.100
  libavcodec     61. 19.100 / 61. 19.100
  libavformat    61.  7.100 / 61.  7.100
  libavdevice    61.  3.100 / 61.  3.100
  libavfilter    10.  4.100 / 10.  4.100
  libswscale      8.  3.100 /  8.  3.100
  libswresample   5.  3.100 /  5.  3.100
  libpostproc    58.  3.100 / 58.  3.100
Universal media converter
usage: ffmpeg [options] [[infile options] -i infile]... {[outfile options] outfile}...

Use -h to get full help or, even better, run 'man ffmpeg'

Running windows 11 version 24H2

[remisarrailh]

Error is from rp :
rp\r.py", line 28816, in _ensure_ffmpeg_installed
https://github.com/RyannDaGreat/rp/blob/c3a37ef9c7d61c6ca3788fd768bf474dcd443b8c/r.py#L28816

get_system_commands() return nothing when on Windows
https://github.com/RyannDaGreat/rp/blob/c3a37ef9c7d61c6ca3788fd768bf474dcd443b8c/r.py#L11265
if currently_running_windows(): return [] #Don't crash rp for now. I'll test this some other time.

[remisarrailh]

WARNING : You'll probably won't have enough VRAM, it tried to allocated 113.01 GiB at the end

1. Animation Template GUI (Local)

WARNING TEMPORARY STUPID SOLUTION, USE AT YOUR OWN RISK

Find location of r.py (you can find the path in the error)
File "C:\Users\remi\anaconda3\Lib\site-packages\rp\r.py", line 28816, in _ensure_ffmpeg_installed
Modify line 28815 to make rp return ffmpeg found when not found

def _ensure_ffmpeg_installed():
    if "ffmpeg" in get_system_commands():
        assert False, "Please install ffmpeg! sudo apt install ffmpeg"

Seems to works (but will probably cause issue with this package)

2 - Running Video Diffusion (GPU)

python make_warped_noise.py <PATH TO VIDEO OR URL> --output_folder noise_warp_output_folder
MUST BE RUN AS ADMINISTRATOR or it will fail

Run Inference 2.4
lora_models\Go-with-the-FlowI2V5B_final_i38800_nearest_lora_weights.safetensors failed to download correctly
I downloaded it manually here (and renamed it)
https://huggingface.co/Eyeline-Research/Go-with-the-Flow/blob/main/I2V5B_final_i38800_nearest_lora_weights.safetensors

Anyway, Got OUT OF MEMORY error so I'll probably won't get further.
Tried to allocate 113.01 GiB

[RyannDaGreat]

Hi - this doesn't seem right, it should never require more than 40GB VRAM, and if you enable gradient checkpointing (aka CPU offloading) it shouldn't take more than 10GB. Was this blowup during the diffusion process or the noise warping process?

[RyannDaGreat]

Also, @remisarrailh rp has just been updated with a corrected detector for FFMPEG that should work on Windows. Can you please update with "pip install rp --upgrade" and confirm? Thank you!

[a-v-ebrahimi]

Thanks1
pip install rp --upgrade
fixed the problem.

[somenewaccountthen]

Hi - this doesn't seem right, it should never require more than 40GB VRAM, and if you enable gradient checkpointing (aka CPU offloading) it shouldn't take more than 10GB. Was this blowup during the diffusion process or the noise warping process?

Please mention VRAM requirement sin the README saving many people a lot of time.
I feel this should be a standard thing for projects like this but it's almost never reported until someone asks.

[TerminatedProcess]

Also, @remisarrailh rp has just been updated with a corrected detector for FFMPEG that should work on Windows. Can you please update with "pip install rp --upgrade" and confirm? Thank

Hi - this doesn't seem right, it should never require more than 40GB VRAM, and if you enable gradient checkpointing (aka CPU offloading) it shouldn't take more than 10GB. Was this blowup during the diffusion process or the noise warping process?

Please mention VRAM requirement sin the README saving many people a lot of time. I feel this should be a standard thing for projects like this but it's almost never reported until someone asks.

I got it working on my 16 gig NVIDIA 4070 TI Super. However, I haven't figured out how to correctly mimic motion as it just cuts and pasts a part of the video the new location (red dots to blue). There's on info on how to use it.