Unwanted skewing and distorting using ffmpegframerecorder

[Hosseinyzr]

I am using ffmpegframerecorder to record Bitamps that converted to Frame Object.
for some Bitmap sizes mostly near to square sizes the out put is skewd... (but for some others there is no problem)

is there any way to solve it?

[saudet]

Would you have some code snippet to reproduce that?

[Hosseinyzr]

          File file = new File(soundAddress);

            fFmpegSoundFrameGrabber = new FFmpegFrameGrabber(file);
            fFmpegSoundFrameGrabber.setAudioChannels(1);
            fFmpegSoundFrameGrabber.start();


            recorderVideoWithSound = new FFmpegFrameRecorder(ouputFile, outputWidth, outputheight, 1);

            recorderVideoWithSound.setFormat("mp4");
            recorderVideoWithSound.setVideoQuality(1);
            recorderVideoWithSound.setVideoCodec(AV_CODEC_ID_H264);
            recorderVideoWithSound.setPixelFormat(AV_PIX_FMT_YUV420P);
            recorderVideoWithSound.setFrameRate(frameRate);
            recorderVideoWithSound.setAudioCodec(fFmpegSoundFrameGrabber.getAudioCodec());
            recorderVideoWithSound.setSampleFormat(fFmpegSoundFrameGrabber.getSampleFormat());
            recorderVideoWithSound.setSampleRate(fFmpegSoundFrameGrabber.getSampleRate());
            recorderVideoWithSound.setAudioBitrate(fFmpegSoundFrameGrabber.getAudioBitrate());




            recorderVideoWithSound.start();

            Frame frame2;
            int i = 0;
            while ((frame2 = fFmpegSoundFrameGrabber.grabFrame()) != null) {
                recorderVideoWithSound.record(frame2);
                if (recorderVideoWithSound.getTimestamp() <= fFmpegSoundFrameGrabber.getLengthInTime()) {
                    recorderVideoWithSound.record(proccessedFrames[i % proccessedFrames.length]);
                }


                i++;
            }
            recorderVideoWithSound.stop();
            recorderVideoWithSound.release();
            fFmpegSoundFrameGrabber.stop();
            fFmpegSoundFrameGrabber.release();

[saudet]

How do you create a "proccessedFrames"?

[Hosseinyzr]

I have some Bitmaps that using this yo convert them:
Frame frame = new AndroidFrameConverter().convert(bitmap);

[saudet]

Could you explain how to create one of those problematic Bitmap?

[Hosseinyzr]

I make them by some basic operation like canvas.drawBitmap() and etc...
I have tried to save each bitmap after generating and there was no problem with them.
and I have tried to resize them to 480 pixel width and the record them and the problem solved.
so for example if I record series of bitmap of size: 741 *723 this problem occurs but if I resize them to 480 * 468 , the problem won't occurs .

[Hosseinyzr]

and also i don't think it is related to AndroidFrameConverter().convert(bitmap) because i tried another test that I convert the Frame result of it to Bitmap again and save it, and i see they have no problem.
I think there is problem with recorder maybe , or its settings...

[saudet]

Yes, I think it's an issue with AndroidFrameConverter, but I won't be able to solve this unless I am able to reproduce this issue here. You're still not giving me anything to create such a Bitmap.

[Hosseinyzr]

Aha, but I think the AndroidFrameConverter is doing well.
and maybe when the image size becomes large , the recorder having problem. yes?
I don't know which part to send , there are many classes related to this.
but I tried to save the result bitmap to png and load it , and there was the same problem.
here is that png file

valen.zip

[saudet]

Thanks! And how do I load this image to cause this issue?

[saudet]

In any case, I probably found the cause. This should be fixed with commit 531220d.
Please give it a try with 1.4.5-SNAPSHOT: http://bytedeco.org/builds/

[Hosseinyzr]

Hello again,
sorry for my latency !
and ok , I will see that snapshot.🙏

[Hosseinyzr]

I have another issue , and because it maybe related to AndroidFrameConertor so I ask it here or if you want, I will open new Issue:
If the bitmap has black pixels , they turn into blue or green!
here is the output gif. I have tested it for mp4 output and it has also this problem.

If I brighter the image the problem will be vanished .

[saudet]

Looks like your image has an alpha channel, you'll need to deal with it.

[Hosseinyzr]

but It does not have alpha channel..
its was a jpeg image that was loaded...

[saudet]

Even if your file doesn't have one Android uses RBGA so there is an alpha channel that gets added.

[Hosseinyzr]

so what is the problem with having alpha channel , though the pixels are fully colored.
and it just affect some black pixels although those black pixels are not transparent.
any idea to solve it?

[Hosseinyzr]

I checked my code, and I fund this problem is not related to your library ... thanks

[saudet]

The skewing issue with AndroidFrameConverter is now fixed with JavaCV 1.5.
Thanks for reporting and enjoy!