[Interest] Video acceleration with gstreamer 1.0 omx and Qt 5.9.4 / 5.10 eglfs on RPI3 (brcm)

Thu Feb 15 12:03:33 CET 2018

Hi Luca.

Nice, I've discovered your project before but somehow wanted to get this
running in default setup.
Anyway, great work! You think this couldn't be upstreamed or you just don't
have the time for it?

Best regards,
Petar

On Sun, Feb 11, 2018 at 7:14 PM, Luca Carlon <carlon.luca at gmail.com> wrote:

> Hello,
> if you want I can play videos in QML with hardware acceleration on pi 1, 2
> and 3 using a custom open source implementation I wrote years ago:
> https://goo.gl/KphzdD. I've been using it with most Qt 5 versions. I
> tested it on raspbian and a custom image I built with yocto only on eglfs.
> This is not the most performant implementation for video playout on the pi
> but 1080p is smooth in QML.
> Regards.
>
> Luca
>
> On Sat, Feb 3, 2018 at 4:15 PM, Petar Koretić <petar.koretic at gmail.com>
> wrote:
>
>> And just to mention for the others who maybe stumble upon this, with
>> gstreamer 1.12 the issue is the same, and also using QMediaPlayer and
>> QVideoOutput (without QML) same thing happens so at this moment I don't se
>> any ability to have a working video playout on raspberry with Qt.
>> I've opened bug for this with some hope QTBUG-66162
>> <https://bugreports.qt.io/browse/QTBUG-66162>.
>>
>> Best regards,
>> Petar
>>
>> On Fri, Feb 2, 2018 at 4:01 PM, Petar Koretić <petar.koretic at gmail.com>
>> wrote:
>>
>>> Well, so couple days more of testing Yocto and Boot2Qt the issue seems
>>> to be in the Qt somewhere.
>>> I decided to build Qt 5.9.4 and even 5.10.1 snapshot using latest
>>> Boot2Qt layer.
>>> Adding gstreamer1.0-omx to the layer and building the image with that
>>> results in a great smooth video when played with gstreamer directly,
>>> ie gst-play-1.0 test.mp4 (this video comes from youtube-dl -f 137+140
>>> https://www.youtube.com/watch?v=T63MCogI4sM)
>>> but playing that same video using Video qml element there are obvious
>>> frame drops.
>>>
>>> In essence there is no ability to get a smooth video playback on RPI3 by
>>> using Qt/QML and any stock method approach as of this moment using bcm or
>>> vc4 driver with buildroot, yocto, rasbpian or archarm.
>>> This definitely surprised me as default Boot2Qt image is obviously
>>> unusable for the RPI QML Video playout. I ran out of free time, so I doubt
>>> I will have time to investigate more.
>>> Next I would try latest gstreamer in hope that there were some
>>> improvements in the sink element that QML uses since 1.10.4 is built by
>>> Boot2Qt and 1.12.4 is the latest if I am not mistaken.
>>>
>>> Best regards,
>>> Petar
>>>
>>> On Wed, Jan 31, 2018 at 6:53 PM, Paolo Angelelli <paolo.angelelli at qt.io>
>>> wrote:
>>>
>>>> Maybe this could be relevant:
>>>> https://gstreamer.freedesktop.org/data/events/gstreamer-conf
>>>> erence/2016/John%20Sadler%20-%20Smooth%20video%20on%20Raspbe
>>>> rry%20Pi%20with%20gst-mmal%20(Lightning%20Talk).pdf
>>>>
>>>> On Wed, 31 Jan 2018 18:48:47 +0100
>>>> Petar Koretić <petar.koretic at gmail.com> wrote:
>>>>
>>>> > Thanks Paolo,
>>>> > I also found something along that lines so I will be trying this next.
>>>> >
>>>> > Vlad, thanks, I actually took buildroot one from that page to make
>>>> sure it
>>>> > works :)
>>>> > yocto was also next on my list, but for the lack of time I always end
>>>> up
>>>> > using buildroot in the end as it should work the same, and I knew I
>>>> had
>>>> > this running on raspbian so I thought this will "just work" as I would
>>>> > somewhat expect this to be pretty standard
>>>> >
>>>> > Best regards,
>>>> > Petar
>>>> >
>>>> >
>>>> > On Wed, Jan 31, 2018 at 6:42 PM, Vlad Stelmahovsky <
>>>> > vladstelmahovsky at gmail.com> wrote:
>>>> >
>>>> > > Hi
>>>> > >
>>>> > > have you  checked the link: http://www.jumpnowtek.
>>>> > > com/rpi/Raspberry-Pi-Systems-with-Yocto.html ?
>>>> > >
>>>> > > On Wed, Jan 31, 2018 at 5:28 PM, Petar Koretić <
>>>> petar.koretic at gmail.com>
>>>> > > wrote:
>>>> > >
>>>> > >> Hi all.
>>>> > >>
>>>> > >> So I haven't played around with this for some time but around one
>>>> year
>>>> > >> ago or more I think I got this up running fairly easily. This was
>>>> maybe
>>>> > >> still with gstreamer 0.10.
>>>> > >>
>>>> > >> For the past two days I was trying to get video working with
>>>> acceleration
>>>> > >> on the RPI player through QtMultimedia using QML Video element.
>>>> > >>
>>>> > >> Using VC4 driver is a no go as there is no acceleration support in
>>>> the
>>>> > >> driver yet as far as I know but the simple fullhd video played
>>>> pretty
>>>> > >> nicely as far as it goes.
>>>> > >>
>>>> > >> Anyway I went back the standard omx route.
>>>> > >> I tried to build and use Qt 5.9 creating a system using buildroot
>>>> as I
>>>> > >> always do and later checking with latest raspbian stretch.
>>>> > >> Both methods compiled without issues using eglfs and gstreamer 1
>>>> and
>>>> > >> using the broadcom driver.
>>>> > >>
>>>> > >> In the end these are the instructions that I decided to follow for
>>>> > >> rasbian http://www.tal.org/tutorials/b
>>>> uilding-qt-510-raspberry-pi-de
>>>> > >> bian-stretch
>>>> > >> where I used gstreamer-omx-rpi package.
>>>> > >>
>>>> > >> Playing example full hd video (http://cdn3.viblast.com/strea
>>>> > >> ms/hls/airshow/2670k/stream.m3u8) or any mp4 youtube file results
>>>> in a
>>>> > >> not so smooth video with obvious stutters (gpu_mem is at 256mb)
>>>> > >> .GST_DEBUG=omx:4 shows that the omx is being used.
>>>> > >>
>>>> > >> I remember that I was able to play two videos at the same time
>>>> (one full
>>>> > >> hd, one smaller) with animations without issues but I'm not sure
>>>> if this
>>>> > >> was using eglfs and gstreamer 1.0 as it was more than a year ago.
>>>> > >>
>>>> > >> Is this expected to work in this setup with gstreamer omx on rpi
>>>> and
>>>> > >> broadcom driver using eglfs or which route should I go? Any help is
>>>> > >> appreciated as I've tried a fair bit of different things and I'm
>>>> still
>>>> > >> trying but can't understand if this should be possible at all.
>>>> > >>
>>>> > >> Best regards,
>>>> > >> Petar
>>>> > >>
>>>> > >>
>>>> > >>
>>>> > >>
>>>> > >>
>>>> > >>
>>>> > >>
>>>> > >> _______________________________________________
>>>> > >> Interest mailing list
>>>> > >> Interest at qt-project.org
>>>> > >> http://lists.qt-project.org/mailman/listinfo/interest
>>>> > >>
>>>> > >>
>>>> > >
>>>> > >
>>>> > > --
>>>> > > Best regards,
>>>> > > Vlad
>>>> > >
>>>>
>>>> _______________________________________________
>>>> Interest mailing list
>>>> Interest at qt-project.org
>>>> http://lists.qt-project.org/mailman/listinfo/interest
>>>>
>>>
>>>
>>
>> _______________________________________________
>> Interest mailing list
>> Interest at qt-project.org
>> http://lists.qt-project.org/mailman/listinfo/interest
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.qt-project.org/pipermail/interest/attachments/20180215/073f4747/attachment.html>