bytedeco/javacv

FFmpegFrameGrabber processImage() method is very resource intensive

Open

#2,093 opened on Sep 11, 2023

View on GitHub
 (0 comments) (1 reaction) (0 assignees)Java (1,583 forks)batch import
enhancementhelp wanted

Repository metrics

Stars
 (6,985 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Converting from one color format to another is just generally very resource intensive. In my case most of the time the conversion is from yuv420p frames to rgb. The real question I have is whether it's possible to avoid this conversion and somehow directly display decoded frames. Is the gpu even capable of doing that? And even if it isn't I see that my processor is also getting quite a bit of work in when converting the frames so is it perhaps possible to leave the entire conversion up to the gpu?

Contributor guide

Research direction
Investigate if the GPU can handle color space conversion directly (e.g., using OpenGL textures or Vulkan), or if there are alternative APIs in FFmpeg/JavaCV to avoid converting to RGB and directly render yuv420p frames.
Tech stack
java
Domain
backend
Issue type
Performance
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Needs investigation
Prerequisites
JavaFFmpeg
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40