Hybrid Encoder Error

[Josh.Dallagiacomo]

Getting this error when using the hybrid encoder

Failed to encode frame #45: __lib_enc_hevc_nv__::NvEncoderCustom::InvalidateRefFrames : m_nvenc.nvEncInvalidateRefFrames(m_hEncoder, invalidRefFrameTimeStamp) returned error 12 (code 12) at ..\enc_hevc\src\nv_acc\nv_enc\nv_hw_enc.cpp:186

Command Line:
& "C:\Program Files\MainConcept\FFmpeg-PlugIns\bin\ffmpeg.exe" -i .\00000.avi  -c:v omx_enc_hevc -omx_core omxil_core.dll -omx_name OMX.MainConcept.enc_hevc.video -omx_param "force_omx_param=0:preset=main:acc_type=nvenc:acc_mode=driven:perf_level=30" -b:v 1024k -maxrate 1485k -minrate 512k .\00000.hevc  -y

Input is AVI 960x720, 23.98fps

Also

• If I change from driven to full it works
  
• If I change it to hybrid it works
  

Full output:

Code:

ffmpeg version release_v2.1_n4.4_rc6-4-gca28973 Copyright (c) 2000-2021 the FFmpeg developers
  built with Microsoft (R) C/C++ Optimizing Compiler Version 19.16.27027.1 for x64
  configuration: --toolchain=msvc --enable-asm --enable-x86asm --disable-mediafoundation --enable-omx --enable-omx_enc_avc --enable-omx_enc_hevc --enable-omx_enc_xheaac --enable-muxer=mpegts_omx --enable-muxer=mxf_omx --extra-cflags='-I ../omxil_common/include/omx' --prefix='../bin/win64-x64"'
  libavutil      56. 70.100 / 56. 70.100
  libavcodec     58.134.100 / 58.134.100
  libavformat    58. 76.100 / 58. 76.100
  libavdevice    58. 13.100 / 58. 13.100
  libavfilter     7.110.100 /  7.110.100
  libswscale      5.  9.100 /  5.  9.100
  libswresample   3.  9.100 /  3.  9.100
Input #0, avi, from '.\00000.avi':
  Metadata:
    software        : TMPGEnc Video Mastering Works 7 Version 7.0.27.30
  Duration: 00:23:46.97, start: 0.000000, bitrate: 69057 kb/s
  Stream #0:0: Video: magicyuv (M8Y0 / 0x3059384D), yuv420p, 960x720, 66747 kb/s, 23.98 fps, 23.98 tbr, 23.98 tbn, 23.98 tbc
  Stream #0:1: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 48000 Hz, stereo, s32 (24 bit), 2304 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (magicyuv (native) -> hevc (omx_enc_hevc))
Press [q] to stop, [?] for help
Trying to load mc_enc_hevc library
HEVC validation error E0121: Layer 0 (Main): 'log2_max_cu_size' was set to 5 (sps.log2_diff_max_min_luma_coding_block_size + 3).
HEVC validation error E0213: Layer 0 (Main): 'sign_data_hiding' was set to 0 (pps.sign_data_hiding_flag).
Creating MainConcept H.265/HEVC video encoder ...
  Version:  13.1.2.5857
  Platform: Windows 64bit (AVX2 + NVENC DRIVEN)
Output #0, hevc, to '.\00000.hevc':
  Metadata:
    software        : TMPGEnc Video Mastering Works 7 Version 7.0.27.30
    encoder         : Lavf58.76.100
  Stream #0:0: Video: hevc, yuv420p(tv, bt709/unknown/unknown, progressive), 960x720, q=2-31, 1024 kb/s, 23.98 fps, 23.98 tbn
    Metadata:
      encoder         : Lavc58.134.100 omx_enc_hevc
Failed to encode frame #45: __lib_enc_hevc_nv__::NvEncoderCustom::InvalidateRefFrames : m_nvenc.nvEncInvalidateRefFrames(m_hEncoder, invalidRefFrameTimeStamp) returned error 12 (code 12) at ..\enc_hevc\src\nv_acc\nv_enc\nv_hw_enc.cpp:186

System Specs:
CPU: Intel Core i9 12900KS
GPU: Nvidia RTX 3090Ti Founders Edition
RAM: 32 Gb DDR5-5600MHz
Windows 11 Pro 10.0.22621 Build 22621

[Ivan Uskov]

Getting this error when using the hybrid encoder
...

Unfortunately this is issue of current nvidia drivers: The nvEncInvalidateRefFrames functionality (IRF) is broken.
If you want to use the driven mode please downgrade your nvidia driver to version 528.02
It can be downloaded by this link: https://www.nvidia.com/download/driverRe...spx/198400