summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-04-14Merge "Set vizier rc parameters"Cheng Chen
2021-04-13Set vizier rc parametersCheng Chen
If pass --use-vizier-rc-params=1, the rc parameters are overwittern by pass in values. It --use-vizier-rc-params=0, the rc parameters remain the default values. Change-Id: I7a3e806e0918f49e8970997379a6e99af6bb7cac
2021-04-13Merge "Removed unused constant"Paul Wilkins
2021-04-12Removed unused constantPaul Wilkins
Deleted #define that is no longer referenced. Change-Id: If0b132c5a40dd8910f535fffdee7d2d1c7df4748
2021-04-08vpx_image: clear user provided vpx_image_t earlyJames Zern
this avoids uninitialized values and potential misuse of them which could lead to a crash should the function fail this is the same fix that was applied in libaom: d0cac70b5 Fix a free on invalid ptr when img allocation fails Bug: webm:1722 Change-Id: If7a8d08c4b010f12e2e1d848613c0fa7328f1f9c
2021-04-07Merge "Fix compilation for CONFIG_RATE_CTRL"Cheng Chen
2021-04-07Merge "Delete unused constants."Paul Wilkins
2021-04-07Merge "Change zm_factor for Vizier."Paul Wilkins
2021-04-06Fix compilation for CONFIG_RATE_CTRLCheng Chen
Recently, some function signatures have been changed. This change fixes compilation error if --enable-rate-ctrl is used. Change-Id: Ib8e9cb5e181ba1d4a6969883e377f3dd93e9289a
2021-04-07Adjust end to end psnr valueCheng Chen
A recent change leads to slight difference of encoding results: d3aaac367 Change calculation of rd multiplier, which is caught by Jenkins nightly test. Adjust the threshold to silence the test failure. BUG=webm:1725 Change-Id: I7e8b3a26b72c831ae4d88d0fca681b354314739d
2021-04-06Change zm_factor for Vizier.Paul Wilkins
Changes the exposed zm_factor parameter. This patch alters the meaning of the zm_factor parameter that will be exposed for the Vizier project. The previous power factor was hard to interpret in terms of its meaning and effect and has been replaced by a linear factor. Given that the initial Vizier results suggested a lower zero motion effect for all formats, the default impact has been reduced. The patch as it stands gives a modest improvement for PSNR but is slightly down on some sets for SSIM (overall psnr, ssim % bdrate change: -ve is better) lowres -0.111, 0.001 ugc360p -0.282, -0.068 midres2 -0.183, 0.059 hdres2 -0.042, 0.172 Change-Id: Id6566433ceed8470d5fad1f30282daed56de385d
2021-04-06Delete unused constants.Paul Wilkins
Delete some #defines that are no longer needed. Change-Id: I9e4e4df10716598b0d62b0c70f538d4b78a32296
2021-04-05Pass vizier rc parameter values with range checkCheng Chen
This is similar to the change: https://chromium-review.googlesource.com/c/webm/libvpx/+/2771081 Which fails libvpx nightly test. Here we add range check to get rid of the warning of "divided by zero". BUG=webm:1723 Change-Id: I7712efe7abd4b11cdb725643d51fd1c0a300d924
2021-04-02Revert "Pass vizier rc parameter values from command line to twopass"Tom Finegan
This reverts commit f32829a2e5db3cd1624e8a7a530af84c382762ef. BUG=webm:1723 Change-Id: I866cdf288f9873c350b32091515a6d5f4df362a3
2021-04-01Merge "Change calculation of rd multiplier."Paul Wilkins
2021-03-31Merge "vp9_ext_ratectrl_test: use uintptr_t for void* value"James Zern
2021-03-31Merge "Convert Vizier RD parameters to normalized factors"Paul Wilkins
2021-03-31Change calculation of rd multiplier.Paul Wilkins
Change the way the rd multiplier is adjusted for Q and frame type. Previously in VP9 the rd multiplier was adjusted based on crude Q bins and whether the frame was a key frame or inter frame. The Q bins create some problems as they potentially introduce discontinuities in the RD curve. For example, rate rising with a stepwise increase in Q instead of falling. As such, in AV1 they have been removed. A further issue was identified when examining the first round of results from from the Vizier project. Here the multiplier for each Q bin and each frame type was optimized for a training set, for various video formats, using single point encodes at the appropriate YT rates. These initial results appeared to show a trend for increased rd multiplier at higher Q for key frames. This fits with intuition as in this encoding context a higher Q indicates that a clip is harder to encode and frames less well predicted. However, the situation appeared to reverse for inter frames with higher rd multipliers chosen at low Q. My initial suspicion was that this was a result of over fitting, but on closer analysis I realized that this may be more related to frame type within the broader inter frame classification. Specifically frames coded at low Q are predominantly ARF frames, for the mid Q bin there will likely be a mix of ARF and normal inter frames, and for the high Q bin the frames will almost exclusively be normal inter frames from difficult content. ARF frames are inherently less well predicted than other inter frames being further apart and not having access to as many prediction modes. We also know from previous work that ARF frames have a higher incidence of INTRA coding and may well behave more like key frames in this context. This patch replaces the bin based approach with a linear function that applies a small but smooth Q based adjustment. It also splits ARF frames and normal inter frames into separate categories. With this done number of parameters that will be exposed for the next round of Vizier training is reduced from 7 to 3 (one adjustment factor each for inter, ARF and key frames) This patch gives net BDATE gains for our test sets even with the baseline / default factors as follows: (% BDRATE change in overall PSNR and SSIM, -ve is better) LowRes -0.231, -0.050 ugc360p 0.160, -0.315 midres2 -0.348, -1.170 hdres2 -0.407, -0.691 Change-Id: I46dd2fea77b1c2849c122f10fd0df74bbd3fcc7f
2021-03-29Pass vizier rc parameter values from command line to twopassCheng Chen
Change-Id: I02eabeccf2fe4604875820d38e23c2586a63e290
2021-03-29Add command line options for a few rc parametersCheng Chen
These rate control parameters are for the Vizier experiment. They are defined as rational numbers. Change-Id: I23f382dd49158db463b75b5ad8a82d8e0d536308
2021-03-26vp9_ext_ratectrl_test: use uintptr_t for void* valueJames Zern
this avoids a warning about differences in size between void* and unsigned int under msvc: vp9_ext_ratectrl_test.cc(40,3): warning C4312: 'reinterpret_cast': conversion from 'const unsigned int' to 'void *' of greater size Change-Id: I5a412ec785ddcaeff2ec71bb83a6048505400293
2021-03-24Merge tag 'v1.10.0'Jerome Jiang
Release v1.10.0 Ruddy Duck 2021-03-09 v1.10.0 "Ruddy Duck" This maintenance release adds support for darwin20 and new codec controls, as well as numerous bug fixes. - Upgrading: New codec control is added to disable loopfilter for VP9. New encoder control is added to disable feature to increase Q on overshoot detection for CBR. Configure support for darwin20 is added. New codec control is added for VP9 rate control. The control ID of this interface is VP9E_SET_EXTERNAL_RATE_CONTROL. To make VP9 use a customized external rate control model, users will have to implement each callback function in vpx_rc_funcs_t and register them using libvpx API vpx_codec_control_() with the control ID. - Enhancement: Use -std=gnu++11 instead of -std=c++11 for c++ files. - Bug fixes: Override assembler with --as option of configure for MSVS. Fix several compilation issues with gcc 4.8.5. Fix to resetting rate control for temporal layers. Fix to the rate control stats of SVC example encoder when number of spatial layers is 1. Fix to reusing motion vectors from the base spatial layer in SVC. 2 pass related flags removed from SVC example encoder. Bug: webm:1712 Change-Id: I4d807da7aee5a4d9d7a7af66b927983622e9cefa
2021-03-23Convert Vizier RD parameters to normalized factorsPaul Wilkins
This patch converts the Vizier custom RD multipliers, to factors that adjust each RD multiplier either side of its default value, where a factor of 1.0 will give the previous default behavior. Ultimately I would like to replace the multiple RD multipliers triggered at different Q thresholds (eg, low, medium, high q) with a function that adjusts the rd behavior smoothly as Q changes. Vizier could then be presented with a single adjustment control for each of key frame and inter frame rd. The current behavior is problematic. Firstly having hard threshold Q values at which rd behavior changes may cause anomalies in the rate distortion curve, where in some situations, raising Q, for example, may not cause the expected drop in rate and rise in distortion, because we have crossed a threshold where the rate distortion multiplier changes sharply and this alters the balance of bits spent in the prediction and residual parts of the signal. Having a single value that is used for a range of Q index values (eg 0-64), (65-128) may also cause problems and over-fitting in the context of the Vizier ML project. This project tries to optimize the values for each Q range, for various YT formats, but does so by analyzing the results of single point encodes on a set of clips. For a given format all the clips are encoded with the same parameters (target rate etc) so there is likely to be clustering in regards to the Q values used. For example the training set may give a new value for the Q range 0-64 but most of the data points used may have Q close 64. It will likely require several iterations working with the Vizier team to get this right. This patch just gives an initial framework for testing. Change-Id: Iaa4cd5561b95a202bcae7a1d876c4f40ef444fa2
2021-03-19Merge "Change SR_diff calculation and representation"Paul Wilkins
2021-03-18Msvc builds convert to windows path w/msys envAdam B. Goode
Bug: webm:1720 Change-Id: I56689ad408f8086c511e1711dfa9c8d404727b2e (cherry picked from commit 04086a30664d2a3e89d6a6e4e1c18f1a82c8f958)
2021-03-18Change SR_diff calculation and representationPaul Wilkins
This patch changes the way prediction decay is calculated. We expect that frames that are further from an ALT-REF frame (or Golden Frame) will be less well predicted by that ALT-REF frame. As such it is desirable that they should contribute less to the boost calculation used to assign bits to the ALT_REF. This code looks at the reduction in prediction quality between the last frame and the second reference frame (usually two frames old). We make the assumption that we can accumulate this to get a proxy for the likely loss of prediction quality over multiple frames. Previously the calculation looked at the absolute difference in the coded errors. The issue here is that the meaning of a unit difference is not the same for very complex frames as it is for easy frames. In this patch we scale the decay value based on how the error difference compares to the overall frame complexity as represented by the intra coding error. This was tuned experimentally to give test results that were approximately neutral for our various test sets. There was a slight drop in Overall PSNR but a consistent improvement in SSIM. This balance may be improved with tuning further as it is noteworthy that it was much better on the hd_res set. Results (Overall PSNR, SSIM -ve better) for low_res, ugc360, midres2, ugc480P and hd_res are as follows: 0.173 -0.688 0.118 -0.153 0.132 -0.239 0.261 -0.405 -0.305 -1.109 As part of this adjustment the contribution of motion amplitude was removed. This patch also changes the control mechanism that will be exposed on the command line for use by the Vizier project. The control is now a linear factor which defaults to 1.0, where values < 1.0 mean a lower decay rate and values > 1.0 mean an increased decay rate. This presents a more easily understandable interface for use in optimizing the decay behavior for various formats, where it is clear what a passed in value means relative to the default. With the new decay mechanism the current values for various formats are almost certainly wrong and we still need to define sensible upper and lower bounds for use during future training. Change-Id: Ib1074bbea97c725cdbf25772ee8ed66831461ce3
2021-03-17Msvc builds convert to windows path w/msys envAdam B. Goode
Bug: webm:1720 Change-Id: I56689ad408f8086c511e1711dfa9c8d404727b2e
2021-03-12Merge "vp8: restrict 1st pass cpu_used range"James Zern
2021-03-12vp9-rtc: Add postencode_drop control to sample encoderMarco Paniconi
Change-Id: I1c989f26b0a7b9239adf37df8d96776f33b89a8b
2021-03-11Prepare for v1.10.0 release.Jerome Jiang
Update CHANGELOG, AUTHORS, README, libs.mk Bug: webm:1712 Change-Id: Ic99de12b91a92c32f8a9485dcb759c48bc3eccd6
2021-03-10Vizer: Added in experimental max KF boost values.Paul Wilkins
Added the experimental max per frame KF boost values derived from the Vizier experiments. These are still all off by default. When enabled I expect these to cause significant regression as they fluctuate wildly and in a way that makes no sense from format to format. I suspect these values reflect over fitting perhaps from a subset of training clips with more frequent mid chunk key frames and or short key frame groups. Also fixed incorrect value for gf boost for one format. Experiment to moderate these values and use different values for first and subsequent KF groups to follow. Change-Id: Ibeb4268957f2edacdb4549d74930255a22a2fcc5
2021-03-10Vizier: Add in field for min kf frame boost.Paul Wilkins
Added kf_frame_min_boost field to hold the minimum per frame boost in key frame boost calculations. Replaces hard wired value. To be used in conjunction with and tied to the maximum value. Change-Id: I67a39ecb3f21b5918512a5ccd9a1b214d7971e45
2021-03-10Merge "Vizier: Add defaults for > 1080P"Paul Wilkins
2021-03-10Merge "L2E: let vp9 encoder respect external max frame size constraint"Cheng Chen
2021-03-09Merge "Further integration for Vizier."Paul Wilkins
2021-03-09Vizier: Add defaults for > 1080PPaul Wilkins
Previous code did not have sensible defaults for larger image formats. Added defaults for Vizier RD parameters for sizes > 1080P and changed the first pass parameters for large formats to use the 1080P values. No supplied value for rd_mult_q_sq_key_high_qp case yet so set to old hard wired default value. If the Vizier parameters were enabled the lack of sensible defaults caused a large regression for 2K clips in one of our test sets. Change-Id: I306c0cd76eab00d50880c91fadb5842faf6661ff
2021-03-08L2E: let vp9 encoder respect external max frame size constraintCheng Chen
Change-Id: Ib926e694d4bc4675af1435a32f6316a587756380
2021-03-08Further integration for Vizier.Paul Wilkins
Further integration of Vizier adjustable parameters, This patch connects up additional configurable two pass rate control parameters for the Vizier project. This still needs to be connected up to a command line interface and at the moment should still be using default values that match previous behavior. Do not submit until verified that defaults are all working correctly. Change-Id: If1241c2dba6759395e6efa349c4659a0c345361d
2021-03-04Check for _WIN32 instead of WIN32.James Touton
_WIN32 is predefined for the Windows platform in MSVC, whereas WIN32 is not, and WIN32 is also not defined in the makefiles. Change-Id: I8b58e42d891608dbe1e1313dc9629c2be588d9ec
2021-03-04Merge "Add fields into RC for Vizier ML experiments."Paul Wilkins
2021-03-04Merge "override assembler with --as option on msvs"Jerome Jiang
2021-03-04Use -std=gnu++11 instead of -std=c++11Jerome Jiang
Cygwin and msys2 have stricter compliance requirement over standard c headers. Bug: webm:1708 Change-Id: I676b1227b9dd304149e50016468df0f057c6a78f
2021-03-03override assembler with --as option on msvsJerome Jiang
Bug: webm:1709 Change-Id: I962a64c00042fe95cc1cd845b187f71ad6cfd1b7
2021-03-03Add fields into RC for Vizier ML experiments.Paul Wilkins
This patch adds fields into the RC data structure for the Vizier. The added fields allow control of some extra rate control parameters and rate distortion. This patch also adds functions to initialize the various parameters though many are not yet used / wired in and for now all are set to default values. Ultimately many will be set through new command line options. Change-Id: I41591bb627d3837d2104fb363845adedbddf2e02
2021-02-26Remove comments for removed 'active_map' parameterWan-Teh Chang
Change-Id: I8635f6121e13089c25e201df033d5bc68e2862b4
2021-02-18Remove two pass related code from svc sample encoder.Jerome Jiang
SVC sample encoder is only supposed to be used for realtime SVC. Bug: webm:1705 Change-Id: I5c0c3491732db3e148073aaf7f90ee8d662b57b5
2021-02-05vp8_denoiser_sse2_test: disable BitexactCheck w/gcc-8+James Zern
this test fails under gcc 8-10, but not with other compilers Bug: webm:1718 Change-Id: I8c6c7a25c4aaf019a7f91f835a1a2c9a731cfadc
2021-02-03svc: Fix an existing unittest for flexible modeMarco Paniconi
The flag update_pattern_ was being set to 0 (because it was set before reset) instead of 1. And the example flexible mode pattern was not setting non-reference frame on top temporal top spatial. Change-Id: I8aee56ce13cc4e0d614126592f9d0f691fe527b0
2021-02-03Merge "L2E: let external rate control pass in a max frame size"Cheng Chen
2021-02-03Merge "svc: Unittest for ksvc flexible mode with no updates on TL > 0"Marco Paniconi