diff options
| author | Yaowu Xu <yaowu@google.com> | 2016-05-31 16:41:49 -0700 |
|---|---|---|
| committer | Yaowu Xu <yaowu@google.com> | 2016-06-01 16:00:56 +0000 |
| commit | 787b38ebb964be883088450eaa17a002d97cd2e1 (patch) | |
| tree | 6076714e93a8957034389373739de7994d7df668 /vp8/encoder/rdopt.c | |
| parent | 46ff1072b38fa0241738535e694a45f5c528c16e (diff) | |
| download | libvpx-787b38ebb964be883088450eaa17a002d97cd2e1.tar libvpx-787b38ebb964be883088450eaa17a002d97cd2e1.tar.gz libvpx-787b38ebb964be883088450eaa17a002d97cd2e1.tar.bz2 libvpx-787b38ebb964be883088450eaa17a002d97cd2e1.zip | |
Fix VP8 encoder UBSAN/IOC errors
1. vp8/decoder/dboolhuff.c
2. vp8/decoder/dboolhuff.h
3. vp8/encoder/bitstream.c
4. vp8/encoder/boolhuff.h
5. vp8/encoder/rdopt.c
BUG=https://bugs.chromium.org/p/webm/issues/detail?id=1218
Change-Id: I5d315d63fd7aeaee6f3bd79178e593f3db38a6b1
Diffstat (limited to 'vp8/encoder/rdopt.c')
| -rw-r--r-- | vp8/encoder/rdopt.c | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/vp8/encoder/rdopt.c b/vp8/encoder/rdopt.c index 9063cea76..6507ae9f1 100644 --- a/vp8/encoder/rdopt.c +++ b/vp8/encoder/rdopt.c @@ -1899,7 +1899,8 @@ static int calculate_final_rd_costs(int this_rd, int prob_skip_cost; prob_skip_cost = vp8_cost_bit(cpi->prob_skip_false, 1); - prob_skip_cost -= vp8_cost_bit(cpi->prob_skip_false, 0); + prob_skip_cost -= + (int)vp8_cost_bit(cpi->prob_skip_false, 0); rd->rate2 += prob_skip_cost; *other_cost += prob_skip_cost; } |