diff options
| author | John Koleszar <jkoleszar@google.com> | 2010-11-04 16:59:26 -0400 |
|---|---|---|
| committer | John Koleszar <jkoleszar@google.com> | 2010-11-05 14:52:53 -0400 |
| commit | 9fb80f7170ec48e23c3c7b477149eeb37081c699 (patch) | |
| tree | 4d98b3422eec115983ac2467d24fd449fb080eb4 /vp8/encoder/picklpf.c | |
| parent | 09bcc1f710ea65dc158639479288fb1908ff0c53 (diff) | |
| download | libvpx-9fb80f7170ec48e23c3c7b477149eeb37081c699.tar libvpx-9fb80f7170ec48e23c3c7b477149eeb37081c699.tar.gz libvpx-9fb80f7170ec48e23c3c7b477149eeb37081c699.tar.bz2 libvpx-9fb80f7170ec48e23c3c7b477149eeb37081c699.zip | |
fix integer promotion bug in partition size check
The check '(user_data_end - partition < partition_size)' must be
evaluated as a signed comparison, but because partition_size was
unsigned, the LHS was promoted to unsigned, causing an incorrect
result on 32-bit. Instead, check the upper and lower bounds of
the segment separately.
Change-Id: I6266aba7fd7de084268712a3d2a81424ead7aa06
Diffstat (limited to 'vp8/encoder/picklpf.c')
0 files changed, 0 insertions, 0 deletions