diff options
| author | Yaowu Xu <yaowu@google.com> | 2013-01-31 15:39:41 -0800 |
|---|---|---|
| committer | Yaowu Xu <yaowu@google.com> | 2013-01-31 15:39:41 -0800 |
| commit | ab1cad9bdd339ada3c80c7ba061e06e760573edf (patch) | |
| tree | cd2d9d3cce691dc935c0cc3b310d6d78bf569d24 /vp9/encoder | |
| parent | 5149d7f7bd99279ed34d6416a63471a0095ba015 (diff) | |
| download | libvpx-ab1cad9bdd339ada3c80c7ba061e06e760573edf.tar libvpx-ab1cad9bdd339ada3c80c7ba061e06e760573edf.tar.gz libvpx-ab1cad9bdd339ada3c80c7ba061e06e760573edf.tar.bz2 libvpx-ab1cad9bdd339ada3c80c7ba061e06e760573edf.zip | |
fix a small bug in 16 point forward dct
The commit fixes a minor error in 16 point fdct where in a rotation can
produce result of -1 instead of 0.
Change-Id: I45aac4a52bcd06225c6d04e643547a13e1c1aade
Diffstat (limited to 'vp9/encoder')
| -rw-r--r-- | vp9/encoder/vp9_dct.c | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/vp9/encoder/vp9_dct.c b/vp9/encoder/vp9_dct.c index bfde02ccb..32e7b3fbc 100644 --- a/vp9/encoder/vp9_dct.c +++ b/vp9/encoder/vp9_dct.c @@ -1288,7 +1288,7 @@ static void dct16x16_1d(int16_t input[16], int16_t output[16], output[15] = (intermediate[11] + intermediate[12] + output_rounding) >> output_shift; - output[ 1] = -(intermediate[11] - intermediate[12] + output_rounding) + output[ 1] = (intermediate[12] - intermediate[11] + output_rounding) >> output_shift; output[ 7] = (2 * (intermediate[13] * C8) + final_rounding) >> final_shift; |