diff options
| author | Johann <johannkoenig@google.com> | 2016-08-02 15:59:35 -0700 |
|---|---|---|
| committer | Johann <johannkoenig@google.com> | 2016-09-23 17:04:18 -0700 |
| commit | ab0e7a237a6e9796c15a8858caac04dea3593d62 (patch) | |
| tree | 359cb7482dca32b87306efb67101c48c616dfcb8 /vpx_dsp/prob.c | |
| parent | ada850786c7e0a5d6024b7716db9896124fd483e (diff) | |
| download | libvpx-ab0e7a237a6e9796c15a8858caac04dea3593d62.tar libvpx-ab0e7a237a6e9796c15a8858caac04dea3593d62.tar.gz libvpx-ab0e7a237a6e9796c15a8858caac04dea3593d62.tar.bz2 libvpx-ab0e7a237a6e9796c15a8858caac04dea3593d62.zip | |
Use shifted value for sinpi8sqrt2
The value 35468 changes sign when stored in int16_t:
implicit conversion from 'int' to 'int16_t' (aka 'short')
changes value from 35468 to -30068
This negation requires adding back the original value to compensate.
Shifting the value keeps the value positive and saves a post-vqdmulh
shift.
This technique is used in webp and idct_dequant_full_2x_neon
BUG=b/28027557
Change-Id: I0c5ce09bea170fe08061856c2af6f841a557e0c3
Diffstat (limited to 'vpx_dsp/prob.c')
0 files changed, 0 insertions, 0 deletions