Ronald S. Bultje fd8b90f5f6 vp9: fix overflow in 8x8 topleft 32x32 idct ssse3 version. ...

Also disable the mmx/iwht optimization when the bitexact flag is set.
With synthetically coded coefficients (i.e. these that lead to a
residual well outside the [-255,255] range), our optimizations will
overflow. It doesn't make sense to fix the overflows, since they can
only occur on synthetic input, not on real fwht-generated input. Thus,
add a bitexact flag that disables this optimization.

2015-09-10 07:51:16 -04:00

1.3 KiB

Raw Blame History

View Raw