Johannes Goetzfried 107778b592 crypto: twofish - add x86_64/avx assembler implementation ... This patch adds a x86_64/avx assembler implementation of the Twofish block cipher. The implementation processes eight blocks in parallel (two 4 block chunk AVX operations). The table-lookups are done in general-purpose registers. For small blocksizes the 3way-parallel functions from the twofish-x86_64-3way module are called. A good performance increase is provided for blocksizes greater or equal to 128B. Patch has been tested with tcrypt and automated filesystem tests. Tcrypt benchmark results: Intel Core i5-2500 CPU (fam:6, model:42, step:7) twofish-avx-x86_64 vs. twofish-x86_64-3way 128bit key: (lrw:256bit) (xts:256bit) size ecb-enc ecb-dec cbc-enc cbc-dec ctr-enc ctr-dec lrw-enc lrw-dec xts-enc xts-dec 16B 0.96x 0.97x 1.00x 0.95x 0.97x 0.97x 0.96x 0.95x 0.95x 0.98x 64B 0.99x 0.99x 1.00x 0.99x 0.98x 0.98x 0.99x 0.98x 0.99x 0.98x 256B 1.20x 1.21x 1.00x 1.19x 1.15x 1.14x 1.19x 1.20x 1.18x 1.19x 1024B 1.29x 1.30x 1.00x 1.28x 1.23x 1.24x 1.26x 1.28x 1.26x 1.27x 8192B 1.31x 1.32x 1.00x 1.31x 1.25x 1.25x 1.28x 1.29x 1.28x 1.30x 256bit key: (lrw:384bit) (xts:512bit) size ecb-enc ecb-dec cbc-enc cbc-dec ctr-enc ctr-dec lrw-enc lrw-dec xts-enc xts-dec 16B 0.96x 0.96x 1.00x 0.96x 0.97x 0.98x 0.95x 0.95x 0.95x 0.96x 64B 1.00x 0.99x 1.00x 0.98x 0.98x 1.01x 0.98x 0.98x 0.98x 0.98x 256B 1.20x 1.21x 1.00x 1.21x 1.15x 1.15x 1.19x 1.20x 1.18x 1.19x 1024B 1.29x 1.30x 1.00x 1.28x 1.23x 1.23x 1.26x 1.27x 1.26x 1.27x 8192B 1.31x 1.33x 1.00x 1.31x 1.26x 1.26x 1.29x 1.29x 1.28x 1.30x twofish-avx-x86_64 vs aes-asm (8kB block): 128bit 256bit ecb-enc 1.19x 1.63x ecb-dec 1.18x 1.62x cbc-enc 0.75x 1.03x cbc-dec 1.23x 1.67x ctr-enc 1.24x 1.65x ctr-dec 1.24x 1.65x lrw-enc 1.15x 1.53x lrw-dec 1.14x 1.52x xts-enc 1.16x 1.56x xts-dec 1.16x 1.56x Signed-off-by: Johannes Goetzfried <Johannes.Goetzfried@informatik.stud.uni-erlangen.de> Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>		2012-06-12 16:46:07 +08:00
..
aes-i586-asm_32.S
aes-x86_64-asm_64.S
aes_glue.c	Merge branch 'modsplit-Oct31_2011' of git://git.kernel.org/pub/scm/linux/kernel/git/paulg/linux	2011-11-06 19:44:47 -08:00
aesni-intel_asm.S	crypto: aesni-intel - fix unaligned cbc decrypt for x86-32	2012-05-31 20:53:22 +10:00
aesni-intel_glue.c	crypto: aesni-intel - move more common code to ablk_init_common	2012-05-15 17:25:33 +10:00
blowfish-x86_64-asm_64.S	crypto: blowfish-x86_64 - improve x86_64 blowfish 4-way performance	2011-10-21 14:23:07 +02:00
blowfish_glue.c	crypto: blowfish-x86_64 - set alignmask to zero	2012-02-25 17:20:24 +08:00
camellia-x86_64-asm_64.S	crypto: camellia - add assembler implementation for x86_64	2012-03-14 17:25:56 +08:00
camellia_glue.c	crypto: camellia-x86_64 - module init/exit functions should be static	2012-03-22 09:17:44 +08:00
crc32c-intel.c	crypto: Add support for x86 cpuid auto loading for x86 crypto drivers	2012-01-26 16:48:10 -08:00
fpu.c	crypto: aesni-intel - Merge with fpu.ko	2011-05-16 15:12:47 +10:00
ghash-clmulni-intel_asm.S
ghash-clmulni-intel_glue.c	crypto: Add support for x86 cpuid auto loading for x86 crypto drivers	2012-01-26 16:48:10 -08:00
Makefile	crypto: twofish - add x86_64/avx assembler implementation	2012-06-12 16:46:07 +08:00
salsa20-i586-asm_32.S
salsa20-x86_64-asm_64.S
salsa20_glue.c
serpent-sse2-i586-asm_32.S	crypto: serpent-sse2 - change transpose_4x4 to only use integer instructions	2012-01-13 16:38:40 +11:00
serpent-sse2-x86_64-asm_64.S	crypto: serpent-sse2 - change transpose_4x4 to only use integer instructions	2012-01-13 16:38:40 +11:00
serpent_sse2_glue.c	crypto: serpent-sse2 - combine ablk_*_init functions	2012-02-25 17:20:23 +08:00
sha1_ssse3_asm.S	crypto: sha1 - use Kbuild supplied flags for AVX test	2012-06-12 16:37:16 +08:00
sha1_ssse3_glue.c	crypto: sha1 - use Kbuild supplied flags for AVX test	2012-06-12 16:37:16 +08:00
twofish-avx-x86_64-asm_64.S	crypto: twofish - add x86_64/avx assembler implementation	2012-06-12 16:46:07 +08:00
twofish-i586-asm_32.S	crypto: twofish-x86-asm - make assembler functions use twofish_ctx instead of crypto_tfm	2011-10-21 14:23:08 +02:00
twofish-x86_64-asm_64-3way.S	crypto: twofish - add 3-way parallel x86_64 assembler implemention	2011-10-21 14:23:08 +02:00
twofish-x86_64-asm_64.S	crypto: twofish-x86-asm - make assembler functions use twofish_ctx instead of crypto_tfm	2011-10-21 14:23:08 +02:00
twofish_avx_glue.c	crypto: twofish - add x86_64/avx assembler implementation	2012-06-12 16:46:07 +08:00
twofish_glue.c	crypto: twofish-x86_64/i586 - set alignmask to zero	2012-02-25 17:20:24 +08:00
twofish_glue_3way.c	crypto: twofish - add x86_64/avx assembler implementation	2012-06-12 16:46:07 +08:00