A quick and bad Raspberry Pi 3 32-bit & 64-bit OpenSSL speed test
And there seems to be, but, this test is very bad in multiple ways. Different versions of just about everything was used (glibc for 32-bit, musl for 64-bit, different gcc versions for building, etc) and also because raspbian is built for armv6 it will loose from the start.
These are just preliminary finds so take them with a grain of salt. Still, interesting...