Add better CPU (and Intel GPU) support?

[levicki]

Not sure if this pytorch extension was mentioned before (I did a cursory search but didn't find anything).

I have no idea how hard it would be to integrate it (I see it requires a patched pytorch version for some reason, also not sure if that patch landed in later pytorch releases or not).

Optimizations take advantage of AVX-512 Vector Neural Network Instructions (AVX512 VNNI) and Intel® Advanced Matrix Extensions (Intel® AMX) on Intel CPUs as well as Intel Xe Matrix Extensions (XMX) AI engines on Intel discrete GPUs. Moreover, through PyTorch* xpu device, Intel® Extension for PyTorch* provides easy GPU acceleration for Intel discrete GPUs with PyTorch*.

https://github.com/intel/intel-extension-for-pytorch