Feature request: merge SD.cpp and Microsoft CPU C++ ONNX Runtime adding ability to use ONNX face restoration models

[JohnClaw]

Microsoft C++ ONNX Runtime for CPU: https://www.nuget.org/packages/Microsoft.ML.OnnxRuntime
ONNX models for face restoration: https://github.com/harisreedhar/Face-Upscalers-ONNX/releases/tag/Models

[JohnClaw]

This also may be useful: https://github.com/hpc203/CodeFormer-onnxrun-cpp-py
https://github.com/xmba15/onnx_runtime_cpp

[Green-Sky]

sd.cpp is based on ggml, not onnx. They are 2 different ml nn frameworks.

[JohnClaw]

Ok. Do you know ONNX cli.exe that can restore faces that were poorly rendered by SD.cpp?

[JohnClaw]

I know that ggml and onnx are different. But how does it matter when we are speaking about post-processing of an already generated image? For example, ggml_module.h of SD.cpp produces a cat.png. Then onnx_module.h of SD.cpp restores cat's face on that cat.png.