Syncopat3d t1_it60d8h wrote on October 21, 2022 at 4:35 AM

What are some typical use cases for using TF from C++, other than for inference in a C++ app? For inference, at least in TF1, there was tfcompile, which gives you an artifact (a standalone dynamic library that does inference) that is much more light-weight and easy to integrate into a C++ program than TF.

In TF2, IDK whether tfcompile still exists and works or whether there is something similar.

lennart-reiher-ika OP t1_it6dgi9 wrote on October 21, 2022 at 7:07 AM

I think that inference would still be the main use case, but sure, you could also use it for graph inspection, training, whatever, if you really wanted to.

Looks like tfcompile still exists, but I have never used it myself. Doesn't look to be much better documented than the C++ API itself. The full C++ API of course gives you way more flexibility and doesn't involve this special process of compiling a specific model. We have been pretty happy with our additional wrapper library tensorflow_cpp, allowing us to easily load arbitrary frozen graphs and saved models for inference.