Llama.cpp C++-to-Csharp wrapper from testedlines.com: C++ docs 1.0.1
Llama.cpp C++-to-Csharp wrapper is a minor extension to Llama.cpp tag b3490 codebase modified a bit by testedlines allowing it to be compiled for and called from Styled Lines Csharp unity asset store package.
|
CAsyncLlamaInfrence | Provides an interface for asynchronous inference operations on a model, such as GPT |
CFileWrapper | Provides static utility functions for saving data to files |
Cgpt_params | |
Cllama_sampling_params | |
CLlamaInfrence | Provides an interface for inference operations on a model, such as GPT (yet any LLama.Cpp compatible with b3212 model would do |
CLoggingContext | Manages callback functions for logging, token processing, and completion events |