koboldcpp

We have hosted the application koboldcpp in order to run this application in our online workstations with Wine or directly.

Quick description about koboldcpp:

KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. It's a single self-contained distributable that builds off llama.cpp and adds many additional powerful features.

Features:

• Single file executable, with no installation required and no external dependencies
• Runs on CPU or GPU, supports full or partial offloaded
• LLM text generation (Supports all GGML and GGUF models, backwards compatibility with ALL past models)
• Image Generation (Stable Diffusion 1.5, SDXL, SD3, Flux)
• Speech-To-Text (Voice Recognition) via Whisper
• Text-To-Speech (Voice Generation) via OuteTTS
• Provides many compatible APIs endpoints for many popular webservices (KoboldCppApi OpenAiApi OllamaApi A1111ForgeApi ComfyUiApi WhisperTranscribeApi XttsApi OpenAiSpeechApi)
• Bundled KoboldAI Lite UI with editing tools, save formats, memory, world info, author's note, characters, scenarios.
• Includes multiple modes (chat, adventure, instruct, storywriter) and UI Themes (aesthetic roleplay, classic writer, corporate assistant, messsenger)
• Supports loading Tavern Character Cards, importing many different data formats from various sites, reading or exporting JSON savefiles and persistent stories.
• Many other features including new samplers, regex support, websearch, RAG via TextDB and more.
• Ready-to-use binaries for Windows, MacOS, Linux. Runs directly with Colab, Docker, also supports other platforms if self-compiled (like Android (via Termux) and Raspberry PI).

Audience: Advanced End Users, System Administrators, Developers, End Users/Desktop.
User interface: X Window System (X11), Win32 (MS Windows), Web-based, Non-interactive (Daemon), Console/Terminal, Command-line.
Programming Language: Python, C++, JavaScript.
Categories: