Kuwa GenAI OS is an open, free, secure, and privacy-focused AI orchestrating system. Kuwa delivers a user-centric interface for generative AI, facilitating interaction with a wide range of models, agents, executables, scripts, tools, weblets, and applications. The orchestration platform facilitates the integration of multiple models and bots in a no-code or low-code setting, thereby streamlining the execution of sophisticated tasks.
Kuwa offers a comprehensive solution for multilingual, multi-model development and deployment—empowering individuals and businesses to harness generative AI, build applications, launch online stores, and deliver external services across local laptops, on-premise servers, or in the cloud.
In Taiwan’s Siraya language, Kuwa refers to a public hall that served as a gathering place for meetings, discussions, and decision-making.
Here's a summary of Kuwa GenAI OS's features:
Usage Environment:
- Provides a turnkey solution for GenAI, RAG, and agent applications by integrating several popular open-source frameworks and tools into a single, ready-to-use system—such as PyTorch, Ollama, LangChain, n8n, Llama.cpp, MCP, Qualcomm’s SDK, and more.
- Supports multiple operating systems, including Windows, Linux, and macOS, and offers easy installation along with online software update tools—such as a Windows installer, Linux installation script, Docker startup script, and pre-configured virtual machines.
- Supports diverse, distributed, and hybrid hardware environments—from Raspberry Pi, laptops, and PCs to on-premise servers, virtual machines, and public or private clouds—with or without GPU/NPU acceleration.
User Interface:
- An integrated interface allows selection and combination of any models, knowledge bases, agents, or GenAI applications to create single or group chat rooms.
- Chat rooms support human-centric orchestration, enabling users to reference or delete conversations, specify group or individual chats, and switch between continuous and single-turn Q&A modes.
- Users can readily interface with the system, importing prompt scripts or uploading files, and exporting complete chat transcripts as PDF, Doc/ODT, plain text, or shareable web pages.
- Supports text and image generation, as well as multi-modal language models with speech and visual recognition, highlighting syntax for code and Markdown, and quick access to system widgets.
Development Interface:
- Users can create prompt bots, server bots, or agent bots using no-code or low-code tools for personalized or enhanced GenAI applications and workflows. This is achieved by connecting existing models, knowledge bases, or bots/applications, and customizing system prompts, user prompt prefixes, suffixes, and batches.
- Users can easily create their own knowledge bases using a drag-and-drop interface or import existing vector databases, utilizing multiple knowledge bases simultaneously for GenAI applications.
- Users can build and maintain shared application stores, allowing for user-to-user sharing of bot applications.
- Supports Ollama’s modelfile for preset scenarios, prompt templates, fine-tuning and enabling Kuwa extensions, models, and advanced RAG features.
Deployment Interface:
- Supports multiple languages, allowing for customized interfaces and messages before deploying external services.
- Integrates with existing accounts or provides invitation code registration, with email-based password reset functionality.
- System settings allow modification of system announcements, terms of service, disclaimers, as well as group permission management, user management, and model management.
- The dashboard supports feedback management, system log management, security and privacy management, and message retrieval.
Development Environment:
- Integrates various open-source generative AI tools, including Faiss, HuggingFace, LangChain,Llama.cpp, Ollama, vLLM, and various embedding and Transformer packages, enabling developers to download, connect, and develop multi-modal large language models and applications.
- The RAG Toolchain includes DB QA, Document QA, Web QA, and Search QA tools for developing advanced, customized applications by connecting search engines and automated crawlers or integrating existing enterprise databases and systems.
- Open-source code allows developers to customize the system to their specific needs.
- Agent-like bots can be shared via the Kuwa Store, exported as standalone apps, or downloaded and imported from external sources.