JSP-AI-Server™
Your organisation's private local AI server
SaaS environmentOn-premisesManaged service
ⓘ What do the product labels mean?
SaaS environment The solution can be installed in the customer’s own or customer-controlled cloud or SaaS environment.
On-premises The solution can be installed in the customer’s local server or virtual environment.
Managed service We can handle the solution’s maintenance, updates, and technical administration.
How the solution works
JSP-AI-Server™ is an organisation's private local AI server, bringing compute, language models, and supporting services into one managed platform. It can run locally, in the customer's cloud or SaaS environment, or as a hybrid solution.
Key benefits
The server provides local inference, LiteLLM API access, and RAG retrieval with Qdrant. n8n automations, speech recognition, speech synthesis, image generation, and a dashboard for GPU, model, and service management can be enabled as needed. Sensitive tasks can remain local while demanding models are accessed through agreed APIs.
Installation and Commissioning
JSP-AI-Server™ can be delivered pre-installed on a server solution, installed on the customer's existing GPU server or an Apple Silicon Mac mini solution, or deployed in the customer's cloud or SaaS environment. Onboarding includes agreed models, access controls, data sources, backups, and a maintenance approach.
Who the solution is for
For organisations and technical teams that need a managed environment for local models, GPU compute, and AI services.
When comparing options: Choose JSP-AI™ for a shared workspace for conversations, assistants, and organisational materials. Choose JSP-AI-Server™ for managed infrastructure for local models, GPU compute, and AI services.
Discuss JSP-AI-Server™ implementation
Explore other solutions in the Automation and AI category.
Back to JSP-Product™ main page.
Features and technical implementation
Name: ODS (Osmantic Deployment System).
Development: ODS is an Apache 2.0-licensed open-source platform for deploying private AI server infrastructure. Its current stable release is v2.6.0.
Info: ODS brings together local model inference, Open WebUI, LiteLLM, Qdrant, n8n, Whisper, Kokoro, ComfyUI, and a management dashboard. It supports Linux, Windows, and Apple Silicon and detects available hardware to select a suitable model.
Content of delivery: Delivery includes the agreed server or cloud environment, ODS installation, basic model and service configuration, access controls, backups, and documented maintenance.
Price: We charge for hardware or server resources, onboarding, model preparation, integrations, and maintenance. Any external model and API usage fees are charged separately.
Integrations and scope
JSP-AI-Server™ provides AI infrastructure. User conversations, materials, and assistants are delivered with JSP-AI™. Governed agent workflows use JSP-Agents™, and LLM observability uses JSP-AI-Observability™. Access rights, approvals, and policies can be governed with ConfidentialPath™.
