LLiMa is an industry-first dedicated integrated framework, or software environment,
developed to run large language models, or LLMs, and generative AI on Modalix, SiMa.ai’s second-generation AI chip.
It plays a key role in smoothly deploying compute-intensive generative AI to resource-constrained edge devices such as robots and drones.
Unlike conventional ChatGPT-style services or large language models that require massive power consumption, LLiMa enables heavy AI models to run smoothly on edge devices with extremely low power consumption of under 10 watts.
LLiMa supports immediate deployment of widely used open-source models, such as Meta’s Llama, as well as customer-customized models.
LLiMa supports not only text-based language models, but also camera-based vision models and multimodal models that combine both language and vision. All models can be run and managed within a single LLiMa environment, without the need to switch between multiple tools.
Dedicated to SiMa.ai’s second-generation chip, Gen 2 Modalix MLSoC
Supports optimization for LLMs, large language models, LMMs, large multimodal models, and GenAI, generative AI
LLiMa seamlessly integrates with Palette™, SiMa.ai’s integrated software platform, allowing users to deploy generative AI in the field through an intuitive drag-and-drop workflow without complex coding.
Ideal for applications that need to understand voice commands and visually recognize their surroundings, such as intelligent robotics, autonomous drones, and advanced smart factories.
With Palette SDK, SiMa.ai’s core software tool for professional developers, complex Physical AI applications can be deployed with ease.
Rather than simply placing an AI model onto a device, Palette SDK allows developers to precisely design the entire workflow pipeline, from processing camera input to controlling devices, using C++ or Python.
The dedicated compiler automatically optimizes the developer’s code for SiMa.ai’s MLSoC hardware architecture, enabling maximum speed and performance while consuming minimal power.
Completed software can be reliably deployed not only on lab PCs, but also directly onto real-world edge devices such as robots, drones, and smart factory equipment. Palette SDK also includes Device Manager, a management tool that allows multiple devices to be controlled at once.
Full support for C++ and Python APIs
Models created with widely used open-source frameworks such as PyTorch, TensorFlow, and ONNX can be imported and used directly without conversion.
Full support for GStreamer (an industry-standard tool for building complex video processing pipelines from camera sensors to AI analysis and display output)
Essential tool provided: chip-specific optimization compiler.
Debugging tools are provided to help detect and resolve errors during development
Supported hardware: With a single installation of Palette SDK, developers can build and control applications for both SiMa.ai’s first-generation chip focused on visual intelligence and the latest second-generation Modalix chip designed to run generative AI and LLM workloads.