Software

LLiMa is an industry-first dedicated integrated framework, or software environment,
developed to run large language models, or LLMs, and generative AI on Modalix, SiMa.ai’s second-generation AI chip.
It plays a key role in smoothly deploying compute-intensive generative AI to resource-constrained edge devices such as robots and drones.

Under 10 Watts Ultra-Low-Power LLM Operation

Unlike conventional ChatGPT-style services or large language models that require massive power consumption, LLiMa enables heavy AI models to run smoothly on edge devices with extremely low power consumption of under 10 watts.

Seamless Integration Flexible Deployment for Any Model

LLiMa supports immediate deployment of widely used open-source models, such as Meta’s Llama, as well as customer-customized models.

Unified Framework An All-in-One Integrated Environment

LLiMa supports not only text-based language models, but also camera-based vision models and multimodal models that combine both language and vision. All models can be run and managed within a single LLiMa environment, without the need to switch between multiple tools.

Additional Specifications and Support
1. Supported Hardware
  • -

    Dedicated to SiMa.ai’s second-generation chip, Gen 2 Modalix MLSoC

2. Supported Models for Optimization
  • -

    Supports optimization for LLMs, large language models, LMMs, large multimodal models, and GenAI, generative AI

3. Development Environment Integration
  • -

    LLiMa seamlessly integrates with Palette™, SiMa.ai’s integrated software platform, allowing users to deploy generative AI in the field through an intuitive drag-and-drop workflow without complex coding.

4. Key Application Areas
  • -

    Ideal for applications that need to understand voice commands and visually recognize their surroundings, such as intelligent robotics, autonomous drones, and advanced smart factories.

With Palette SDK, SiMa.ai’s core software tool for professional developers, complex Physical AI applications can be deployed with ease.

Build Precise Control and Development

Rather than simply placing an AI model onto a device, Palette SDK allows developers to precisely design the entire workflow pipeline, from processing camera input to controlling devices, using C++ or Python.

Optimize Chip-Specific Extreme Optimization

The dedicated compiler automatically optimizes the developer’s code for SiMa.ai’s MLSoC hardware architecture, enabling maximum speed and performance while consuming minimal power.

Deploy Fast Real-World Deployment and Management

Completed software can be reliably deployed not only on lab PCs, but also directly onto real-world edge devices such as robots, drones, and smart factory equipment. Palette SDK also includes Device Manager, a management tool that allows multiple devices to be controlled at once.

Support
1. Supported Programming Languages
  • -

    Full support for C++ and Python APIs

2. Compatible AI Frameworks
  • -

    Models created with widely used open-source frameworks such as PyTorch, TensorFlow, and ONNX can be imported and used directly without conversion.

3. Video Processing Framework
  • -

    Full support for GStreamer (an industry-standard tool for building complex video processing pipelines from camera sensors to AI analysis and display output)

  • -

    Essential tool provided: chip-specific optimization compiler.

4. Debugging Tools for Error Detection
  • -

    Debugging tools are provided to help detect and resolve errors during development

5. Performance Profiler for Visualizing On-Chip Speed and Power Consumption
  • Supported hardware: With a single installation of Palette SDK, developers can build and control applications for both SiMa.ai’s first-generation chip focused on visual intelligence and the latest second-generation Modalix chip designed to run generative AI and LLM workloads.