AI Application Introduction
Last Version: 2025/09/22
Compatibility Note
- Currently supports only Bianbu Star v2.x (e.g., v2.1.x).
- Bianbu Star V3.x is under development and not yet supported for installation or use.
Prerequisites
- Requires Bianbu Star v2.x (e.g., v2.1.x) with AI Fusion X and necessary dependencies pre-installed.
- For real-time video/audio features, connect an available camera and microphone.
- To run or update models via Ollama, ensure the device has network access.
AI Fusion X
AI Fusion X is a demo application that integrates multiple AI capabilities including
- Computer vision
- Large language models (LLMs)
- Real-time video processing
- Speech recognition
Computer Vision
Uses ONNX Runtime as the inference backend and supports various image processing/recognition algorithms. The app includes sample images for demonstration and also allows users to upload their own images for processing.
Large Language Models (LLM)
The application comes with two built-in LLMs: Qwen and DeepSeek by default (specific versions may change with image updates). Users can interact with these models via a chat interface to perform natural language understanding and generation.
Real-time Video Processing
Three modes are supported for real-time video processing as follows:
- Object detection
- Pose estimation
- Face recognition
Users can freely switch between these modes to explore different scenarios.
Speech Recognition
- Features built-in automatic speech recognition (ASR) that converts recorded audio to text.
- Transcription occurs automatically after recording completion.
Ollama
The system comes with the Ollama
command-line tool pre-installed which is used to manage and run local large language models.
Run the ollama
command view commands and help information.