Skip to content

Token Management

Eliran Wong edited this page Jan 6, 2024 · 4 revisions

Token Management

Pricing, charged by OpenAI / Google, is affected by token usage. You may want to have better control over token usage.

Check Token Count

You can check token count for the current message chain:

  1. Manually, by pressing keyboard combo "escape + c"

  2. Dynamically (real-time), by enabling "dynamic token count" via action menu [Remarks: This feature may cause some delay for typing on low-end devices]

Related Settings

Enter a blank entry to open the action menu for changes in related settings.

You can:

  • select a right model, with a particular token limit

  • customise maximum output tokens

  • customise minimum output tokens

token_mx

Disable unused plugins

Plugins with function calling contribute to the token count. You may disable unused plugins to reduce token usage.

Read https://github.com/eliranwong/letmedoit/wiki/Plugins-%E2%80%90-Overview#enable--disable-individual-plugins

Chat-only Feature

Consider to use Chat-only Features when you only want to chat and don't need to execute computing tasks.

Read https://github.com/eliranwong/letmedoit/wiki/Chat%E2%80%90only-Features

Installation

Installation
Installation on Android
Install a Supported Python Version
Install ffmpeg
Android Support
Install LetMeDoIt AI on Android Termux App Automatic Upgrade Option

Video Demonstration

Video Demo

Basics

Quick Guide
Action Menu
ChatGPT API Key
Use GPT4 Models
Google API Setup
ElevenLabs API Setup
OpenWeatherMap API Setup
Run Local LLM Offline
Token Management
Command Line Interface Options
Command Execution
Chat-only Features
Developer Mode
Save Chart Content Locally
Work with Text Selection
Work with File Selection
System Tray
Custom Key Bindings

Selective Features

Examples
Features
Change Assistant Name
Setup Multiple LetMeDoIt Assistants
Memory Capabilities
Data Visualization
Analyze Files
Analyze Images
Analyze Audio
Google and Outlook Calendars
Python Code Auto‐heal Feature
Integration with AutoGen
Integration with Google AI Tools
Integration with Open Interpreter
Speak to LetMeDoIt AI
LetMeDoIt Speaks
Speak multi‐dialects
Create a map anytime
Modify your images with simple words
Work with Database Files
Create a Team of AI Assistants
Search and Load Chat Records
Search Weather Information
Search Financial Data
Social Media

Plugins

Plugins ‐ Overview
Plugins - How to Write a Custom Plugin
Plugins ‐ Add Aliases
Plugins ‐ Input Suggestions
Plugins ‐ Install Additional Packages
Plugins ‐ Predefined Contexts
Plugins ‐ Transform Text Output
Plugins ‐ Work with LetMeDoIt AI Configurations
Plugins ‐ Function Calling
Plugins ‐ Run Codes with Specific Packages
Plugins ‐ Work with Non‐conversational Model
Plugins ‐ Integrate Text‐to‐speech Feature
Plugins ‐ Integrate Other Shared Utilities

Comparison

Compare with ChatGPT
Compare with Siri and Others

Clone this wiki locally