Skip to content

Latest commit

 

History

History
1009 lines (546 loc) · 23.9 KB

latest_changes.md

File metadata and controls

1009 lines (546 loc) · 23.9 KB
Raw
  • extra server port configuration for gui backend

0.6.14-0.6.16

  • added support of Anthropic Claude 3.5 Sonnet

  • added support of custom Azure model list

0.6.11-0.6.13

  • added "Researches" submenu to system tray

  • improved CLI options

  • improved GUI functionalities

  • improved handling of multiple keys in the same backend

  • fixed setting max tokens of chatgpt models via api client

0.6.9-0.6.10

  • support Gemini 2.0 models via GenAI SDK

0.6.7-0.6.8

  • fixed using Azure AI as backends

  • fixed image creation tools

0.6.6

  • fixed API client error message

0.6.5

  • fixed AutoGen tools using GitHub API Keys

0.6.0-0.6.4

  • added support of backend OpenAI models via Github API keys or Azure API keys

  • improved cli options

0.5.91-0.5.99

  • added Desktop Assistant GUI in full version

  • changed tool name execute_computing_task to task

  • added setup menu tmsetup -m

  • Enhanced fabric integration. Added CLI options --chatpattern and --searchpatterns for ToolMate AI to use fabric pattern as chat system message. https://github.com/eliranwong/toolmate/blob/main/package/toolmate/docs/Fabric%20Integration.md This feature uses AI model assigned in ToolMate AI backend, rather than the default model set up in fabric.

  • fixed tm -py

0.5.85-0.5.90

  • enhanced integration of AutoGen agents in tools: proxy, group, agents, captain, examine_files, examine_web_content

  • fixed saving autobuilder configs

  • support use of bing api key and rapid api key for use with AutoGen captain agent

  • document about captain agent setup

  • fixed viewing server information when backend is set to chatgpt

0.5.82-0.5.84

  • changed tool name create_agents to agents

  • changed command name tmteam to tmagents

  • changed command name tminternet to tmonline

  • simplified some tool names

  • added code execution ability to tool "create_agents"

  • added config options for AutoGen parameters

  • fixed repetitive download of nltk modules on startup

0.5.76-0.5.81

  • support use of image tools with api_client

  • support non-chatgpt backends to use autobuild tool

  • added downloading nltk packages for running unstructured package

  • added group chat options to api client cli

  • fixed auto code correction feature

  • fixed display of auto code correction results with vertexai as backend

  • fixed autogen tools

  • fixed selecting google ai, vertex ai and xai models in interactive mode

0.5.75

  • support the latest structured output feature, offered by Ollama version 0.5.0+. Users need to upgrade Ollama to version 0.5.0+, to work with Toolmate AI.

  • unload ollama previous model when ollama model is changed

0.5.68-0.5.76

  • updated dependencies

  • added configurable command shortcuts tms1, tms2, tms3, ... tms20, for running with custom chat system messages

  • added configurable command shortcuts tmt1, tmt2, tmt3, ... tmt20, for running with particular tools

0.5.57-0.5.67

  • improved support of ollama

  • improved handling of code execution

  • implemented risk assessment agent in api client

  • added backend and model options to api client

  • skipped some plugins if no internet connection

0.5.56

  • Support Llama.cpp server on Lite version and running on Android

0.5.28-0.5.55

  • Improved api server and client

  • Added cli tmsetup for setup, check tmsetup -h for options

  • backend llama.cpp changed to be extra module for installation

0.5.23-0.5.27

  • enhanced API server and client features, check toolmate -h, tm -h, tmc -h for options

  • fixed use of default tool

  • fixed running python code

0.5.15-0.5.22

  • added an API server, toolmateserver

  • added an API client, toolmateclient; tm and tmc are aliases to toolmateclient; tmc enables chat feature by default.

0.5.10-0.5.14

  • support custom config file when launched, via -c argument

  • .favourite action renamed to .like

  • added command toolmatelite to full version

0.5.03-0.5.09

  • supports Google AI Studio API key

  • renamed package toolmate_android to toolmate_lite

0.5.02

  • added a combination for inserting the best-liked entry

  • a few changes on default key combination, enter .keys for more information

  • a few tweaks

  • reload plugins after changing the tool-selection agent setting

0.4.94-0.5.01

  • improved use of backends Mistral AI and Gemini

  • improved use of system messages

  • improved a few plugins

  • validate extracted parameters for tool calling

  • fixed code generation with Mistral AI backend

  • a few fixes

  • added @search_conversation tool running on Android Termux

0.4.89-0.4.93

0.4.88

  • added support of using Grop cloud API keys for running tool perplexica

0.4.81-0.4.87

  • added support using Android built-in text-to-speech

  • change directory to the most recently saved conversations when users run .open action.

  • added tool @uniquebible_web

0.4.75-0.4.80

  • added action menu item .last, to open the previously saved conversation.

  • fixed loading action menu on Android

0.4.73-0.4.74

  • added my favourite string, inserted when users press ctrl+b

  • added action command .favourite for users to customise my favourite string

  • support customisation of the default tool when tool-selection agent is not enabled and a tool is not specified in a request. Enter .tools to customise.

0.4.68-0.4.72

  • improved integration with uniquebible app

  • support api to retrieve bible data

0.4.46-0.4.67

  • improved Android support

0.4.45

  • fixed loading agents with Ollama and Llama.cpp

0.4.44

  • updated groqchat

0.4.43

  • fixed reflection tools

  • automatically saved workflow with save, save as, and export

  • added ".workflow" to display the current workflow

  • added ".shareworkflow" to share the current workflow on Android

  • action item ".workflow" in action menu to display current workflow

0.4.40-0.4.42

  • integration with bible tools [optional]

0.4.35-0.4.39

  • added a bundle of Android-only tools:

@show_location @show_connection @start_recording @stop_recording @phone_call @play_media @search_contacts @take_photo @selfie @read_sms @send_sms @send_email @send_whatsapp @share @share_file

0.4.34

  • set tool_selection_agent to False by default

0.4.35

  • added commentary suggestions

0.4.32

  • added a tool @share to share generated result to other apps in Android.

0.4.22-0.4.31

  • added commentary integration in bible tool

0.4.21

  • fixed custom system messages suggestion

  • fixed clipboard tools on Android

  • ".txt" extension added to exported conversation by default

0.4.20

  • automatically check if termux:api is enabled

0.4.17-0.4.19

  • added Android tools @share_file, @send_email, @send_whatsapp, @add_calendar_event, @open_browser

  • added Android actions .timer, .alarm

0.4.14-0.4.16

  • fixed Dalle tools on running on Android

0.4.13

  • updated plugin search searxng, so that it works on both full version and lighter Android version.

  • added item .maxonlinesearches to action menu, for users to customise the maximum number of online search results to be retrieved.

0.4.13

  • update input suggestions after changes made to plugin selection

0.4.12

  • support access to local server installed outside a container running on the same machine.

0.4.11

  • added tool perplexica

0.4.09-0.4.10

  • added plugins for audio analysis and transcription

0.4.08

  • tweaked plugin fabric

  • updated help store

0.4.07

  • minor tweaks for Android

0.4.06

  • added two tools o1 and o1_mini to use reasoning model o1-preview and o1-mini

0.4.04-0.4.05

  • added support of single-turn system message for chat conversation

  • integrated predefined chat system messages and contexts with tool @chat

0.4.03

  • updated ollama model list

0.4.02

  • updated chatgpt model list

0.3.92-0.4.01

  • fixed plugin create ai assistants

  • added support optional modules for installation:

gui install additional GUI library for running gui system tray and experimental desktop assistant

pip install --upgrade toolmate[gui]

linux install additional packages for Linux users, i.e. flaml[automl], piper-tts, pyautogen[autobuild]

pip install --upgrade toolmate[linux]

bible install additional packages for working with bible tools

pip install --upgrade toolmate[bible]

0.3.91

  • support multiple Open Weather Map API keys

0.3.90

  • support multiple Elevenlabs API keys

0.3.89

  • simplified the plugin read aloud

0.3.87-0.3.88

  • added support of Vosk Speech Recognition Toolkit for speech recognition

  • added support of edge-tts for speech generation

0.3.83-0.3.86

  • supports Python 3.12.x

0.3.82

  • updated help store

0.3.81

  • added tool @termux in toolmate_lite version

  • support install full version toolmate on Android

0.3.79

  • fixed plugin search_searxng

Version 0.3.76-0.3.78

  • created Android package toolmate_lite

  • updated documentations

Version 0.3.75

  • added instructions to install Ollama on Android

  • tweaked plugin search searxng

Version 0.3.74

Added tool aliases for @search_searxng categories:

  • @apps Search for information online in the 'apps' category.

  • @files Search for information online in the 'files' category.

  • @general Search for information online in the 'general' category.

  • @images Search for information online in the 'images' category.

  • @it Search for information online in the 'it' category.

  • @lyrics Search for information online in the 'lyrics' category.

  • @map Search for information online in the 'map' category.

  • @music Search for information online in the 'music' category.

  • @news Search for information online in the 'news' category.

  • @packages Search for information online in the 'packages' category.

  • @qna Search for information online in the 'questions_and_answers' category.

  • @radio Search for information online in the 'radio' category.

  • @repos Search for information online in the 'repos' category.

  • @science Search for information online in the 'science' category.

  • @scientific_publications Search for information online in the 'scientific_publications' category.

  • @social_media Search for information online in the 'social_media' category.

  • @software_wikis Search for information online in the 'software_wikis' category.

  • @translate Search for information online in the 'translate' category.

  • @videos Search for information online in the 'videos' category.

  • @web Search for information online in the 'web' category.

  • @wikimedia Search for information online in the 'wikimedia' category.

Version 0.3.73

Version 0.3.68-0.3.72

  • added an alias internet to point to @search_searxng

  • updated Ollama model list

  • updated documentations

  • minor tweaks

Version 0.3.67

  • added plugin search searxng

  • updated help store

Version 0.3.66

Updated Grop model lists

Added plugins:

  • analyze images with Groq

  • ask tavily

  • search tavily

Version 0.3.61-0.3.65

  • unload Llama.cpp model on exit

  • support Lllam.cpp to use additional chat model

  • updated help store

Version 0.3.58-0.3.60

  • fixed dynamic token count feature for chatgpt and letmedoit mode

  • added ui to specify context window size and gpu layers

  • tweaked using Ollama models

Version 0.3.57

  • fixed loading Ollama models

Version 0.3.55-0.3.56

  • added ToolMate AI icon

  • fixed image-related plugins

  • fixed plugin "ask gemini"

  • rebuilt help vector store

Version 0.3.54

  • added a help vector store for searching documentations

  • added a tool @help to search for offline documentations

Version 0.3.53

  • prompt confirm chaning embedding model

Version 0.3.52

  • fixed loading Ollama models for embedding

Version 0.3.51

  • support RAG utilities in GUI

Version 0.3.50

  • support Ollama models for embedding

Version 0.3.49

  • updated RAG utilities

  • updated dependencies

Version 0.3.48

  • added risk assessment agent to safeguard from running harmful system command.

Version 0.3.47

  • added gui support to a few plugins

Version 0.3.46

  • unload Ollama model when a chat session is finished or the app exits.

  • updated two Ollama plugins

Version 0.3.44-0.3.45

  • enhance Tool Selection Agent, read Tool Selection Agent

  • Added an option for tool selection configurations, i.e.:

Would you like to inform the Tool Selection Agent of each tool's requirements? Doing so could improve the selection outcome, but it will consume more tokens and processing power.

  • maintain backward compatibility to LetMeDoIt mode

  • optimised tool @recommend_tool

Version 0.3.42-0.3.43

  • get rid of old tool selection code to make launching faster

Version 0.3.41

  • implemented the new tool selection agent to all other backends

  • check backward compatibility of letmedoit mode

Version 0.3.40

  • brand new tool selection agent

  • implemented the new tool selection agent to Groq backend

Version 0.3.39

  • updated Ollama model list

  • gui development in progress

Version 0.3.36-0.3.38

  • testing gui in developer mode

  1. Run toolmate

  2. Enable Developer Mode, by entering .toggledeveloper

  3. Run toolmateai

  4. Select Desktop Assistant [experimental] from the system tray.

This is a raw one, not yet ready for production.

Version 0.3.35

  • added tool @create_image_flux to create images with Flux.1.

Running Flux models locally requires GPU support, read GPU Acceleration

Version 0.3.34

  • added tool @create_image_imagen3 to create images with Google Imagen 3 via Vertex AI.

For set up of Vertex AI Credentials, read https://github.com/eliranwong/toolmate/blob/main/package/toolmate/docs/Google%20Cloud%20Service%20Credential%20Setup.md

Version 0.3.31-0.3.33

  • Improved tool descriptions

Version 0.3.29-0.3.30

  • added tool @recommend_tool to help users to find an appropriate tool

Version 0.3.28

  • added special entry - Enter @ to read brief descriptions of all enabled tools.

  • fixed fabric plugin

Version 0.3.27

  • fixed chat feature

Version 0.3.26

  • added save as and export features

Version: 0.3.25

Version: 0.3.24

  • custom tool system message and chat system message

Version: 0.3.23

  • fixed install on macOS, pysqlite3 failed the installation, as it is required by pyautogen[autobuild]

Version: 0.3.22

  • fixed loading reflection plugin

Version: 0.3.21

  • fixed depencdency versions for installation

  • fixed link to Reflection Agents documentation

Version: 0.3.20

Version: 0.3.19

  • added tool @reflection to mimic the reflection feature performed by the LLM Reflection:70b This tool is created to work with any LLM

Version: 0.3.18

  • updagrade a few dependencies

  • downgrade elevenlabs version to 1.5.0, to avoid a pydantic warning

Version: 0.3.17

  • renamed old data directory freegenius to toolmate, to facilitate migration

Version: 0.3.16

FreeGenius AI has been renamed to ToolMate AI. For the latest developement, read https://github.com/eliranwong/toolmate

Version: 0.3.14-0.3.15

  • removed triton==2.3.0 from requirements.txt, for Windows users, read

  • updated a few package versions

Version: 0.3.13

Version: 0.3.10-0.3.12

  • Updated documentation

  • Added an option config.enable_tool_screening_agent to enable / disable tool-screening agent.

  • Added an option config.tool_selection_agent to enable / disable tool-selection agent.

Version: 0.3.09

  1. Added Gemini model options: "gemini-1.0-pro-001", "gemini-1.0-pro-002", "gemini-1.5-flash-001", "gemini-1.5-pro-001 (Default)"

  2. Sorted auto suggestions

Version: 0.3

  1. Fixed Running tool calling with Gemini models

  2. Changed default models for backend llamacpp:

  • tool - MaziyarPanahi/WizardLM-2-7B-GGUF/WizardLM-2-7B.Q4_K_M.gguf
  • chat - bartowski/Meta-Llama-3.1-8B-Instruct-GGUF/Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf

Version: 0.3.07

  • Updating documentation ...

Version: 0.3.06

  • Improved relative date conversion
  • Updated Ollama model list

Version: 0.3.05

Fixed tools @command, @append_command, @fabric and @append_fabric

Version: 0.3.02-0.3.04

Added three tools:

convert_relative_datetime to convert relative dates and times in writing

add_google_calendar_event to add Google calendar event

add_outlook_calendar_event to add Outlook calendar event

Removed tool add_calendar_event

Version: 0.2.98-0.3.01

Added two tools:

copy_to_clipboard copy text to the system clipboard

paste_from_clipboard paste text from the system clipboard

Version: 0.2.98-0.3.00

Removed items .code and .run from action menu.

Added two tools:

extract_python_code extract python code, enclosed by ```

execute_python_code extract and run python code, enclosed by ```

Version: 0.2.97

Fixed input suggestion plugin

Version: 0.2.96

Removed item .content from action menu.

Added a tool list_current_directory_contents to list current directory contents.

Version: 0.2.95

Support tool without given prompt.

Read more at https://github.com/eliranwong/freegenius/blob/main/package/freegenius/docs/Running%20Multiple%20Tools%20in%20One%20Go.md#work-on-generated-response-from-previous-tool

Version: 0.2.94

Fixed built-in text editor

Version: 0.2.93

Fixed startup

Version: 0.2.92

Now able to save changes after editing assistant previous response.

Version: 0.2.91

  1. Improved plugin fabric

  2. Added config item fabricPath. Users can customise fabric path by editing its value in config.py.

  3. Added two new tools:

@append_instruction - append assistant previous response to the newly given prompt.

@improve_writing - improve writing of the given prompt

Version: 0.2.90

  1. Added two new tools:

@command Execute the given command

@append_command Append assistant previous response to the given command and execute.

@command echo "Hello World!"
@append_command echo

These new tools work with multiple tools in a single prompt.

For an example, to integrate fabric with other FreeGenius AI tools, you may do something like this:

@command /home/ubuntu/go/bin/fabric -m gemini-1.5-pro -p write_essay "What is machine learning?"
@append_command /home/ubuntu/go/bin/fabric -m llama3.1:latest -p extract_wisdom
@append_command /home/ubuntu/go/bin/fabric -m mistral-large:123b -p summarize
gemini Explain it to a five-year kid
chatgpt Translate it into Chinese
  1. Created two aliases:

@fabric -> @command fabric

@append_fabric -> @append_command fabric

The aliases were added in the plugin fabric.py

from freegenius import config
config.aliases["@fabric"] = "@command fabric"
config.aliases["@append_fabric"] = "@append_command fabric"
config.inputSuggestions += ["@fabric", "@append_fabric"]

Users may further customise, e.g. changing the fabric path, etc.

Version: 0.2.89

Fixed improve input entry feature.

Version: 0.2.88

  1. Added plugins ask_chatgpt, ask_codey, ask_gemini, ask_groq, ask_llama3_1, ask_llamacpp, ask_llamacppserver, ask_ollama, ask_palm2 to call different chatbots for collaboration. For example, with support of running Multiple Tools in Single Prompt, you can do something like:
@chat What is the future of AI development?
chatgpt What is your opinion?
gemini What do you disagree?

Or

llama3_1 Write code to extract mp3 audio from YouTube video
codey Review the code generated above
  1. Suspended features in previous version resume:
  • Let me Translate feature with pre-defined context
  • improved writing feature
  • forcing the app to always search_google

Version: 0.2.87

  1. Added initial support multiple-step actions in a single prompt.

Examples of Use Cases:

Guided Step-by-step Responses for Detailed Research

To guide your chosen LLM to provide you with a step-by-step response, for example:

@chat What is narrative therapy? 
@chat How does it compare to other popular counselling approaches? 
@chat Tell me pros and cons of this approach? 
@chat Give me theories that support this approach in detail. 
@chat Any controversies about it? 
@chat Give me a summary of all your findings above.

Multiple Computing Tasks in Order

To guide FreeGenius AI to perform multiple computing tasks in order.

For example, download two more songs from YouTube and play all downloaded mp3 files with VLC player:

@download_youtube_audio https://youtu.be/KBD18rsVJHk?si=PhfzNCOBIj7o_Bdy 
@download_youtube_audio https://www.youtube.com/watch?v=gCGs6t3tOCU
@task Play all the mp3 files in folder `/home/ubuntu/freegenius/audio` with command `vlc`

Tool and Chat Feature Integration

To integrate multiple tools and chat features in a single prompt, for example:

@search_google Latest updates about OpenAI in 2024 
@chat Give me a summary 
@send_gmail Email your findings to [email protected] in detail
  1. The following features are temporarily suspended to facilitate the development of the Multiple Tools feature:
  • Let me Translate feature with pre-defined context
  • improved writing feature
  • calling different chatbots from the main session
  • forcing the app to always search_google

They may be added back or changed in coming updates

  1. Special entry @none introduced in the last version is now changed to @chat. It means for chat-only feature without using a tool.

  2. Plugin send_email is changed to two separate plugins send_gmail and send outlook. Their corresponding entries are:

@send_gamil
@send_outlook
  1. Added two plugins download_youtube_video and download_youtube_audio, previously integrated into plugin download_web_content. Their corresponding entries are:
@download_youtube_video
@download_youtube_audio

Version: 0.2.86

  1. Use @ to call a particular tool (inspired by Google Gemini App)

Changed tool calling pattern from [TOOL_{tool_name}] to @{tool_name}

Currently supported tools:

@search_google @add_calendar_event @examine_audio @examine_files @examine_images @examine_web_content @correct_python_code @chat @build_agents @create_image @create_map @create_qrcode @create_statistical_graphics @datetimes @download_web_content @edit_text @task @install_python_package @save_memory @search_memory @modify_images @open_browser @pronunce_words @remove_image_background @search_conversations @load_conversations @search_finance @search_news @search_sqlite @search_weather @send_email @send_tweet

To disable tool in for a single turn, use @none.

Tips: Enter @ to get input suggestions of available tools

  1. Removed the improved writing feature temporarily, will be added as a separate tool next update