MARKETPLACE
PLUGINS
AI / LLM TOOLKIT
AI / LLM Toolkit logo

AI / LLM Toolkit

Published April 2023
   •    Updated this month

Plugin details

== USE THE NEW FREE AND OPEN-SOURCE VERSION OF THIS PLUGIN (see marketplace) ==
The best way to build advanced AI/LLM apps!  With built-in response streaming, support for 100+ models, file uploads, web searches, vector storage, chat history management, and more!

Features:

🚫 NO More Waiting: Experience real-time streaming of responses, reminiscent of the official ChatGPT interface. Say goodbye to timeouts and prolonged waits!

💪 Support for 100+ Models: Including OpenAI, Anthropic/Claude, Llama, Mistral, Google Gemini, and more! Unlock unparalleled versatility and scalability for your applications!

🤖 Assistants API with Streaming: Create and use OpenAI Assistants in real-time by streaming your runs. Also supports all other functions of the API.

🧠 Enhanced Memory: Multi-turn conversations made easy with our intuitive message history. Perfect memory that just works.

🛠 Function Calling & API Execution: Supercharge your apps with custom ChatGPT plugins or integrate third-party data sources from APIs.

👁️‍🗨️ Multi-modal support (eg GPT-4o) Elevate your AI experience by integrating GPT-4o, enabling your applications to understand and interpret visual and auditory data alongside text, broadening the scope of interaction and functionality.

⏳ Token Monitoring: Keep an eye on your token consumption for every request you make.

✂ Automatic Truncation: Effortlessly manage messages without worrying about input length.

🛑 Stream Interruption: Regain control and steer the conversation when ChatGPT goes off-course.

🌐 Web Search Capabilities: Built-in web search enables you to extract relevant information from the web in real-time using Google search, or paste URLs/links directly for sites you are interested in.

📂 File Uploads: Seamlessly extract text from uploaded files (.pdf, .pptx, .docx, .csv, and many more types). It's easier than ever to add your own data sources to chats.

📌 Bubble-native Vector Storage & Search: Super-charge your app with "Retrieval Augmented Generation". Introducing Bubble-native embedding vector storage and search, so that you can search through your data without requiring Pinecone, Weaviate, or another third-party vector database service.

🔍 Enhanced Error Handling: With clearer and simpler mechanisms, we've made it easier to troubleshoot and navigate unexpected events.

📌 Custom Headers & bodies: For advanced users, you have full control over the payload and headers of your request.

⚙ Comprehensive API Parameters: Fine-tune your requests using all available parameters, including frequency penalty, presence penalty, and logit bias.

🏠 Custom endpoints Use Microsoft Azure deployments or other hosting providers.

🏠 Self-Hosting: Host your own backend server for complete control over your data.


===================================
   
💡 Endless Possibilities with ChatGPT:
Whether it's crafting chat UIs, answering questions, generating content, evaluating statements, or deep Chain-of-Thought reasoning, the potential uses for ChatGPT are vast and still being explored. Dive into this vast ocean and discover its limitless potentials!

===================================

EDITOR MODE - DEMO APP - RESOURCES

See the overiew page and features here:
🔗 https://chatgpt.launchable.ai/

Inspect sample setups and workflows here:
🔗 https://llm-toolkit-quickstart.bubbleapps.io/version-test

Find the complete documentation here:
🔗 https://launchable-ai.github.io/llm-toolkit-docs/

Watch video tutorials for more ideas and instructions:
🔗 https://chatgpt.launchable.ai/tutorials

Stay updated! For the latest news and updates, check out our discord server:
🔗 https://discord.com/invite/HfjhqcHfh3

To host your own server, head here:
🔗 https://github.com/Launchable-AI/llm-toolkit-backend


If you need help, please get in touch, at: https://launchable.ai/contact

$10

One time

4.5 stars   •   20 ratings
1.4K installs
This plugin does not collect or track your personal data.

Contributor details

Joined 2021   •   3 Plugins
View contributor profile

Instructions

For chat streaming, place a "Data Container" element on your page.  You can use the "Chat Completion" workflow to send a request to an LLM.  You can then set a text element to "AI/LLMToolkit Data Container A's Current Message".  
To use Assistant streaming, place an "Assistants Container" on the page, and use the actions it provides, like "Create Run".

For realtime audio, set an Audio Container on the page.

For more help, see:

- https://chatgpt.launchable.ai/

- the documentation: https://launchable-ai.github.io/llm-toolkit-docs

You will need an OpenAI or OpenRouter API key to use this plugin.  The steps for creating an API key are described on the plugin demo page.

Please note: in some setups, this plugin uses a server to relay requests between OpenAI/OpenRouter and Bubble.  The server is built and maintained by us, Launchable AI.

Types

This plugin can be found under the following types:
Api   •   Action   •   Background Services   •   Element   •   Event

Categories

This plugin can be found under the following categories:
Productivity   •   Technical   •   AI   •   Visual Elements   •   Data (things)

Rating and reviews

Average rating (4.5)
Some good, a lot of frustrating
October 6th, 2024
The plugin has a lot of great features, however the amount of features there are, with very confusing setups makes this plugin frustrating. Trying to understand the assistant setup made my brain hurt, the lack of ability to return function results on your own (The execute function action doesnt cut it). Again, good features, but poor and confusing execution on many
bad customer service, without sample site for reference, unclear toturials
October 5th, 2024
Very poor customer service; after sending several inquiry emails, no one replied. Also, there are no sample websites to refer to. There are a bunch of features, but we don't know how to use them correctly. The tutorial videos are also unclear.
Not RAG Ready!
June 28th, 2024
Specifically, we are trying to use this plugin for RAG AI querying. While in theory, this plug provides this capability, the reality is that it is not ready and does not function correctly. Working with the vendor, I have been unable to get it to work to the point that I would publish it to a live customer. There are issues in constraining the data being referenced and issues simply running the Vector Similarity Search. I believe if these things could be fixed then the general framework would be very powerful.
This plugin saved my AI product
June 7th, 2024
I had a moment of panic when I realized Bubble does not support Streaming for AI products. Then I learned about this Plugin. Oh my goodness, it literally saved my project. The Plugin works really well, and has tons of features. It's clear that lots of thought and care went behind its development. More importantly, the developer himself, Korey, takes great effort in responding to user questions. This gives me confidence that I can trust this Plugin going forward for my project in production. I also just discovered Korey's Discord community. That gives me even more confidence that I can trust this Plugin in production.
Amazing! The best ChatGPT plugin available!
April 9th, 2024
Super flexible plugin with NO long wait times for the API responses! Great plugin support too! It's a no-brainer - well worth it.
Bubble