MARKETPLACE
PLUGINS
LLM WITH STREAMING
LLM with Streaming logo

LLM with Streaming

Published March 2024
   •    Updated this week

Plugin details

This plugin offers a ton of features but the main feature is ability to stream LLM responses to your bubble app with also protecting your LLM API key.
Check out the service page for a full description of all the features:
https://llm-connector-demo.bubbleapps.io/version-test

$55

One time  •  Or  $10/mo

5.0 stars   •   9 ratings
62 installs  
This plugin does not collect or track your personal data.

Platform

Web & Native mobile

Contributor details

Paul G logo
Paul G
Joined 2021   •   1 Plugin
View contributor profile

Instructions

Instructions: Client side:
1. Add Stream Element to bubble page
2. Add  Generate tokens action to a workflow
3. In same workflow, add Call GPT action
4. Populate token and cipher fields with the result of generate tokens action
5. Populate fields in Call GPT action as per the documentation (this is important)
6. Add the event "Stream Complete". This will trigger when GPT has finished and will give you access to the Streamed response" value.

Note 1: if you have stream set to "yes", then you can add this exposed state to any text element or other appropriate element which will take on the value of GPT's streamed response.

Note 2: Using function calling is optional but if you do, you cannot use the stream function. This is a GPT limitation

Note 3: The exposed state "Call cost" is based on the model you are using, the input tokens and the output token. Calculated price is as per the OpenAI pricing documentation. Pricing is in USD

Note 4: Pass through text is documented in the action

Check out the service URL for much more detailed instructions:
https://llm-connector-demo.bubbleapps.io/version-test

Types

This plugin can be found under the following types:
Api   •   Action   •   Background Services   •   Element   •   Event

Categories

This plugin can be found under the following categories:
AI   •   Chat   •   Input Forms   •   Visual Elements

Resources

Support contact
Documentation
Tutorial

Rating and reviews

Average rating (5.0)

Best LLM plugin out there!
January 8th, 2025
This is the best LLM plugin I have tried so far! Whether you are new to LLMs or a pro, the features in the plugin will blow you away. Paul is amazingly helpful at guiding you when stuck and is very responsive on the forum. He has spent a ton of time getting the documentation to be detailed and user friendly. A must-install for anyone using AI in their app!
Highly recommended!
October 30th, 2024
This plugin is absolutely spectacular! It works flawlessly and has significantly enhanced my app's functionality. Paul is always incredibly helpful and friendly, going above and beyond to assist whenever needed. Highly recommended!
Superb plugin with even greater support
September 13th, 2024
Great plugin with some unique capabilities that are crucial to my apps requirements. Developer is lightning fast in responding to queries and super helpful too. Great work!
No brainer Plugin
July 31st, 2024
Only OpenAI powered plugin that has zero bugs ....i've seen one with 1000+ installs that has issues almost all the time. Looking forward to its development
STELLAR. Best of the best
July 17th, 2024
This plugin is absolutely amazing. Plugin author is responsive & trustworthy. If AI is important to your app, this plugin is a no-brainer.
Bubble