MARKETPLACE
PLUGINS
OPENAI CHATGPT REAL-TIME STREAMING
OpenAI ChatGPT Real-Time Streaming logo

OpenAI ChatGPT Real-Time Streaming

Published September 2023
   •    Updated this week

Plugin details

Elevate your Bubble.io applications to the next level with our groundbreaking plugin – Real-Time Data Streaming! Say goodbye to waiting for entire blocks of data to be generated, and welcome instant, dynamic content updates that will enhance the user experience like never before, similar to how this shows up for ChatGPT.
Link to the Editor - https://bubble.io/page?name=index&id=credit-third-app

IMPORTANT NOTE:

Please be aware that the streaming functionality is available without any additional server or workload unit costs in Bubble, since these calls are executed on the client-side.

This also means that potential intruders could get a hold of your OpenAI API key making this request thus making it NOT SECURE.

Hence, this plugin is ideal for the use-case where USERS ENTER THEIR OWN OPENAI API KEYS. Reason being, that since they enter their own key, when the request is being made using this plugin, their own key will be visible, but only in their own web session, thus preventing any intruder from accessing the other's API keys.

CUSTOM SOLUTION:

In case any developer wants a secure solution, please do not hesitate to reach out to us at [email protected]. We are offering cloud deployments in order to implement a secure solution for you which otherwise, cannot be natively handled in Bubble.

Free

For everyone

3.2 stars   •   12 ratings
1.7K installs
This plugin does not collect or track your personal data.

Other actions

Platform

Web

Contributor details

Zeroic - India's top product studio logo
Zeroic - India's top product studio
Joined 2021   •   4 Plugins
View contributor profile

Instructions

There are 2 types of elements available
1. GPT Streaming Element: This element takes a single message as an input of role being user. Setup instructions below

(i) Introduce the "GPT Streaming Element" in your page.
(ii) Add the "Generate Output GPT Streaming Element" action in any event (could be a click of a button, or a page load etc) in your Workflow tab.
(iii) Add your API key, select and pass the model in the action, and give the input to it, to which GPT would give you the output later on.
(iv) In the design tab, if you want to refer to the output being streamed, simply insert the dynamic content "GPT's Real-Time Output" in any input or text element.
(v) You are ready! Further enhance the experience by introducing the "A GPT Streaming Element Output Generation Completed" and set actions within it (could be to save the recently generated output).

2. Advanced GPT Streaming Element: This element has various options available. You can pass the JSON of messages to it as an input (with roles being system, user, assistant), the "Frequency Penalty", "Max Tokens", "N", "Presence Penalty", "Temperature", "Top_p". Setup instructions below

(i) Introduce the "Advanced GPT Streaming Element" in your page.
(ii) Add the "Generate Output Advanced GPT Streaming Element" action in any event (could be a click of a button, or a page load etc) in your Workflow tab.
(iii) Add your API key, select and pass the model in the action, and give the messages JSON to it, other optional parameters, to which GPT would give you the output later on.
(iv) In the design tab, if you want to refer to the output being streamed, simply insert the dynamic content "Advanced GPT's Real-Time Output" in any input or text element.
(v) You are ready! Further enhance the experience by introducing the "A Advanced GPT Streaming Element Output Generation Completed" and set actions within it (could be to save the recently generated output).

Types

This plugin can be found under the following types:
Background Services   •   Element   •   Event   •   Action

Categories

This plugin can be found under the following categories:
AI   •   Productivity   •   Technical   •   Visual Elements

Resources

Support contact
Documentation

Rating and reviews

Average rating (3.2)

how it's done !!!
June 25th, 2024
properly explain the steps to be taken
Great plugin, may need some tweaking.
May 29th, 2024
Thank you for all of the hard work with this plugin. It came at the right time and is helping me solve a specific need. However, I ran into issues with trying to use the Generate Advanced GPT Streaming action. For some reason, it would not take my API key, but the normal GPT streaming action did. But so far, so good.
Insecure
April 10th, 2024
If you use this plugin, anyone tech-savvy enough to open dev tools and look through the network tab can get your openai api key from the streaming request's headers.
This is Prashant, the co-founder at Zeroic. Thanks for taking out the time to test our plugin. That's correct, since the request to OpenAI is being made on the client side (for a server side implementation, websockets would be required, which means using a third-party service for deploying a server, or one could use the Data API, but it is workload units intensive and thus, not sustainable). We already had added a "Note" in the plugin description that mentions the same, along with the ideal use-case for using this plugin (where the users using your app would need to provide their own API keys, instead of you as a developer, providing your own API key). Hope that helps you and the other users of our plugin. Feel free to reach out to us if you have any other concerns, questions etc. (plugin author)
April 25th, 2024
  •  
Zeroic - India's top product studio
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
March 2nd, 2024
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
Thank you for your review. However, you might have mistakengly entered your OpenAI key here. Requesting you to remove that from here so that there's no unauthorized usage. Thanks Prashant Abbi Co-founder @ Zeroic (plugin author)
May 29th, 2024
  •  
Zeroic - India's top product studio
Unable Vision API
February 28th, 2024
Bubble