Skip to main contentIf you don’t see your question answered here, drop us a line at support@streamstraight.com.
Does Streamstraight store my chat messages for me?
No, Streamstraight does not currently store your chat messages for you. We store the stream of chunks passed to us, each of which represents only part of the full LLM response. We have no knowledge of how the data is chunked before streaming, so we cannot reconstruct the full data. This stream of chunks is stored for 60 minutes before being deleted.
You must process and store the result of the LLM stream yourself, whether on the server or on the client. Streamstraight only helps you stream data from the server to the client; it does not offer a permanent storage solution.
What happens with Streamstraight when my client’s connection is flaky?
Streamstraight uses socket.io and websockets under the hood to guarantee a reliable connection. If a connection is flaky and chunks are dropped or delayed, Streamstraight will buffer and retry. Once the connection reestablishes, Streamstraight will process the buffer and continue tailing the stream.
Streamstraight guarantees that each chunk will be received exactly once, in order.
What happens when my client’s page reloads in the middle of a stream?
If your frontend reloads in the middle of a stream, you must detect that a stream with the given streamId was interrupted and reinitialize Streamstraight in the client. Streamstraight does not connect unless you tell us to; as a result, we do not know if there was a stream in-progress when the page reloaded.
Whether you connect or reconnect to a stream, Streamstraight will replay the stream from the beginning and continue tailing. We do not assume that any already-streamed chunks are already on your client; as a result, we re-stream from the beginning.
How do I stream the same stream to multiple browser tabs?
Streamstraight supports streaming the same stream to multiple different clients (including browser tabs). Depending on how your frontend client’s state is set up, if you connect to Streamstraight with the same streamId from multiple tabs, Streamstraight will provide the same data to both tabs: streaming from the beginning and tailing until the end of the stream is reached.
What happens when I connect on the client before the server stream begins?
If you connect to Streamstraight from the client with a streamId that has not been provided from your server, Streamstraight will block until the stream is available.
What happens if the server stream ends before the client connects?
If the server stream ends before the client connects, Streamstraight persists the contents of the stream for up to 60 minutes. This means that when the client connects, Streamstraight will immediately replay the entire stream from the beginning.