Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trubrics Integration into DemoGPT #23

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

PBozmarov
Copy link

Hey @melih-unsal, this PR enables you to gather and analyze feedback for the results and sources of the DemoGPT model by integrating the Trubrics SDK. You are then also able to analyse the feedback received through registration on the Trubrics platform.

Setup

To store feedback in your Trubrics account, follow these steps:

  1. Register for a free account with Trubrics here
  2. Input your Trubrics email & password into st.secrets

Preview

Here is an example of gathering and storing feedback using the faces feature for the generated code from DemoGPT.
Screenshot 2023-07-24 at 16 42 19

We have also integrated feedback into the Streamlit app with the generated model:
Screenshot 2023-07-24 at 16 33 56

In the following image, we can see the feedback saved in our Trubrics account.
Screenshot 2023-07-24 at 16 41 42

Useful links

  1. See here for information on how to integrate Trubrics with Streamlit.
  2. Here you can find descriptions of the various feedback types (thumbs, faces, custom text).

We believe it would be fascinating to investigate the possibility of the feedback collector being automatically incorporated into the code when the model is generated, as opposed to being added externally as we did. Please let me know what you think.

If you have any questions, feel free to contact me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant