Summary

🛑 Overall, very buggy.

☠️ Wouldn’t use it again.

Basic interactions crashed without explanation.
Visual elements were randomly empty or repeated
Accept the terms on each topic?

🟨 UX design was very weak

CTAs were confused. “New topic” is more prominent than “Ask another question”
- “New topic” is near the input bar, which should be about this topic
- “Help?” is near Suggested follow ups
Use of accent color is all over the place highlighting everything and nothing at the same time
Big blockers (“Accept the terms”, “You need to log in to continue”) are far away from the thing that they block (the input field), so it is hard to tell how to unblock yourself
Sources are not clear
- It is not clear how the answer used most sources.
- The sources are presented only by domain, which makes it impossible to tell if you want to follow them
Questions and answers are far away and poorly grouped.
Copy is needlessly hidden behind a menú and not useful because of extra “How else can I help you useful?”

🟢 The responses are fairly self-aware. The model sometimes catches itself hallucinating and stops the response dead in its tracks. This increased my confidence in the model

🟨 But way this is implemented is by splicing some strings “The GDP is… Sorry we don’t have that number” which makes the answer confusing to read.

Summary

Raw log