Sept 2023, https://blog.sbensu.com/

For more like this one, see Friction logs

Summary

✅ Best AI product I have tried by a mile!

• OMG. It tells me when it can’t find something and it doesn’t know.
• The answers are usually to the point and don’t have fluff
• The signup flow was smooth
• It is extremely clear when you are using Copilot and how many free queries you have for it
  • The app guides you to it without being annoying

🛑 Bigger bugs:

• When I removed a source from an answer, it said “recomputing” but the source was still there when it sent me back to the answer.
• When you zoom into image results / charts, they might be transparent SVG which look bad

🟨 Some minor bugs:

• Back button works, forward button doesn’t
• When you edit your username, it doesn’t update it in many parts of the screen

🛑 Bigger UI issues:

• The answer is streamed to the client and the client reflows the text as it comes down which makes it very hard to read until it is done. It should just pin the answer to the top of the page and start rendering from there.
• When using Copilot, there is too much space between question and answer, making it hard to read the full-answer, which is often below the fold.
  • “More Copilot uses” doesn’t really tell me what is each a Copilot “use”. I’d change to “query”
  • I can’t tell the difference between “Quick search” and “Searching the web” which seems to be one of main value props of Copilot
• 🛑 After I signed up, it forgot the thread that I had spent half an hour on! Felt like losing a document I worked on.
• I can’t tell which sources the footnotes refer to