Asked about Unsupervised methods in LLM work
How would you find out what users are asking your AI assistant, at scale?
An answer that works
Embed the questions, cluster them with a method that tolerates noise, rank clusters by size and growth, name them from samples with a model, and verify a few by reading. Then compare against what the product was designed for and add the big unexpected clusters to the eval set.
Reading an answer is not being able to give one. The section that teaches this is Unsupervised methods in LLM work, 3 hours of Unsupervised learning.
Learn this properlyAlso asked about Unsupervised learning
You have clustered your customers into five groups. How do you know the groups are real?What does the elbow method actually tell you?What is PCA doing?Why should you not interpret distances in a t-SNE plot?How would you detect anomalies without labelled examples?How do you evaluate clustering when you have no labels?How do you choose the number of clusters?