Things I wish someone told me before building my first LLM feature:
Ishaan Reddy
ML Engineer | LLMs, RAG, Python | Shipping AI features that survive production
Things I wish someone told me before building my first LLM feature:
1. Build the eval set before the feature
2. Log every prompt + response from day one
3. Latency matters more than you think: users notice 3s vs 8s
4. The model is rarely the bottleneck; retrieval is
5. Have a plan for when it's confidently wrong
22 reactions3 comments