LLMs: A Real Use Case
LLMs: A Real Use Case
TLDR: We worked on implementing LLMs, Vector DB, and RAG for elMejorTrato.com. We concluded that:
- Working with Spanish language has its tricks
- ChatGPT API is too costly
- LangChain and agents are sometimes an overkill
- With SentenceBert and a VectorDB, marvelous things can be done
- Quantized open-source LLMs give very good results