When your enterprise doesn’t use public fashions like OpenAI
Beginning with LlamaIndex is a superb selection when constructing an RAG pipeline. Often, you want an OpenAI API key to observe the various tutorials accessible.
Nonetheless, you would possibly face these conditions:
- Your organization can solely use privately deployed fashions as a consequence of compliance.
- You’re utilizing a mannequin fine-tuned by your information science crew.
- Authorized restrictions stop your organization’s non-public information from leaving the nation.
- Different causes that require utilizing privately deployed fashions.
When constructing enterprise AI purposes, you possibly can’t use OpenAI or different cloud suppliers’ LLM companies.
This results in a irritating first step: How do I join my LlamaIndex code to my firm’s non-public API service?
To avoid wasting your time, for those who simply want the answer, set up this extension:
pip set up -U llama-index-llms-openai-like
This may clear up your drawback.
If you wish to perceive why, let’s proceed.