Hello,
I need help to choose a tech stack for an application.
It is an application with AI Assistant (an Agent) that reads scripts to users. The Agent should select appropriate script based on user’s input. I am thinking to go either with Mistral-7B-Instruct-v0.2 or llama2 LLM but opened for other suggestions.
The Model should have access to the database to retrieve user’s information and scripts.
What is the best place to host an LLM and build such an application? Which tools shall I use?
Can someone please push me to the right direction.
Thank you!