Need help to design a tech stack and get started

I need help to choose a tech stack for an application.
It is an application with AI Assistant (an Agent) that reads scripts to users. The Agent should select appropriate script based on user’s input. I am thinking to go either with Mistral-7B-Instruct-v0.2 or llama2 LLM but opened for other suggestions.
The Model should have access to the database to retrieve user’s information and scripts.
What is the best place to host an LLM and build such an application? Which tools shall I use?
Can someone please push me to the right direction.

Thank you!

Hi @Leon Welcome to the Tensorflow Forum ,

As per my understanding These tech stacks for your AI-driven script-reading application is crucial for its performance, scalability, and maintainability.

AI Model Selection: Mistral-7B-Instruct-v0.2 or llama2 LLM ,

Hosting and Infrastructure: Cloud Platforms , Containerization, Serverless Architecture

Database: Relational or NoSQL , Data Security

Frontend Framework: React or Vue.js, Responsive Design

Integration and APIs: RESTful APIs, Authentication and Authorization

Monitoring and Maintenance: Logging and Monitoring, Continuous Integration/Continuous Deployment (CI/CD)

Thank You !

1 Like