Tag: llm

  • How to run a GenAI LLM Chatbot locally.

    GenAI Chatbots can be helpful assistants. While they can make up facts and answers, they can answer most questions correctly. You do need to cross check their answers. Most of these bots like ChatGPT from OpenAI require an internet connection. The OpenAI’s free tier uses your questions as training for your bots. You need to…

  • Google introduces Gemini 1.5 Pro with 1 million token context window

    AI LLM models are growing and improving at break neck speed. Google has announced Gemini 1.5 Pro. https://developers.googleblog.com/2024/02/gemini-15-available-for-private-preview-in-google-ai-studio.html Following technique used by Mistral, Google’s latest Gemini 1.5 Pro will use a mix of experts approach to LLM. A query is routed to a smaller expert LLM. This results in faster and more precise response. Gemini…

  • Meta has released 8B and 70B Llama3 LLM model

    Meta has released Llama3 LLM model. https://ai.meta.com/blog/meta-llama-3/ Tech talk from Meta about Llama3 posted on YouTube:https://www.youtube.com/watch?v=r3DC_gjFCSA Its 70B instruct model came up ahead in head to head human evaluation against Claude Sonnet, Mistral Medium and GPT 3.5, and its predecessor llama2. Llama3 improved in reasoning and code generation. Meta has also created web UI to…