SLM in Action Arcee Nova 72B local inference on math and code with Open WebUI and ollama

August 11, 2024
In this video, I run Arcee Nova 72B locally on my Mac with Open WebUI and Ollama. ⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at https://julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️ This is the same 3-bit version I used in https://youtu.be/n42AMXecd_A. I ask the model to explain what the gradient and the hessian are: first the intuition, then the math, then a Python code example. Just a basic one-line prompt. See the result for yourself. Offline work. Full privacy. No inference cost. Remind me why I need ChatGPT again 🤣 Arcee Nova: https://huggingface.co/arcee-ai/Arcee-Nova Open WebUI: https://github.com/open-webui/open-webui Ollama: https://github.com/ollama/ollama #chatgpt #openai #python #ai #llm #slm #ollama #chatbot #opensource

Transcript

The provided transcript is entirely composed of the word "you" repeated multiple times. Since there is no actual content to clean or improve according to the given instructions, the cleaned transcript remains as follows: you you you you you you you

Tags

repetitivemonotonespeechwordyou
← Back to YouTube Overview

About the Author

Julien Simon is the Chief Evangelist at Arcee AI , specializing in Small Language Models and enterprise AI solutions. Recognized as the #1 AI Evangelist globally by AI Magazine in 2021, he brings over 30 years of technology leadership experience to his role.

With 650+ speaking engagements worldwide and 350+ technical blog posts, Julien is a leading voice in practical AI implementation, cost-effective AI solutions, and the democratization of artificial intelligence. His expertise spans open-source AI, Small Language Models, enterprise AI strategy, and edge computing optimization.

Previously serving as Principal Evangelist at Amazon Web Services and Chief Evangelist at Hugging Face, Julien has helped thousands of organizations implement AI solutions that deliver real business value. He is the author of "Learn Amazon SageMaker," the first book ever published on AWS's flagship machine learning service.

Julien's mission is to make AI accessible, understandable, and controllable for enterprises through transparent, open-weights models that organizations can deploy, customize, and trust.