Skip to content
Josh Pocock
0:13:14
851
21
6
Last update : 23/08/2024

🤖🦙 Master Ollama Engineer: Your Open-Source AI Coding Sidekick 💻✨

👋 Introduction: Why This Matters for You!

Ever wished for a coding buddy available 24/7? Tired of pricey AI subscriptions? 💰 Ollama Engineer is your answer! This open-source tool, built by the creators of Claude Engineer, lets you harness the power of large language models (LLMs) like Llama 3.1 directly on your machine.

🧰 Setting Up Your AI Assistant

  1. Get Ollama: Download and install Ollama, your gateway to running LLMs locally. (https://ollama.com/)
  2. Choose Your Model: Go for Llama 3.1 (8B parameter version is a good start).
  3. Grab Ollama Engineer: Clone the repository: https://github.com/Doriandarko/claude-engineer.
  4. Install Dependencies: pip install -r requirements.txt (But hold on, we’ll tweak this soon!)
  5. API Keys Ready: Get your keys for Anthropic and Tavily (a great AI search tool!). You can skip Cohere for now.
  6. The Tavily Trick: Uninstall the pre-installed Tavily version and install a specific older version:
  • pip uninstall tavily-python
  • pip install tavily-python==0.3.5
  1. Environment Setup: Create an .env file in your project directory and paste your API keys like this:

    ANTHROPIC_API_KEY=your_anthropic_key
    TAVILY_API_KEY=your_tavily_key
  2. Customize Your Model: In the ollama_engineer.py file, change the model name on line 78 (and around line 81-82) to llama 3.1.

🚀 Launching Ollama Engineer

  • Open your terminal, navigate to your project folder, and run: python ollama_engineer.py

🕹️ How to Use It:

  • Chat Mode: Just like chatting with Claude! Ask questions, get code snippets, or brainstorm ideas.
  • Auto Mode: Ollama Engineer attempts to build entire projects based on your instructions (use with caution – it’s still under development! 🚧).

🤔 Josh’s Take and Pro Tips:

  • Ollama Engineer is promising, but still has rough edges. Don’t expect it to replace seasoned AI coding assistants (yet!).
  • Experiment! Try different Ollama models and see what works best.
  • Start with simple tasks and gradually increase complexity.

🧰 Toolbox for AI-Powered Coding

🚀 Your Challenge!

Try building a simple “Hello World” website with Ollama Engineer. Can you get it to add some HTML and basic styling? Share your experience in the comments!

Other videos of

Josh Pocock
0:09:28
52
3
0
Last update : 27/02/2025
Josh Pocock
0:14:55
102
6
1
Last update : 20/02/2025
Josh Pocock
0:18:39
91
5
0
Last update : 20/02/2025
Josh Pocock
0:15:31
184
21
2
Last update : 20/02/2025
Josh Pocock
0:11:56
40
6
2
Last update : 12/02/2025
Josh Pocock
0:16:36
0
0
0
Last update : 13/02/2025
Josh Pocock
0:15:32
58
7
0
Last update : 13/02/2025
Josh Pocock
0:16:50
542
27
4
Last update : 13/02/2025
Josh Pocock
0:13:02
67
10
1
Last update : 08/02/2025