Skip to content
Josh Pocock
0:13:14
851
21
6
Last update : 23/08/2024

🤖🦙 Master Ollama Engineer: Your Open-Source AI Coding Sidekick 💻✨

👋 Introduction: Why This Matters for You!

Ever wished for a coding buddy available 24/7? Tired of pricey AI subscriptions? 💰 Ollama Engineer is your answer! This open-source tool, built by the creators of Claude Engineer, lets you harness the power of large language models (LLMs) like Llama 3.1 directly on your machine.

🧰 Setting Up Your AI Assistant

  1. Get Ollama: Download and install Ollama, your gateway to running LLMs locally. (https://ollama.com/)
  2. Choose Your Model: Go for Llama 3.1 (8B parameter version is a good start).
  3. Grab Ollama Engineer: Clone the repository: https://github.com/Doriandarko/claude-engineer.
  4. Install Dependencies: pip install -r requirements.txt (But hold on, we’ll tweak this soon!)
  5. API Keys Ready: Get your keys for Anthropic and Tavily (a great AI search tool!). You can skip Cohere for now.
  6. The Tavily Trick: Uninstall the pre-installed Tavily version and install a specific older version:
  • pip uninstall tavily-python
  • pip install tavily-python==0.3.5
  1. Environment Setup: Create an .env file in your project directory and paste your API keys like this:

    ANTHROPIC_API_KEY=your_anthropic_key
    TAVILY_API_KEY=your_tavily_key
  2. Customize Your Model: In the ollama_engineer.py file, change the model name on line 78 (and around line 81-82) to llama 3.1.

🚀 Launching Ollama Engineer

  • Open your terminal, navigate to your project folder, and run: python ollama_engineer.py

🕹️ How to Use It:

  • Chat Mode: Just like chatting with Claude! Ask questions, get code snippets, or brainstorm ideas.
  • Auto Mode: Ollama Engineer attempts to build entire projects based on your instructions (use with caution – it’s still under development! 🚧).

🤔 Josh’s Take and Pro Tips:

  • Ollama Engineer is promising, but still has rough edges. Don’t expect it to replace seasoned AI coding assistants (yet!).
  • Experiment! Try different Ollama models and see what works best.
  • Start with simple tasks and gradually increase complexity.

🧰 Toolbox for AI-Powered Coding

🚀 Your Challenge!

Try building a simple “Hello World” website with Ollama Engineer. Can you get it to add some HTML and basic styling? Share your experience in the comments!

Other videos of

Play Video
Josh Pocock
0:29:53
858
50
5
Last update : 19/09/2024
Play Video
Josh Pocock
0:15:35
2 326
54
8
Last update : 18/09/2024
Play Video
Josh Pocock
0:18:07
4 051
121
15
Last update : 18/09/2024
Play Video
Josh Pocock
0:15:44
1 673
38
6
Last update : 18/09/2024
Play Video
Josh Pocock
0:17:00
2 310
31
11
Last update : 18/09/2024
Play Video
Josh Pocock
0:22:44
6 077
179
21
Last update : 18/09/2024
Play Video
Josh Pocock
0:32:41
523
20
6
Last update : 18/09/2024
Play Video
Josh Pocock
0:15:38
1 968
69
15
Last update : 18/09/2024
Play Video
Josh Pocock
0:13:10
3 943
150
22
Last update : 18/09/2024