👋 Introduction: Why This Matters for You!
Ever wished for a coding buddy available 24/7? Tired of pricey AI subscriptions? 💰 Ollama Engineer is your answer! This open-source tool, built by the creators of Claude Engineer, lets you harness the power of large language models (LLMs) like Llama 3.1 directly on your machine.
🧰 Setting Up Your AI Assistant
- Get Ollama: Download and install Ollama, your gateway to running LLMs locally. (https://ollama.com/)
- Choose Your Model: Go for Llama 3.1 (8B parameter version is a good start).
- Grab Ollama Engineer: Clone the repository: https://github.com/Doriandarko/claude-engineer.
- Install Dependencies:
pip install -r requirements.txt
(But hold on, we’ll tweak this soon!) - API Keys Ready: Get your keys for Anthropic and Tavily (a great AI search tool!). You can skip Cohere for now.
- The Tavily Trick: Uninstall the pre-installed Tavily version and install a specific older version:
pip uninstall tavily-python
pip install tavily-python==0.3.5
- Environment Setup: Create an
.env
file in your project directory and paste your API keys like this:
ANTHROPIC_API_KEY=your_anthropic_key
TAVILY_API_KEY=your_tavily_key
- Customize Your Model: In the
ollama_engineer.py
file, change the model name on line 78 (and around line 81-82) tollama 3.1
.
🚀 Launching Ollama Engineer
- Open your terminal, navigate to your project folder, and run:
python ollama_engineer.py
🕹️ How to Use It:
- Chat Mode: Just like chatting with Claude! Ask questions, get code snippets, or brainstorm ideas.
- Auto Mode: Ollama Engineer attempts to build entire projects based on your instructions (use with caution – it’s still under development! 🚧).
🤔 Josh’s Take and Pro Tips:
- Ollama Engineer is promising, but still has rough edges. Don’t expect it to replace seasoned AI coding assistants (yet!).
- Experiment! Try different Ollama models and see what works best.
- Start with simple tasks and gradually increase complexity.
🧰 Toolbox for AI-Powered Coding
- Ollama: https://ollama.com/ (For running LLMs locally)
- Ollama Engineer Repo: https://github.com/Doriandarko/claude-engineer
- Tavily (AI Search): https://www.tavily.com/
🚀 Your Challenge!
Try building a simple “Hello World” website with Ollama Engineer. Can you get it to add some HTML and basic styling? Share your experience in the comments!