AI usage
I run LLMs locally to understand how they work and how I can best leverage it for my clients and users.
Here’s how I’ve used AI:
- Created custom prompts for things like my home network, resume reviews, technical writer assistant, and more.
- Created a Python script that prompted users to fill in the required fields for the homepage template.
- Ran multiple LLMs locally through LM Studio (mostly from the Qwen3 family).
- Replaced GitHub Copilot in VS Code with local LLMs using the Cline extension.
- Developed my portfolio website using Google Bard/Gemini, Claude, GitHub Copilot, and local LLMs.
- Locally hosted SearXNG anonymous search engine in a Docker container and added it as an MCP server so local LLMs can access the internet.
Related work
Webinar: Vibe Coding Your Career: Ed Marsh on Job Searching & Portfolio Development
Kinetic Council, 2026
Webinar: Vibe Coding Your Career: Ed Marsh on Job Searching & Portfolio Development
Kinetic Council, 2026
So, you want to be a technical writer?
Tech Write Pro India, 2025
So, you want to be a technical writer?
Tech Write Pro India, 2025
Webinar: So, you want to be a technical writer?
Content Wrangler webcast, 2024
Webinar: So, you want to be a technical writer?
Content Wrangler webcast, 2024
Tools used
GitHub Copilot
Open-source
GitHub Copilot
Open-source
GPT4All
Open-source
GPT4All
Open-source
LM Studio local AI LLM
Open-source
LM Studio local AI LLM
Open-source
Ollama AI
Open-source
Ollama AI
Open-source
Ollama AI server
Ollama
Ollama AI server
Ollama
Qwen3 large language model family
Alibaba
Qwen3 large language model family
Alibaba
SearXNG search MCP server
SearXNG
SearXNG search MCP server
SearXNG