AI usage

I run LLMs locally to understand how they work and how I can best leverage it for my clients and users.

Here’s how I’ve used AI:

  • Created custom prompts for things like my home network, resume reviews, technical writer assistant, and more.
  • Created a Python script that prompted users to fill in the required fields for the homepage template.
  • Ran multiple LLMs locally through LM Studio (mostly from the Qwen3 family).
  • Replaced GitHub Copilot in VS Code with local LLMs using the Cline extension.
  • Developed my portfolio website using Google Bard/Gemini, Claude, GitHub Copilot, and local LLMs.
  • Locally hosted SearXNG anonymous search engine in a Docker container and added it as an MCP server so local LLMs can access the internet.

Related work

So, you want to be a technical writer?

Tech Write Pro India, 2025

Webinar: So, you want to be a technical writer?

Content Wrangler webcast, 2024

Tools used

    GitHub Copilot

    Open-source

    GPT4All

    Open-source

    LM Studio local AI LLM

    Open-source

    Ollama AI

    Open-source

    Qwen3 large language models

    Alibaba