Posts

Building linfer: A Rust-Based LLM Inference Engine

Why Build Another Inference Engine? When I started working with large language models locally, I quickly ran into the usual suspects: slow inference times, memory bloat, and dependency hell. Most existing solutions are either too heavyweight (PyTorch with CUDA) or too opinionated about model formats. So I built linfer — a Rust-based local LLM inference engine that’s 3x faster than comparable solutions for CPU inference. The Core Problem Running LLMs locally on CPU is painful: ...

What I Learned Solving 200+ Competitive Programming Problems

The Journey I started competitive programming in 2021 with zero algorithmic knowledge. Fast forward to today: 200+ problems solved across Codeforces, LeetCode, CodeChef, and AtCoder. This isn’t a “how I became red on Codeforces” story. I’m still grinding through Div 2 problems. But I’ve learned a lot about problem-solving, pattern recognition, and how to think algorithmically. Here’s what actually stuck. 1. Most Problems Are Variations of ~20 Patterns After solving 50 problems, I thought every problem was unique. After 200, I realized they’re all remixes. ...

Running LLMs Locally on Arch Linux — No Cloud, No Ollama

Why I Built This Instead of Using Ollama I wanted to run AI models locally on my Arch Linux laptop — privately, offline, with zero cloud dependency. Ollama seemed like the obvious choice, but I didn’t want an opaque, heavy framework. I wanted control. After navigating outdated documentation and breaking changes, I got llama.cpp running with Vulkan GPU acceleration on my Intel Iris Xe. This is the guide I wish I had. ...

How to Add GitHub Copilot and Kiro to CLIProxyAPIPlus

Guide based on CLIProxyAPIPlus v6.9.1-0-plus · Commands may vary in future versions. Connect two powerful AI providers — GitHub Copilot and Kiro AI — to your self-hosted CLIProxyAPIPlus instance in minutes using OAuth device flow authentication. Prerequisites Before you begin, make sure you have the following in place: Requirement Details CLIProxyAPIPlus Running via eceasy/cli-proxy-api-plus:latest GitHub Copilot subscription Individual, Business, or Enterprise AWS Builder ID or Kiro IDE For Kiro AI login Docker Installed and accessible in your shell Verify your container is running before proceeding: ...