Posts

All the articles I've posted.

• Text Streaming in AI Interfaces: Understanding Real-Time Content Generation

  Published:Dec 15, 2024

  Streaming in AI Interfaces is important and it creates an illusion of natural communication

  AILLM

• LLM Prompt Routing: The Strategic Key to Scaling AI Applications

  Published:Dec 10, 2024

  Prompt routing is an intelligent dispatching mechanism

  LLMAIPrompt Engineering

• Forcing a LLM to operate Safe

  Published:Dec 4, 2024

  Imagine building an app for children. Topic safety is very important.

  AIAI Safety

• How to run a LLM in your Laptop

  Published:Sep 18, 2024

  LLMs can be quantized and be fit in your laptop's GPU. Really!

  AI

• Building an Offline AI tool in your browser

  Published:Jul 4, 2024

  AI tools in your browser.

  AIBrowser

• On Device AI

  Published:Jul 4, 2024

  On-device AI presents a compelling opportunity for businesses to achieve cost savings alongside the well-established benefits of AI.

  AI