TOGO
All plugins

ai-crawlee

Go-native site crawler data-source for the togo AI kit

Extends ai

togo install togo-framework/ai-crawlee
togo-framework/ai-crawleeWebsite
Stars0
LanguageGo
License—
Last push2026-06-25
  • ai
  • artificial-intelligence
  • crawler
  • go
  • golang
  • llm
  • plugin
  • togo

Readme

togo-framework/ai-crawlee

Part of the togo framework.

Install

bash

ai-crawlee

A togo AI data-source plugin — crawl a website and extract page text for ai-rag ingest and agents. Crawlee is a Node library; this is a Go-native crawler (colly) serving the same purpose.

togo install togo-framework/ai-crawlee

Use

  • Go: crawlee.FromKernel(k).Crawl(ctx, "https://example.com", 20) → []Page{URL,Title,Text}
  • REST: POST /api/ai/crawlee {"url":"…","maxPages":20}

Part of the togo AI kit. MIT.

Premium sponsors

text

Support togo — become a sponsor.