ai-crawlee
Go-native site crawler data-source for the togo AI kit
يمتدّ من ai
togo install togo-framework/ai-crawleeالنجوم0
اللغةGo
الرخصة—
آخر تحديث2026-06-25
- ai
- artificial-intelligence
- crawler
- go
- golang
- llm
- plugin
- togo
اقرأني
togo-framework/ai-crawlee
Part of the togo framework.
Install
bash
ai-crawlee
A togo AI data-source plugin — crawl a website and extract page text for ai-rag ingest and agents. Crawlee is a Node library; this is a Go-native crawler (colly) serving the same purpose.
togo install togo-framework/ai-crawlee
Use
- Go:
crawlee.FromKernel(k).Crawl(ctx, "https://example.com", 20)→[]Page{URL,Title,Text} - REST:
POST /api/ai/crawlee{"url":"…","maxPages":20}
Part of the togo AI kit. MIT.
Premium sponsors
text
Support togo — become a sponsor.