/tldr [since] summarizes the messages in the channel it is run in that the caller has not been summarized yet, using a small local model on Ollama, and replies ephemerally. The answer streams into the reply as it is written. - Per-user, per-channel cursor (tldr_cursors) so each run picks up where the last left off; `since:` (e.g. 6h, 2d, max 7d) peeks without moving it. First use covers the last 24h, and a stale cursor never reaches back more than 7 days. - Only summarizes channels both the caller and the bot can read. - The transcript drops bots, system messages, reactions and filler, turns links, GIFs, images and files into short tags ([link: site], [image], [file: name], preview titles), marks replies, and writes a date marker where the chat paused for 3h or more so the model can keep topics apart. - The prompt asks for one bullet per conversation, oldest first, with a worked example; it was tuned against a synthetic chat and a real export with qwen3:4b-instruct-2507 (the default model). - One model call at a time across the bot, one /tldr per user. - docker-compose: Ollama service (CPU only, 8g memory cap: 6g killed the runner mid-request), model pull on startup. Needs the tldr_cursors migration (velox-dashboard-api 000016). Co-Authored-By: Claude Opus 5.5 <[email protected]>
24 lines
513 B
Go
24 lines
513 B
Go
package tldr
|
|
|
|
import (
|
|
"context"
|
|
|
|
"velox-bot/internal/db/repos/tldrrepo"
|
|
)
|
|
|
|
type Service struct {
|
|
repo *tldrrepo.Repo
|
|
}
|
|
|
|
func New(repo *tldrrepo.Repo) *Service {
|
|
return &Service{repo: repo}
|
|
}
|
|
|
|
func (s *Service) GetCursors(ctx context.Context, userID, guildID int64) (map[int64]int64, error) {
|
|
return s.repo.GetCursors(ctx, userID, guildID)
|
|
}
|
|
|
|
func (s *Service) SetCursors(ctx context.Context, userID, guildID int64, cursors map[int64]int64) error {
|
|
return s.repo.SetCursors(ctx, userID, guildID, cursors)
|
|
}
|