Integration of CPU-powered semantic search.
  • TypeScript 59.9%
  • Python 29.1%
  • JavaScript 10.5%
  • Shell 0.4%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
oliver.maklott 54639f2cf8
All checks were successful
Publish / test (push) Successful in 27s
Publish / pack-and-publish (push) Successful in 5s
Publish / build-sidecar (push) Successful in 54s
Migrate to new owner
2026-10-02 13:18:53 +02:00
.forgejo/workflows Migrate to new owner 2026-10-02 13:18:53 +02:00
.githooks Sub-repo fmt/lint pre-push rollout 2026-08-29 15:43:24 +02:00
blob Initial commit 2026-08-21 14:45:58 +02:00
client Make search result rows fully clickable 2026-09-12 11:20:03 +02:00
prep Sub-repo fmt/lint pre-push rollout 2026-08-29 15:43:24 +02:00
protocol Initial commit 2026-08-21 14:45:58 +02:00
search_pipeline Fix vectorsearch "response consumer is not running" 2026-08-27 00:00:19 +02:00
server Initial commit 2026-08-21 14:45:58 +02:00
worker Extend wizard: local data volume vs host directory + ldcmd data export/import 2026-09-02 12:55:02 +02:00
.env.example Migrate to new owner 2026-10-02 13:18:53 +02:00
.gitignore Initial commit 2026-08-21 14:45:58 +02:00
CACHE_BOUNDARIES.md Align vectorsearch cache path under /app/data/cache/vectorsearch 2026-08-27 12:06:40 +02:00
compose.dev.yml Migrate to new owner 2026-10-02 13:18:53 +02:00
deploy.json Fix host data path resolve + Plugins/sidecar UX 2026-09-02 15:58:01 +02:00
limedoc.project.json Fix resource URLs; remove build from prod 2026-08-25 23:38:50 +02:00
README.md Review Follow-up 2026-08-28 14:03:44 +02:00
search_provider.test.ts Fix plugin separation boundary violations 2026-08-29 13:27:16 +02:00
search_provider.ts Fix plugin separation boundary violations 2026-08-29 13:27:16 +02:00
SearchResultsModal.tsx Make search result rows fully clickable 2026-09-12 11:20:03 +02:00
SEMANTIC_CHUNKER.md Align vectorsearch cache path under /app/data/cache/vectorsearch 2026-08-27 12:06:40 +02:00
semantic_entity_repr.ts Sub-repo fmt/lint pre-push rollout 2026-08-29 15:43:24 +02:00
semantic_export.test.ts Initial commit 2026-08-21 14:45:58 +02:00
semantic_export.ts Initial commit 2026-08-21 14:45:58 +02:00
settings_schema.test.ts Initial commit 2026-08-21 14:45:58 +02:00
settings_schema.ts Flush enqueue + heading index + quieter prep 2026-08-27 17:38:41 +02:00
vectorsearch-lite.plugin.json Fix vectorsearch "response consumer is not running" 2026-08-27 00:00:19 +02:00
vectorsearch-lite.ts Sub-repo fmt/lint pre-push rollout 2026-08-29 15:43:24 +02:00
vectorsearch_dashboard_widget.tsx Initial commit 2026-08-21 14:45:58 +02:00
vectorsearch_header_tool.tsx Deferred follow-ups from review fixes 2026-08-28 14:41:19 +02:00
vectorsearch_hydrator.tsx Initial commit 2026-08-21 14:45:58 +02:00
vectorsearch_settings_client.tsx Vectorsearch settings rebuild + soft-fail embeds 2026-08-27 11:28:39 +02:00

Vector Search Lite

Hybrid vector search with permission-aware retrieval.

Requirements

  • Docker (or Podman with DOCKER_CMD=podman)
  • That's it — everything else runs inside containers.

Quick start

# 1. Pull the dev image and set up .env
./ldcmd setup

# 2. Start the dev environment (app + Redis)
./ldcmd up

# 3. Open http://localhost:5173 in your browser

# 4. Edit plugin sources — HMR applies automatically
# 5. Run tests
./ldcmd test

# 6. Check types and import boundaries
./ldcmd check

Directory layout

vectorsearch-lite.plugin.json   # Plugin manifest
vectorsearch-lite.ts            # Server entry (defineLimedocPlugin)
vectorsearch_lite_editor_tool.tsx  # Browser client (builds to client/*.js)
client/              # Pre-built browser bundles (committed)
limedoc.project.json # Store metadata (package download URLs)
compose.dev.yml      # Dev compose (uses the published limedoc-dev image)
ldcmd                # Bridge script — the only thing you run on your host
.env.example         # Env var template — copy to .env and fill in OIDC values

ldcmd commands

Command What it does
./ldcmd setup Pull limedoc-dev image, copy .env.example → .env
./ldcmd up Start dev environment
./ldcmd down Stop dev environment
./ldcmd logs [service] Follow container logs
./ldcmd sh [service] Open shell in container (default: app-dev)
./ldcmd test Run plugin tests
./ldcmd fmt Format sources
./ldcmd lint Lint sources
./ldcmd check Type-check + import boundary check
./ldcmd pack Build zip + sha256 (CI also publishes sig.json)
./ldcmd publish Pack and upload (needs .forgejo.env / PACKAGE_TOKEN)
./ldcmd plugin install <id> Install a plugin dependency into the running env
./ldcmd plugin ls List installed plugins

Building client bundles

# Inside the container (run after editing .tsx files)
./ldcmd sh
deno task plugin:build -- /limedoc/plugins/vectorsearch-lite.plugin

Or directly:

./ldcmd check  # runs build as part of the check

Production sidecar (host)

Pack Store / packs:install unpacks this plugin into the app only. The Docker sidecar is not started by Limedoc (no Docker socket in the app). On the deploy host:

ldcmd sidecar up vectorsearch-lite
# or: ldcmd up

Compose SoT: deploy.json + worker/docker-compose.yml (joins DOCKER_NETWORK_NAME).

Packing and publishing

# Build the installable zip + sha256 sidecar (local)
./ldcmd pack

# Publish (needs .forgejo.env with PACKAGE_TOKEN, PACKAGE_OWNER)
./ldcmd publish

CI (Forgejo Actions, .forgejo/workflows/publish.yml) on push to main publishes zip + sha256 + sig.json to Packages and Releases. Pack CI signs the content hash with OpenBao Transit (Forgejo Actions OIDC). Actions secret PACKAGE_TOKEN only — PACKAGE_OWNER is in the workflow env.

Developing with plugin dependencies

Your plugin may depend on another plugin at runtime. Three ways to include it:

1. Install via ldcmd (easiest, needs the app running)

./ldcmd up
./ldcmd plugin install media   # fetches from PACKAGE_STORE_URL in .env

Set PACKAGE_STORE_URL in .env to point at the Forgejo package registry:

PACKAGE_STORE_URL=https://git.belowtoxic.cloud/api/packages/limedoc-plugins

2. Local bind-mount (no running app needed)

Download the pack zip, unzip it next to this directory, then add a volume to compose.dev.yml:

app-dev:
    volumes:
        - .:/limedoc/plugins/vectorsearch-lite.plugin
        # Add the dependency:
        - ../other-plugin.plugin:/limedoc/plugins/other.plugin

Then ./ldcmd up — the app loads all *.plugin directories in plugins/.

3. Multi-repo development (two plugins at once)

Check out the other plugin repo next to this one:

cd ..
git clone git@git.belowtoxic.cloud:limedoc-plugins/other.git other.plugin

Then add it as a bind-mount in compose.dev.yml as shown above. Both plugins are mounted into the same app instance. No special ldcmd support required — the app discovers every *.plugin directory at startup.

Startup order: The app loads plugins alphabetically. If your plugin requires another, the dependency must be present on disk for the load plan to resolve. The compose depends_on in the sidecar template ensures the worker sidecar is healthy before the app starts, but for plugin-to-plugin dependencies no extra compose configuration is needed.

CI / CD

Push to main → Forgejo Actions runs .forgejo/workflows/publish.yml:

  1. Tests pass inside the limedoc-dev container
  2. Client bundles built; boundary check passes
  3. plugin:pack produces vectorsearch-lite-{version}.zip + .sha256
  4. OpenBao signs the content hash → vectorsearch-lite-{version}.sig.json
  5. Zip, sha256, and sig.json uploaded to the generic package registry (store)
  6. Same artifacts attached to a Forgejo Release v{version} (operators)

The app installs plugins from the generic package registry at PACKAGE_STORE_URL.

Using Podman instead of Docker

# In .env (or export before running):
DOCKER_CMD=podman
./ldcmd up

ldcmd detects podman compose automatically.