Commit Graph

75 Commits

Author SHA1 Message Date
lukaszraczylo d04b60517a Make things 'betterer' across the board (#23)
* Make things 'betterer' across the board

* fix: reorganize struct fields and config parameters for consistency

- [x] Reorder Config struct fields alphabetically and by related functionality
- [x] Reorganize Observation model fields with archival fields grouped together
- [x] Reorder ObservationStore fields to group related members
- [x] Reorder Store struct fields with health check caching grouped
- [x] Reorganize HealthInfo and PoolMetrics struct field order
- [x] Reorder maintenance Service struct fields logically
- [x] Reorganize MCP server handler parameter structs alphabetically
- [x] Reorder pattern detector candidate tracking fields
- [x] Reorganize search Manager struct fields by functionality
- [x] Reorder vector Client struct fields with mutex protections grouped
- [x] Reorganize handler request/response struct fields
- [x] Update handlers_test.go to expect wrapped response format
- [x] Reorder middleware TokenAuth and rate limiter fields
- [x] Reorganize Service struct fields with grouped functionality
- [x] Fix RateLimiter field ordering for clarity
- [x] Reorder CircuitBreaker metrics fields

* fix(security): improve JSON output safety and path traversal protection

- [x] Replace unsafe JSON string formatting with proper json.Marshal in export handler
- [x] Remove escapeJSONString helper function in favor of standard JSON marshaling
- [x] Add safeResolvePath function to validate paths and prevent directory traversal
- [x] Apply path traversal validation in captureFileMtimes operations
- [x] Cap result slice capacity in getRecentSearchQueries to prevent DoS via excessive allocation

* fix(sdk): improve path traversal protection and allocation safety

- [x] Enhance safeResolvePath with stricter validation using filepath.Rel
- [x] Reject paths containing ".." after cleaning to prevent traversal
- [x] Validate absolute paths are within cwd when cwd is specified
- [x] Apply safeResolvePath validation to GetFileContent for consistency
- [x] Add comprehensive test coverage for path traversal protection
- [x] Fix allocation safety in getRecentSearchQueries by using constant capacity
v0.11.13
2026-01-11 01:51:20 +00:00
github-actions[bot] 3107eddeb2 chore: update marketplace for v0.11.9 2026-01-10 03:44:38 +00:00
lukaszraczylo 026035dc15 Update go.mod and go.sum (#22) v0.11.9 2026-01-10 03:32:48 +00:00
github-actions[bot] 4629b75c8a chore: update marketplace for v0.11.5 2026-01-09 22:23:29 +00:00
lukaszraczylo e07d4174de fix(hooks,db,mcp,worker): add type safety and error handling (#21)
- [x] Add type checking and error handling for JSON type assertions in user-prompt hook
- [x] Add error handling for session update query in CreateSDKSession
- [x] Update MCP tool description to reference sqlite-vec instead of ChromaDB
- [x] Fix MinConfidence sentinel value check from 0 to -1
- [x] Pass project parameter to vector search filter in handleSearchByPrompt
- [x] Return empty map instead of nil for successful responses without JSON body
v0.11.5
2026-01-09 22:17:05 +00:00
github-actions[bot] e0218c2bd4 chore: update marketplace for v0.11.1 2026-01-07 22:14:24 +00:00
lukaszraczylo 5c2685c7b6 feat(leann-phase2): implement hybrid vector storage and graph-based search (#20)
* feat(leann-phase2): implement hybrid vector storage and graph-based search

- [x] Add AST-aware code chunking for Go, Python, and TypeScript using tree-sitter
- [x] Implement LEANN-inspired hybrid vector storage with hub detection and selective embedding storage (60-80% savings)
- [x] Add observation relationship graph with CSR format and edge detection (file overlap, semantic similarity, temporal, concept)
- [x] Implement graph-aware search with two-level traversal and relationship-based ranking
- [x] Add auto-tuning system for dynamic hub threshold adjustment based on query performance
- [x] Add comprehensive metrics tracking for vector storage, queries, latency, and graph traversals
- [x] Update configuration system with graph and hybrid storage settings
- [x] Add graph stats and vector metrics endpoints to worker service
- [x] Enhance UI sidebar with advanced metrics display and graph visualization
- [x] Optimize struct field alignment throughout codebase for memory efficiency
- [x] Update documentation with LEANN Phase 2 features and performance benefits
- [x] Add tree-sitter dependency for AST parsing

* fix: add fts5 build tag to CI workflow

Pass build-tags: "fts5" to shared workflow to properly compile
sqlite-vec-go-bindings with SQLite FTS5 support.

This fixes test failures in hybrid vector storage tests that require
CGO and FTS5 build tags.

Requires shared-actions@8f7f235 or later.

* docs: add testing documentation and macOS ARM64 known issue

Document the macOS ARM64 CGO linking issue with sqlite-vec-go-bindings
that prevents hybrid package tests from compiling locally.

Added:
- .github/TESTING.md: Comprehensive testing guide with platform-specific
  issues, workarounds, and CI configuration details
- internal/vector/hybrid/README.md: Package-specific documentation
  explaining the macOS limitation
- .github/CI_FIX_SUMMARY.md: Technical details of the CI fix

Key points:
- 41 out of 42 packages test successfully on all platforms
- hybrid package tests fail only on macOS ARM64 (local dev issue)
- Linux CI tests pass with proper build-tags: "fts5" configuration
- Production builds and runtime functionality unaffected

This is a known limitation of sqlite-vec-go-bindings on macOS ARM64
and does not impact CI/CD or production deployments.

* fix: add SQLite busy_timeout to prevent database locked errors

Set PRAGMA busy_timeout=5000 (5 seconds) to allow SQLite to retry
when the database is locked instead of failing immediately.

This fixes race conditions when multiple goroutines try to write
simultaneously, particularly in tests where StoreObservation spawns
async cleanup goroutines.

Root cause:
- StoreObservation launches goroutine -> CleanupOldObservations
- Multiple concurrent cleanups caused "database is locked" errors
- Without busy_timeout, SQLite fails immediately on lock contention

Solution:
- Add 5-second busy timeout for automatic retry on lock
- Standard practice for concurrent SQLite usage
- Works with existing WAL mode configuration

Fixes TestObservationStore_CleanupOldObservations in CI.

* docs: complete summary of all CI test fixes

Comprehensive documentation of all fixes applied:
1. Missing build tags (fts5)
2. Database locked errors (busy_timeout)

All 41/42 packages now pass tests. The hybrid package has a known
macOS ARM64 limitation that doesn't affect CI or production.

No functionality was removed - all fixes are additive only.

* fix: add SQLite driver import to hybrid tests for CGO linking

Add blank import of mattn/go-sqlite3 to hybrid test files to ensure
the SQLite driver is linked into the test binary. This provides the
SQLite symbols that sqlite-vec-go-bindings requires.

Root cause:
- hybrid package imports sqlitevec (transitively depends on sqlite-vec CGO)
- Test binary needs SQLite symbols for linking
- sqlitevec tests already had this import, but hybrid tests didn't
- Without the driver import, linker fails with "undefined symbols"

This fix enables hybrid tests to run with -race flag on all platforms.

Before: 41/42 packages pass (hybrid failed to link)
After:  42/42 packages pass 

Fixes hybrid test compilation on macOS ARM64, Linux, and Windows.

* docs: remove outdated macOS limitation documentation

The hybrid test linking issue has been fixed by adding the SQLite
driver import. All tests now pass on all platforms including macOS.

Removed:
- internal/vector/hybrid/README.md (documented workaround no longer needed)
- .github/TESTING.md (macOS limitation section obsolete)

All 42/42 packages now test successfully with -race flag.

* docs: final comprehensive summary of all CI fixes

All three issues now resolved:
1. Missing fts5 build tags
2. Database busy_timeout for concurrent writes
3. Missing SQLite driver import in hybrid tests

Result: 42/42 packages pass with -race on all platforms.

Credit to reviewer for identifying the race detector concern.
v0.11.1
2026-01-07 22:03:59 +00:00
github-actions[bot] 7ab4b07cf2 chore: update marketplace for v0.10.5 2026-01-07 03:42:17 +00:00
lukaszraczylo 57395ace82 Update go.mod and go.sum (#18) v0.10.5 2026-01-07 03:33:19 +00:00
github-actions[bot] 5eb6ad395f chore: update marketplace for v0.10.1 2026-01-07 00:37:31 +00:00
lukaszraczylo 7a061c85eb general improvements (#17)
* refactor(hooks): simplify hook execution with shared context

- [x] Extract BaseInput struct to eliminate duplicate fields across hooks
- [x] Create RunHook handler pattern for session-start and user-prompt
- [x] Create RunStatuslineHook for fast statusline rendering without worker startup
- [x] Add HookContext struct to pass port, project, CWD, SessionID to handlers
- [x] Add db/interface.go with ObservationReader/Writer interfaces
- [x] Add comprehensive conflict management tests in sqlite/conflict_test.go
- [x] Add vector client tests for Count, ModelVersion, NeedsRebuild, GetStaleVectors
- [x] Add FilterByThreshold helper tests for query result filtering
- [x] Make handlers_test more robust for network-dependent update checks
- [x] Update package versions in UI

* Move to GORM + general cleanup

* feat(mcp): add observation relations discovery and scoring integration

- [x] Add find_related_observations MCP tool for discovering related observations by confidence
- [x] Integrate scoring calculator and recalculator into MCP server initialization
- [x] Add pattern, relation, and session stores to MCP server dependencies
- [x] Register MCP server in Claude Code settings during plugin installation
- [x] Update install scripts (bash, PowerShell) to configure MCP server settings
- [x] Switch plugin manifest files to template-based versioning (plugin.json.tpl, marketplace.json.tpl)
- [x] Update all MCP server tests to pass new dependency parameters
v0.10.1
2026-01-07 00:26:20 +00:00
github-actions[bot] 92a99c7615 chore: update marketplace for v0.9.5 2026-01-02 03:42:58 +00:00
lukaszraczylo f8693bde26 Update go.mod and go.sum (#16) v0.9.5 2026-01-02 03:34:15 +00:00
github-actions[bot] c99b8f29b8 chore: update marketplace for v0.9.1 2025-12-19 18:25:50 +00:00
lukaszraczylo 40a44a71eb fixup! fixup! Release dec 2025 (#15) v0.9.1 2025-12-19 18:20:06 +00:00
lukaszraczylo 7cbe16ae7e fixup! Release dec 2025 (#15) 2025-12-19 18:14:20 +00:00
lukaszraczylo f79782a008 Release dec 2025 (#15)
* Resolves issue #13

- Switched model to bge-small-en-v1.5
- Added lazy re-embedding
- Added model version tracking per vector
- Added conversion of vectors to the new model

* Add lfs support to the workflow.

* Implements importance scoring with decay + voting #6

* Resolves issue #5 by marking observations as superseeded and scheduled for deletion

* Implement pattern detection #7

* Improve injections and observations accuracy

- Session start: Recent observations for project context (recency-based)
- User prompt: Semantically relevant observations (similarity-based with threshold)

* Added two stage retrieval with bi and cross encoder #8

* Implement query expansion and reformulation #9

* Knowledge graph and relationships ( resolves #4 )

- File Overlap Detection: Detects relationships when observations modify/read the same files
- Concept Overlap Detection: Detects relationships based on shared semantic concepts
- Type Progression Detection: Infers relationships from natural observation type progressions (e.g., discovery → bugfix = "fixes")
- Temporal Proximity Detection: Detects relationships between observations in the same session within 5 minutes
- Narrative Mention Detection: Detects explicit relationship language in narratives (e.g., "fixes", "depends on", "supersedes")

* Add visualisation of the relations to the dashboard.

* fixup! Add visualisation of the relations to the dashboard.

* Update documentation with new settings and screenshots.
2025-12-19 17:57:11 +00:00
github-actions[bot] 48957a6c81 chore: update marketplace for v0.6.38 2025-12-19 02:17:31 +00:00
lukaszraczylo ed8b5e92e1 Display only current project statistics in statusline. (#3) 2025-12-19 02:17:30 +00:00
lukaszraczylo 2f303454af fixup! Further improvements to the coverage. 2025-12-19 02:17:30 +00:00
github-actions[bot] cca48962b4 chore: update marketplace for v0.6.33 2025-12-19 02:17:29 +00:00
lukaszraczylo 7e2e4d7b6b Further improvements to the coverage. 2025-12-19 02:17:29 +00:00
lukaszraczylo c259bb1d18 Increase test coverage to 45.6% 2025-12-19 02:17:28 +00:00
lukaszraczylo 4add030bed Increase tests coverage. 2025-12-19 02:17:28 +00:00
github-actions[bot] 587cdab9a5 chore: update marketplace for v0.6.26 2025-12-19 02:17:27 +00:00
lukaszraczylo 2098a38d64 Add restart command, fix post-update restarts as well. 2025-12-19 02:17:27 +00:00
github-actions[bot] d90664d27d chore: update marketplace for v0.6.22 2025-12-19 02:17:26 +00:00
lukaszraczylo fbb09ac6f5 Update go.mod and go.sum (#2) 2025-12-19 02:17:26 +00:00
github-actions[bot] 6680aa7072 chore: update marketplace for v0.6.18 2025-12-19 02:17:25 +00:00
lukaszraczylo cbf6f533f3 Prevent endless loops during connectivity issues. 2025-12-19 02:17:25 +00:00
github-actions[bot] 7d856c7330 chore: update marketplace for v0.6.15 2025-12-19 02:17:24 +00:00
lukaszraczylo 406de5c850 Increase automatic update size limit to 250MB 2025-12-19 02:17:24 +00:00
github-actions[bot] 7fed76b53e chore: update marketplace for v0.6.11 2025-12-19 02:17:23 +00:00
lukaszraczylo 9a2f66d37c Don't store system / agent summaries. 2025-12-19 02:17:23 +00:00
github-actions[bot] 9d12f08c91 chore: update marketplace for v0.6.8 2025-12-19 02:17:22 +00:00
lukaszraczylo 4440fd0afb Fixes onnx version mismatch, vectordb not liking it and dashboard
Fixes summaries not being generated and timeline showing all observations
despite of project filter being applied.
2025-12-19 02:17:22 +00:00
github-actions[bot] 2730727e8b chore: update marketplace for v0.6.4 2025-12-19 02:17:21 +00:00
lukaszraczylo cae0af62e2 Add deployment of statusline. 2025-12-19 02:17:21 +00:00
github-actions[bot] cc7b458f07 chore: update marketplace for v0.6.1 2025-12-19 02:17:20 +00:00
lukaszraczylo 916b2354aa fixup! ... another attempt with goreleaser publishing. 2025-12-19 02:17:20 +00:00
lukaszraczylo cc95e92450 ... another attempt with goreleaser publishing. 2025-12-19 02:17:19 +00:00
lukaszraczylo 97fb3a4102 Website dependencies. 2025-12-19 02:17:19 +00:00
lukaszraczylo d01f51d0d1 Fix the release jsons conflicts 2025-12-19 02:17:18 +00:00
lukaszraczylo a45d1dc0e7 ... f-windows. 2025-12-19 02:17:18 +00:00
lukaszraczylo 939ff8573d Remove AMD64 macos support. Just realised nobody uses it anymore. 2025-12-19 02:17:17 +00:00
lukaszraczylo 95073ae65e Correctly identify the platform during the build. 2025-12-19 02:17:17 +00:00
lukaszraczylo 17d69bc8fe Fix Windows linker conflict between go-sqlite3 and sqlite-vec
Both libraries embed their own copy of SQLite, causing duplicate
symbol errors on Windows. Add CGO_LDFLAGS to allow multiple definitions.
2025-12-19 02:17:16 +00:00
lukaszraczylo 9afd95d0e5 Fix windows build. 2025-12-19 02:17:16 +00:00
lukaszraczylo 47c83a71e2 Add windows embeddings as well. 2025-12-19 02:17:15 +00:00
lukaszraczylo 0f78f6af43 Add preparation workflow. 2025-12-19 02:17:15 +00:00