karakeep-app/karakeep

Fr: expose binaryQuantized of meilisearch (faster search and lighter db)

Open

#1,315 opened on Apr 26, 2025

View on GitHub
 (1 comment) (0 reactions) (0 assignees)TypeScript (1,356 forks)auto 404
feature requestgood first issuepri/lowstatus/approved

Repository metrics

Stars
 (27,587 stars)
PR merge metrics
 (PR metrics pending)

Description

Describe the feature you'd like

Hi,

binaryQuantized allows to keep only 1 and 0s in the embedding process, making the db way smaller and the search way faster. Depending on the model and dimensions the loss can actually be negligible.

In this example using binary embeddings uses 3% of the space (x32 compression) and retains 96% of the performance with a x25 speedup.

I'm not saying it should default to true but exposing the setting would be a good start!

Here's the doc

Describe the benefits this would bring to existing Karakeep users

Way faster search, way lower db size, usable on cheaper hardware.

Can the goal of this request already be achieved via other means?

No

Have you searched for an existing open/closed issue?

  • I have searched for existing issues and none cover my fundamental request

Additional context

No response

Contributor guide

Research direction
Investigate how Meilisearch settings are configured in the codebase, specifically the settings API, and add the binaryQuantized option.
Tech stack
typescript
Domain
backend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
TypeScriptMeilisearch
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
75