milvus-io/milvus

[Feature]: bitwise AND and OR operators in filter expression

Open

#24,490 opened on May 29, 2023

View on GitHub
 (5 comments) (0 reactions) (1 assignee)Go (4,000 forks)batch import
good first issuekind/feature

Repository metrics

Stars
 (44,298 stars)
PR merge metrics
 (Avg merge 7d) (314 merged PRs in 30d)

Description

Is there an existing issue for this?

  • I have searched the existing issues

Is your feature request related to a problem? Please describe.

We are going to use Milvus in our product. However, our product has document permission similar to Linux file permission. We are going to use an integer to store the document permission in each bit within the document entity. And we want to use the bitwise operator to filter the permission against the user's.

Unfortunately, the bitwise operator is not available in Milvus now.

Describe the solution you'd like.

I hope there are bitwise operators in filter expression like other modern expression systems.

Describe an alternate solution.

If no such operator, we have to flatten the permission in multiple fields and use 'or' to check the permission. I can assume it hits the system query performance since the "or" operator is very difficult to optimize.

Anything else? (Additional Context)

No response

Contributor guide

Research direction
Examine the existing filter operator implementation in Milvus's query engine, then add support for bitwise AND and OR operators following similar patterns.
Tech stack
go
Domain
databasebackend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
Go
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60