elastic/elasticsearch

Add ingest processor to percolator that rewrites queries

Open

#29,053 opened on Mar 14, 2018

View on GitHub
 (4 comments) (1 reaction) (0 assignees)Java (25,882 forks)batch import
:Search Relevance/Percolator>bugTeam:Search Relevancehelp wantedpriority:normal

Repository metrics

Stars
 (76,700 stars)
PR merge metrics
 (Avg merge 2d) (1,000 merged PRs in 30d)

Description

Follow up from #17071

The percolator needs a ingest processor that performs the QueryBuilder rewrite. At the moment the query builder rewrite happens in the PercolatorFieldMapper which means each shard copy performs this rewrite. Most of the time this isn't a problem, but in the case that a query builder does a remote fetch (geo_shape query using indexed shape) there is a chance that the query builder rewrite that each shard copy forms fetch slightly different values.

Contributor guide

Research direction
Investigate the percolator's QueryBuilder rewrite logic and design an ingest processor that performs the rewrite before indexing.
Tech stack
java
Domain
backend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
JavaElasticsearch internals
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30