feat: V115 clear person domain tables #617

Merged
chris merged 4 commits from fix/clear-people-domain into main 2026-07-14 22:09:05 +02:00
Owner

Clears ALL person domain discovery tables to start fresh pipeline: faces found -> face clusters -> persons.

Tables cleared (16 operations in FK-safe order):

  • pending_face_embeddings, class_instance_review_decisions
  • collaborative_class_instances + child tables (forks, contributions, roles, shares)
  • class_instance_merge_suggestion_decisions
  • class_occurrence_embeddings, class_instance_occurrences, class_instance_occurrence_candidates
  • class_instances, discovery_results, media_item_discovery_status
  • worker_jobs (queued/failed people pipeline jobs only)
  • discovery_domains: reset reprocess_last_enqueued_at for people

Impact: All named persons permanently deleted. reprocess_last_enqueued_at reset so periodic scan re-enqueues all media for people detection.

Version bump: 1.10 -> 1.11

Clears ALL person domain discovery tables to start fresh pipeline: faces found -> face clusters -> persons. Tables cleared (16 operations in FK-safe order): - pending_face_embeddings, class_instance_review_decisions - collaborative_class_instances + child tables (forks, contributions, roles, shares) - class_instance_merge_suggestion_decisions - class_occurrence_embeddings, class_instance_occurrences, class_instance_occurrence_candidates - class_instances, discovery_results, media_item_discovery_status - worker_jobs (queued/failed people pipeline jobs only) - discovery_domains: reset reprocess_last_enqueued_at for people Impact: All named persons permanently deleted. reprocess_last_enqueued_at reset so periodic scan re-enqueues all media for people detection. Version bump: 1.10 -> 1.11
feat: add V115 migration to clear person domain tables
All checks were successful
Build and Deploy / Detect changed services and test scopes (push) Successful in 3s
Build and Deploy / Smoke API and media worker (push) Has been skipped
Build and Deploy / Smoke web (push) Has been skipped
Build and Deploy / Smoke ML worker (push) Has been skipped
Build and Deploy / Build plants worker image (push) Has been skipped
Build and Deploy / Build people worker image (push) Has been skipped
Build and Deploy / Build converter worker image (push) Has been skipped
Build and Deploy / Build API image (push) Has been skipped
Build and Deploy / Build media worker image (push) Has been skipped
Build and Deploy / Build web image (push) Has been skipped
Build and Deploy / Build ML worker image (push) Has been skipped
Build and Deploy / Deploy API (push) Has been skipped
Build and Deploy / Deploy web (push) Has been skipped
Build and Deploy / Deploy media worker (push) Has been skipped
Build and Deploy / Deploy ML worker (push) Has been skipped
Build and Deploy / Deploy plants worker (push) Has been skipped
Build and Deploy / Deploy people worker (push) Has been skipped
Build and Deploy / Deploy converter worker (push) Has been skipped
Build and Deploy / Clean Docker build artifacts (push) Has been skipped
Build and Deploy / Run scoped PR tests (push) Successful in 2m16s
919047d668
Clears all person domain discovery tables to start fresh:
- pending_face_embeddings, class_instance_review_decisions
- collaborative_class_instances and child tables (forks, contributions, roles, shares)
- class_instance_merge_suggestion_decisions
- class_occurrence_embeddings, class_instance_occurrences, class_instance_occurrence_candidates
- class_instances, discovery_results, media_item_discovery_status
- worker_jobs (queued/failed people pipeline jobs only)
- discovery_domains: reset reprocess_last_enqueued_at for people domain

Destructive operation per user directive. After merge, pipeline restarts:
media → faces found → face clusters → persons.

Bumps version to 1.11.
fix: add user_discovery_markers DELETE before TRUNCATE parent tables in V115
All checks were successful
Build and Deploy / Detect changed services and test scopes (push) Successful in 3s
Build and Deploy / Smoke API and media worker (push) Has been skipped
Build and Deploy / Smoke web (push) Has been skipped
Build and Deploy / Smoke ML worker (push) Has been skipped
Build and Deploy / Build plants worker image (push) Has been skipped
Build and Deploy / Build people worker image (push) Has been skipped
Build and Deploy / Build converter worker image (push) Has been skipped
Build and Deploy / Build API image (push) Has been skipped
Build and Deploy / Build media worker image (push) Has been skipped
Build and Deploy / Build web image (push) Has been skipped
Build and Deploy / Build ML worker image (push) Has been skipped
Build and Deploy / Deploy API (push) Has been skipped
Build and Deploy / Deploy web (push) Has been skipped
Build and Deploy / Deploy media worker (push) Has been skipped
Build and Deploy / Deploy ML worker (push) Has been skipped
Build and Deploy / Deploy plants worker (push) Has been skipped
Build and Deploy / Deploy people worker (push) Has been skipped
Build and Deploy / Deploy converter worker (push) Has been skipped
Build and Deploy / Run scoped PR tests (push) Successful in 3m19s
Build and Deploy / Clean Docker build artifacts (push) Has been skipped
c5cb823bdc
FK violation: user_discovery_markers references both class_instances(id)
and discovery_results(id). TRUNCATE of parent tables at steps 12-13
fails if user_discovery_markers has person-domain rows.

Added DELETE with domain_key='people' filter before parent TRUNCATE.
Renumbered steps 13-17.
fix: swap TRUNCATE order for discovery_results before class_instances in V115
All checks were successful
Build and Deploy / Detect changed services and test scopes (push) Successful in 3s
Build and Deploy / Smoke API and media worker (push) Has been skipped
Build and Deploy / Smoke web (push) Has been skipped
Build and Deploy / Smoke ML worker (push) Has been skipped
Build and Deploy / Build plants worker image (push) Has been skipped
Build and Deploy / Build people worker image (push) Has been skipped
Build and Deploy / Build converter worker image (push) Has been skipped
Build and Deploy / Build API image (push) Has been skipped
Build and Deploy / Build media worker image (push) Has been skipped
Build and Deploy / Build web image (push) Has been skipped
Build and Deploy / Build ML worker image (push) Has been skipped
Build and Deploy / Deploy API (push) Has been skipped
Build and Deploy / Deploy web (push) Has been skipped
Build and Deploy / Deploy media worker (push) Has been skipped
Build and Deploy / Deploy ML worker (push) Has been skipped
Build and Deploy / Deploy plants worker (push) Has been skipped
Build and Deploy / Deploy people worker (push) Has been skipped
Build and Deploy / Deploy converter worker (push) Has been skipped
Build and Deploy / Clean Docker build artifacts (push) Has been skipped
Build and Deploy / Run scoped PR tests (push) Successful in 2m10s
02e2745654
discovery_results has FK existing_instance_id -> class_instances(id).
Must truncate child (discovery_results) before parent (class_instances)
to avoid PostgreSQL FK violation.
fix: scope V115 DELETE to people domain only, replace TRUNCATE with WHERE domain_key='people'
All checks were successful
Build and Deploy / Detect changed services and test scopes (push) Successful in 4s
Build and Deploy / Smoke API and media worker (push) Has been skipped
Build and Deploy / Build plants worker image (push) Has been skipped
Build and Deploy / Build converter worker image (push) Has been skipped
Build and Deploy / Smoke web (push) Has been skipped
Build and Deploy / Smoke ML worker (push) Has been skipped
Build and Deploy / Build API image (push) Has been skipped
Build and Deploy / Build media worker image (push) Has been skipped
Build and Deploy / Build people worker image (push) Has been skipped
Build and Deploy / Build web image (push) Has been skipped
Build and Deploy / Build ML worker image (push) Has been skipped
Build and Deploy / Deploy API (push) Has been skipped
Build and Deploy / Deploy web (push) Has been skipped
Build and Deploy / Deploy media worker (push) Has been skipped
Build and Deploy / Deploy ML worker (push) Has been skipped
Build and Deploy / Deploy plants worker (push) Has been skipped
Build and Deploy / Deploy people worker (push) Has been skipped
Build and Deploy / Deploy converter worker (push) Has been skipped
Build and Deploy / Clean Docker build artifacts (push) Has been skipped
Build and Deploy / Run scoped PR tests (push) Successful in 2m8s
925f9cbfef
chris merged commit ec3d8707c1 into main 2026-07-14 22:09:05 +02:00
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
chris/memories!617
No description provided.