fix(api): raise Jackson maxStringLength for large clustering results #992

Merged
chris merged 2 commits from fix/api-jackson-string-limit into main 2026-10-02 19:15:12 +02:00
Owner

Raises the global Jackson string limit to 64,000,000 characters before application startup. WorkerController uses MVC to deserialize payloadJson, then SubmitJobResultRequest uses a dedicated mapper to parse the nested JSON. PR #987 exposed a 26,651-face pool; 5,832 candidates exceeded the old 20M string default and failed job 53082876-d532-45c1-a663-2135d405558c. Regression test parses 5,832 synthetic candidates (>20M chars) through the MVC converter mapper and request payload mapper. Focused class and dev.memories.api.worker.* passed locally. Version: 1.21.62. Chunked submission remains follow-up work. No Testcontainers POST; no existing worker controller harness. Do not merge automatically.

Raises the global Jackson string limit to 64,000,000 characters before application startup. WorkerController uses MVC to deserialize payloadJson, then SubmitJobResultRequest uses a dedicated mapper to parse the nested JSON. PR #987 exposed a 26,651-face pool; 5,832 candidates exceeded the old 20M string default and failed job 53082876-d532-45c1-a663-2135d405558c. Regression test parses 5,832 synthetic candidates (>20M chars) through the MVC converter mapper and request payload mapper. Focused class and dev.memories.api.worker.* passed locally. Version: 1.21.62. Chunked submission remains follow-up work. No Testcontainers POST; no existing worker controller harness. Do not merge automatically.
fix(api): raise Jackson maxStringLength for large clustering result payloads
Some checks failed
Wiki Sync / Sync wiki from docs (push) Has been skipped
Build and Deploy / Android unit tests and debug APK (push) Has been skipped
Build and Deploy / Build postgres image (push) Has been skipped
Build and Deploy / Smoke API and media worker (push) Has been skipped
Build and Deploy / Smoke web (push) Has been skipped
Build and Deploy / Smoke ML worker (push) Has been skipped
Build and Deploy / Smoke people worker (push) Has been skipped
Build and Deploy / Detect changed services and test scopes (push) Successful in 5s
Build and Deploy / Build plants worker image (push) Has been skipped
Build and Deploy / Build converter worker image (push) Has been skipped
Build and Deploy / Deploy postgres (push) Has been skipped
Build and Deploy / Build API image (push) Has been skipped
Build and Deploy / Build media worker image (push) Has been skipped
Build and Deploy / Build ML worker image (push) Has been skipped
Build and Deploy / Build people worker image (push) Has been skipped
Build and Deploy / Build web image (push) Has been skipped
Build and Deploy / Deploy API (push) Has been skipped
Build and Deploy / Deploy web (push) Has been skipped
Build and Deploy / Deploy media worker (push) Has been skipped
Build and Deploy / Deploy ML worker (push) Has been skipped
Build and Deploy / Deploy plants worker (push) Has been skipped
Build and Deploy / Deploy people worker (push) Has been skipped
Build and Deploy / Deploy converter worker (push) Has been skipped
Build and Deploy / Clean Docker build artifacts (push) Has been skipped
Build and Deploy / Run scoped PR tests (push) Failing after 1m13s
7cfcd06d05
HttpMessageNotReadableException: JSON parse error: String value length (20051112) exceeds the maximum allowed (20000000, from StreamReadConstraints.getMaxStringLength())

PR #987 made the full 26,651-face pool feedable; the first real run produced 5,832 candidates (approximately 20 MB). Job 53082876-d532-45c1-a663-2135d405558c failed on result submission. Raise the global default to 64M characters before MVC and dedicated worker mappers initialize; chunked submission remains the long-term fix.
docs(known-issues): track large worker result mitigation in PR #992
All checks were successful
Wiki Sync / Sync wiki from docs (push) Has been skipped
Build and Deploy / Detect changed services and test scopes (push) Successful in 6s
Build and Deploy / Android unit tests and debug APK (push) Has been skipped
Build and Deploy / Smoke API and media worker (push) Has been skipped
Build and Deploy / Smoke web (push) Has been skipped
Build and Deploy / Smoke ML worker (push) Has been skipped
Build and Deploy / Smoke people worker (push) Has been skipped
Build and Deploy / Build postgres image (push) Has been skipped
Build and Deploy / Build plants worker image (push) Has been skipped
Build and Deploy / Build converter worker image (push) Has been skipped
Build and Deploy / Deploy postgres (push) Has been skipped
Build and Deploy / Build API image (push) Has been skipped
Build and Deploy / Build media worker image (push) Has been skipped
Build and Deploy / Build ML worker image (push) Has been skipped
Build and Deploy / Build people worker image (push) Has been skipped
Build and Deploy / Build web image (push) Has been skipped
Build and Deploy / Deploy API (push) Has been skipped
Build and Deploy / Deploy web (push) Has been skipped
Build and Deploy / Deploy media worker (push) Has been skipped
Build and Deploy / Deploy ML worker (push) Has been skipped
Build and Deploy / Deploy plants worker (push) Has been skipped
Build and Deploy / Deploy people worker (push) Has been skipped
Build and Deploy / Deploy converter worker (push) Has been skipped
Build and Deploy / Clean Docker build artifacts (push) Has been skipped
Build and Deploy / Run scoped PR tests (push) Successful in 8m35s
bba751f7b1
chris merged commit 8aada337a2 into main 2026-10-02 19:15:12 +02:00
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
chris/memories!992
No description provided.