Technologies/Meilisearch/meilisearch.tasks.failed

MeilisearchMetric

meilisearch.tasks.failed

Tasks in failed status

Dimensions:None

Available on:Native (1)

Interface Metrics (1)

Native

tasks.failed

Number of tasks in failed status

Dimensions:None

Sources

tasks.failedwww.meilisearch.com

Technical Annotations (74)

Configuration Parameters (11)

TMPDIRrecommended: /meili_data/tmp or other disk-based path

Points Meilisearch temporary file writes to disk instead of RAM

MEILI_MAX_INDEXING_MEMORYrecommended: 40Gb

Example configuration for 128GB RAM systems during large imports

MEILI_EXPERIMENTAL_MAX_NUMBER_OF_BATCHED_TASKSrecommended: 5-50

Limits concurrent task processing; lower values (5-20) for large batches, higher (up to 50) for smaller batches

MEILI_MAX_INDEXING_THREADSrecommended: 20

Example thread limit for 48-core systems during large imports

searchableAttributesrecommended: minimal set of fields requiring full-text search

Reducing searchable attributes limits FST size and prevents LMDB value size overflow

filterableAttributesrecommended: fields requiring exact match only

Use for fields that don't need full-text search to reduce prefix database bloat

MDB_APPENDrecommended: enabled for sequential writes to empty database

Reduces transaction overhead and dirty pages when loading dumps

max_index_sizerecommended: larger than 1MB default for production

Initial index size allocation; too small causes frequent resizes

MAX_MAP_COUNTrecommended: 262144

System-level memory-mapped file limit for handling bulk document operations

NOFILE_SOFTrecommended: 65536

Soft file descriptor limit required for high-volume document indexing

NOFILE_HARDrecommended: 65536

Hard file descriptor limit required for high-volume document indexing

Error Signatures (22)

I/O error (os error 5)error code

io_errorerror code

This error generally happens when you have no space left on device or when your database doesn't have read or write right

log pattern

MDB_TXN_FULL: Transaction has too many dirty pages - transaction too bigerror code

internalerror code

MeiliSearch::TimeoutError: The request was not processed in the expected timeexception

Net::ReadTimeout with #<TCPSocket:(closed)>exception

Input/output error (os error 5). This error generally happens when you have no space left on device or when your database doesn't have read or write right.

log pattern

Maximum database size has been reached.log pattern

database_size_limit_reachederror code

index_scheduler: internal: decoding failed.log pattern

500http status

A document cannot contain more than 65535 fieldserror code

too many open fileserror code

MDB_TXN_FULLerror code

OOM killedexit code

milli::UserError(MaxDatabaseSizeReached)error code

max_fields_limit_exceedederror code

A document cannot contain more than 65,535 fields.log pattern

408http status

missing_document_iderror code

Document does not have a :primaryKey attributelog pattern

CLI Commands (5)

docker run -d --restart always -p 7700:7700 -e TMPDIR=/meili_data/tmp -v /root/meili_data:/meili_data getmeili/meilisearch:v1.14.0

remediation

curl -H "Authorization: Bearer ${MEILISEARCH_API_KEY}" -H "Content-Type: application/json" "${MEILISEARCH_HOST}/indexes/${INDEX_NAME}/documents/delete" -d "{\"filter\": \"timestamp < $(date --date=\"00:00 today\" -u \"+%s000\")\"}"

diagnostic

df data.msdiagnostic

service meilisearch statusdiagnostic

meilisearch --log-level=debugdiagnostic

Technical References (36)

ramfsconcept/tmpfile pathTMPDIRcomponentautobatchingconcepttmpfsconceptstateful podsconceptdocumentAdditionOrUpdatecomponentLMDBcomponentfacet databasecomponentdocumentDeletioncomponentmeilisearch-railscomponenthttp_request.rbfile pathFSTconceptprefix databasecomponentdata.msfile pathtasks queuecomponenttask DBcomponentbatch insertconceptindex_schedulercomponentsnapshotconceptdumpconceptdot-notated pathconceptJSON.stringifyconceptgrenadcomponentextractorcomponenttask schedulercomponentauto-batchingconceptedit documents by functioncomponenttaskUidconcepttask statusconceptIndexMappercomponentIndexSchedulercomponentmillicomponentfield_distributionconceptindex schemaconceptprimaryKeyconcept

Related Insights (24)

TMPDIR RAM exhaustion causes I/O errors during large batch indexingcritical

▸

Unlimited task autobatching triggers resource exhaustion and I/O failurescritical

▸

Docker volume and tmpfs misconfiguration prevents large-scale indexingwarning

▸

Large batch sizes amplify temporary storage and memory pressurewarning

▸

Index corruption when bulk deletion fails with MDB_TXN_FULL transaction limitcritical

▸

Meilisearch Cloud timeout errors discard indexing jobswarning

▸

I/O error (os error 5) when index exceeds ~800GB due to LMDB value size limitcritical

▸

Task queue reaches 10 GiB limit in Meilisearch v1.0.xcritical

▸

Large batch document inserts fail at scalewarning

▸

Crashes during document indexation due to memory exhaustioncritical

▸

Snapshot import from incompatible version causes index_scheduler decoding failurecritical

▸

Nested object flattening causes field limit exceeded during ingestioncritical

▸

Documents with over 65,536 attributes fail to indexcritical

▸

Primary key values exceeding 511 bytes cause task failurecritical

▸

Too many open files error during indexingcritical

▸

MDB_TXN_FULL error blocks large indexing operationscritical

▸

OOM crashes from auto-batching too many taskscritical

▸

Disk space exhaustion during bulk document editingwarning

▸

Document operations return 202 but changes not visible in search resultswarning

▸

Index settings update causes infinite OOM loopcritical

▸

Tasks auto-retry after MaxDatabaseSizeReached errorwarning

▸

Schema evolution accumulates field definitions causing field limit exceeded errorscritical

▸

Bulk document addition causes complete API freezecritical

▸

Document indexing failure prevents search resultscritical

▸