| CLUSTER_STATUS_REDCluster status drops to RED and search requests return partial or 503 errors | One or more primary shards are UNASSIGNED after a data node crash, disk full event, or corrupt Lucene translog. | Run GET _cluster/allocation/explain on the unassigned primary, verify node storage health, retry allocation via _cluster/reroute?retry_failed=true, or restore from S3 snapshot. |
|---|
| DISK_FLOOD_STAGE_READONLYIndices lock into read_only_allow_delete and ingestion stops | A data node crossed the 95% cluster.routing.allocation.disk.watermark.flood_stage threshold due to stalled ISM deletion or uneven shard placement. | Relieve disk space or relocate oversized shards, fix the blocked ISM policy, and reset index.blocks.read_only_allow_delete: null. |
|---|
| JVM_OLD_GEN_GC_STORMData nodes drop out of cluster with master_not_discovered_exception | Stop-the-world JVM garbage collection pauses exceed cluster.fault_detection.follower_check.timeout because of oversharding or heavy fielddata aggregations. | Inspect _nodes/hot_threads and GC logs, cancel runaway tasks via _tasks/_cancel, and reduce shard density and aggregation bucket limits. |
|---|
| SEARCH_THREADPOOL_REJECTQueries fail with EsRejectedExecutionException on search or write queues | Slow unindexed wildcard/regex queries or unbatched _bulk requests saturate fixed thread pool queues (search queue 1000 / write queue 200). | Check _cat/thread_pool/search,write?v, isolate slow queries in index.search.slowlog, and enable Segment Replication to free CPU cores. |
|---|
| ISM_ROLLOVER_STALLEDA single write index grows past 800 GB instead of rolling over | Misconfigured is_write_index alias flags or template collisions prevent the ISM rollover action from creating the next generation index. | Run GET _plugins/_ism/explain/<index>, repair the write alias pointer atomically via _aliases, and retry the failed ISM step. |
|---|
| BLUE_GREEN_UPGRADE_STUCKAmazon OpenSearch Service domain update hangs at 90% for hours | Unassigned replica shards, high JVM pressure, or incompatible index settings block the managed blue/green shard migration check. | Audit domain upgrade eligibility logs, resolve YELLOW replica allocation blocks, and throttle ingestion during the blue/green switch. |
|---|