Embedding model change requires costly re-embedding and re-indexing

Changing the embedding model affects downstream results and requires re-embedding and re-indexing all data. The operational cost (time, compute resources, downtime) should only be incurred if performance improvements justify it.

Before changing the embedding model, establish an evaluation pipeline to compare baseline performance against the fine-tuned model. Only proceed with model changes if retrieval performance improvements justify the cost of re-embedding and re-indexing all data.