We ran a product catalog through an LLM translation pipeline and shipped it. Search broke the next day. The prose was fine, but model numbers and pack sizes got translated too, so nothing matched anymore. We had handed the model a product title and called the whole thing text.
Now non-translatable spans get marked before the model sees them, and a batch fails if a digit changed. Some part of your data is probably not language at all.