copy&paste source text from media wiki into tiki wiki this char "→" breaks "index rebuilding"

• Release Blocker

In an old media wiki with iso-8859-1 charset, somebody supposedly has copy&pasted some M$ Office/Word DOC text into the old wiki.
Now, when migrating from the old media wiki to a new tiki wiki 15.2., somebody else copy&pastes the same text from source to source, but after saving it into the new wiki, "index rebuilding" fails because of the char "→", and with that the whole tiki wiki is stalled, won't produce any usable page anymore.

Uhm, apparently there are multiple versions of "right arrow" in M$ Word, which all seem to be converted to the same UTF char ... now.
Not sure anymore which of those it was... I can't reproduce in old environment, because the pages have been deleted after migration.

Will investigate if I can recover those broken pages/ chars, back later.

Now... funny thing, I didn't notice immediately, but other users later on, and when I "rebuild index" via the search control panel, I get the following errorlist for simply putting this little example on a page:

"Bla → KK"

Error(s)

Indexing failed while processing "12" (type activity) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "1" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "2" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "3" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "4" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "6" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "7" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "8" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "10" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "12" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "13" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "14" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "15" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "16" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "17" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "18" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "19" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "20" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "21" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "22" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "23" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "24" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "25" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "26" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "27" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "28" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "29" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "30" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "32" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "33" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "34" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "35" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "36" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "37" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "38" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "39" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "40" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "41" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "42" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "43" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "44" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "45" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
Indexing failed while processing "46" (type category) with the error "Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1"
The search index could not be rebuilt.
Could not perform index modification: Incorrect string value: '\xE2\x86\x92 KK...' for column 'data' at row 1

1. Kkk

This bug has been demonstrated on show2.tiki.org

Please demonstrate your bug on show2.tiki.org

This bug has been demonstrated on show.tikiwiki.org

Please demonstrate your bug on show.tikiwiki.org