Loading...
 

Display Problems in utf-8 : part of text are displayed as latin1 into encoded page utf-8.

Status
Closed
Subject
Display Problems in utf-8 : part of text are displayed as latin1 into encoded page utf-8.
Version
5.x
Category
  • Error
Feature
All / Undefined
Resolution status
Fixed or Solved
Submitted by
Bernard TREMBLAY
Lastmod by
Bernard TREMBLAY
Rating
(0)
Description

phenomenon :

On a particular configuration, not identified yet, pieces of text are displayed as latin1 in a pagecode identified as utf-8 encoded.

test and facts :

  1. From a database well encoded utf8 and used with 5.0 on windows : export sql and look at encoding in hexa editor.
  2. Create from sql file two new database one on a windows installation, the other on Linux (OVH)
  3. Copy 5.3 to both installations.
  4. Run install and uses upgrade and convert
  5. Export databases to sql
  6. Compare the sql file : identical main data
  7. On loading the same page from the two servers we obtain two different displays :
    1. - Locally the delivered html page is clean and well displayed (sourcepage save and edited in hexa and firebug)
    2. - From the OVH server all the data from database are converted to latin1(where ?, probably served by mysql converted to latin1) while the text form system (language file) are displayed in utf8.
  8. __ - The behaviour of the OVH installation is completely erratic (because the data are served converted and all indexes request and keys with accents become wrong)
  9. The Administrator general display says : "database error"__

question :

Why the data served to tikiwiki, with exactly the same parameters and data, are right on my server and converted into latin1 on the OVH configuration ?
I have not yet searched into the product, and I don't know, previously, how tikiwiki holds the encoding.

I think that who have developed these piece of product is able to tell me where the encoding to serve by mysql to the product is defined and which parameter can have an effect on the linux server and not on the one on windows.

Solution

Partial éléments of solution :

1- if $tiki-api is not set into local.php the default MYSQL (mysql.ini of the server) connection parameters are used and tiki-db-pdo is not run at init session. So as on the concerned server the default CHARSET was latin1 the installation was unavailable.
The fact that the local.php parameter $client_charset='utf8' has no effect if $api_tiki='pdo'; is not set.
This is a not consistency problem.

2- It remain some curious problem : Found lack of resources not bug, solved

  1. into listpages the categories are still displayed as latin1
  2. some option can't be run (button without effect) even by administrator. This comes from wrong commands (probably caused by latin1 values sent to ajax)

Remark : with all latin1 database request answers nothing can function.

3-I developed a module which checks (partially) and displays some system variables and those of mysql with "show variables" (as a "listpages" with warning messages). Some variables-flags have been set into the "major key init functions" so, if the flags- vars and the system-vars generated are not consistent, the module is launched with warning messages.
I think to have began, with this module, to put apart, the check of all parameters and the consistency from the system behavior at launch

Solution for 5.3 :

If the mysql server is not set to utf8 for all transactions, the local.php must be checked :
1- Set $api_tiki='pdo';
2- Set $client_charset='utf8';

Importance
9 high
Priority
45
Demonstrate Bug (Tiki 19+)
Please demonstrate your bug on show2.tiki.org
 About show2.tiki.org

To help developers solve the bug, we kindly request that you demonstrate your bug on a show2.tiki.org instance. To start, simply select a version and click on "Create show2.tiki.org instance". Once the instance is ready (in a minute or two), as indicated in the status window below, you can then access that instance, login (the initial admin username/password is "admin") and configure the Tiki to demonstrate your bug. Priority will be given to bugs that have been demonstrated on show2.tiki.org.

Version: Create show2.tiki.org instance
Demonstrate Bug (older Tiki versions)
Please demonstrate your bug on show.tikiwiki.org
 About show.tikiwiki.org

To help developers solve the bug, we kindly request that you demonstrate your bug on a show.tikiwiki.org instance. To start, simply select a version and click on "Create show.tikiwiki.org instance". Once the instance is ready (in a minute or two), as indicated in the status window below, you can then access that instance, login (the initial admin username/password is "admin") and configure the Tiki to demonstrate your bug. Priority will be given to bugs that have been demonstrated on show.tikiwiki.org.

Version: Create show.tikiwiki.org instance
Ticket ID
3578
Created
Tuesday 12 October, 2010 22:35:28 GMT-0000
by Bernard TREMBLAY
LastModif
Sunday 18 June, 2017 23:01:14 GMT-0000

Attachments

 filenamecreatedhitscommentversionfiletype 
No attachments for this item


Keywords

The following is a list of keywords that should serve as hubs for navigation within the Tiki development and should correspond to documentation keywords.

Each feature in Tiki has a wiki page which regroups all the bugs, requests for enhancements, etc. It is somewhat a form of wiki-based project management. You can also express your interest in a feature by adding it to your profile. You can also try out the Dynamic filter.

Accessibility (WAI & 508)
Accounting
Administration
Ajax
Articles & Submissions
Backlinks
Banner
Batch
BigBlueButton audio/video/chat/screensharing
Blog
Bookmark
Browser Compatibility
Calendar
Category
Chat
Comment
Communication Center
Consistency
Contacts Address book
Contact us
Content template
Contribution
Cookie
Copyright
Credits
Custom Home (and Group Home Page)
Database MySQL - MyISAM
Database MySQL - InnoDB
Date and Time
Debugger Console
Diagram
Directory (of hyperlinks)
Documentation link from Tiki to doc.tiki.org (Help System)
Docs
DogFood
Draw -superseded by Diagram
Dynamic Content
Preferences
Dynamic Variable
External Authentication
FAQ
Featured links
Feeds (RSS)
File Gallery
Forum
Friendship Network (Community)
Gantt
Group
Groupmail
Help
History
Hotword
HTML Page
i18n (Multilingual, l10n, Babelfish)
Image Gallery
Import-Export
Install
Integrator
Interoperability
Inter-User Messages
InterTiki
jQuery
Kaltura video management
Kanban
Karma
Live Support
Logs (system & action)
Lost edit protection
Mail-in
Map
Menu
Meta Tag
Missing features
Visual Mapping
Mobile
Mods
Modules
MultiTiki
MyTiki
Newsletter
Notepad
OS independence (Non-Linux, Windows/IIS, Mac, BSD)
Organic Groups (Self-managed Teams)
Packages
Payment
PDF
Performance Speed / Load / Compression / Cache
Permission
Poll
Profiles
Quiz
Rating
Realname
Report
Revision Approval
Scheduler
Score
Search engine optimization (SEO)
Search
Security
Semantic links
Share
Shopping Cart
Shoutbox
Site Identity
Slideshow
Smarty Template
Social Networking
Spam protection (Anti-bot CATPCHA)
Spellcheck
Spreadsheet
Staging and Approval
Stats
Survey
Syntax Highlighter (Codemirror)
Tablesorter
Tags
Task
Tell a Friend
Terms and Conditions
Theme
TikiTests
Federated Timesheets
Token Access
Toolbar (Quicktags)
Tours
Trackers
TRIM
User Administration
User Files
User Menu
Watch
Webmail and Groupmail
WebServices
Wiki History, page rename, etc
Wiki plugins extends basic syntax
Wiki syntax text area, parser, etc
Wiki structure (book and table of content)
Workspace and perspectives
WYSIWTSN
WYSIWYCA
WYSIWYG
XMLRPC
XMPP




Useful Tools