Category: 18.x Regression

Hello folks,

I found out a strange behaviour at least for .pdf files:

I use a Tracker with a field of type "files" to provide a "file-pool" respectively a download area for an npo's member are - Tiki 18.0 alpha. On another site with Tiki 17 the error does not appear.
File gallery is set to store in directory on both sites.

__When a user tries to upload a file of any size that was ===either created on a Mac or that was sent from a Mac=== by email (so has been stored/saved on a Mac), it is not possible to upload to Tiki via the files field.__

Error: Upload impossible. There are restrictions.
(translated)

The same file __can be uploaded via the file gallery__ - but then it does not appear in the tracker.

{QUOTE(replyto="jonnyb")}
Jonny in IRC at 26 March 2018:
"4:57:20 PM - jonnyb: althugh the error looks like one i exposed recently in 18.x - before when it errored it just removed the tracker item edit modal so you lost all your changes an so i fixed that, but i should not have introduced any new errors - maybe the file is too big, or doesn 't meet the mime type or somthing? check the extension is .pdf etc, maybe it's something like that?"
{QUOTE}

When I recreate the file (I use Ubuntu 14.04), by importing to a software and save as new file or I split and remerge it with pdfSAM, __the newly ===recreated=== file can be uploaded__ via the tracker field files.

It is not enough to simply save a copy from the .pdf viewer, but it must be really created new. pdfSAM is a workaround for multipage files, but not sufficient for a growing amount of files.

As I am stubborn in the npos where I am engaged, that we need OS independend solutions, not excluding for ex Linux users, I cannot expect from Mac users to not being able to use the Tracker field of type files and even not be able to privide files to the teams.

I am wondering why this occurs, cause afaik the main developer of this field type is a Mac user himself -Jonny, right assumtion ;-) ?

Please help or comment.

If no quick fix possible, I'll post a bugreport including this description later on today.

Thx for help and considerations.
Torsten

I tested today the plugin helper ui to select fields in plugin trackerlist, but I had no way to get my typing stored/saved in the page for the "fields" param: numbers got lost when clicking elsewhere, and text (field names) didn't make any matxh in the dropdown.
This used to work with no problems in the past (Tiki15 LTS at least).
Editing by hand in the wiki textarea (aside of the plugin popup helper ui) worked as expected for the param "fields" in plugin trackerlist, but new users got confused aboput why that text input/dropdown for "fields" in plugin trackerlist didn't work in the popup helper.

When you upload the output of a favicon generator like [https://realfavicongenerator.net|Real Favicon Generator] into file galleries (in order to use the file galleries as a repository of files for other co-admins, for instance), the uploading of safari pinned tabs images results in a crash of the thumbnail generator, yielding the error message "Warning: imagecreatefromstring(): Data is not in a recognized format in MYHOME/tiki-18.8/lib/images/gd.php on line 70

Warning: Cannot modify header information - headers already sent by (output started at MYHOME/tiki-18.8/lib/images/gd.php:70) in MYHOME/tiki-18.8/tiki-download_file.php on line 395

Warning: Cannot modify header information - headers already sent by (output started at /homepages/41/d104554784/htdocs/agim/tiki-18.8/lib/images/gd.php:70) in MYHOME/tiki-18.8/tiki-download_file.php on line 404

Warning: Cannot modify header information - headers already sent by (output started at MYHOME/tiki-18.8/lib/images/gd.php:70) in MYHOME/tiki-18.8/tiki-download_file.php on line 442
�PNG " and some binary (!) image content instead of a thumbnail...

I'm unable to reply or post to comments to my tracker items with some default Linux browsers, such as __Chromium__ or __SeaMonkey__ (default in [http://www.lxle.net/|LXLE]) internet browsers (fine with Firefox)

Reproduced here with user "xavi" (with no admin rights, in case it matters):
https://dev.tiki.org/tiki-view_tracker_item.php?itemId=6689&threadId=6491&cookietab=1

On a brand new trunk Revision: 63992

{img fileId="1130" thumb="box"}

When ''Automatic indexing of file content'' is active, trying to upload pdf files fails.

The pdf file is still uploaded but the end user is told that upload failed.

Try uploading pdfs in [http://nycdwight-11908-6600.show.tikiwiki.org/tiki-upload_file.php?galleryId=4] ! (beware of the 8MB size limit) (verify that ''Automatic indexing of file content'' is still active)

They display an error « File upload failed: SyntaxError: JSON.parse: unexpected character at line 1 column 1 of the JSON data ».
Only for pdfs.

This is an example return answer to /tiki-ajax_services.php?controller=file&action=upload_multiple :

<feff>{"files":[{"size":15295,"name":"document_BBB_02_argentine.pdf","type":"application\/pdf","fileId":"5788","galleryId":"137","md5sum":"7a035db1d92779f8dcdefe083b292d94","info":{"fileId":"5788","galleryId":"137","name":"Document BBB 02 Argentine","description":"","created":"1554159196","filename":"document_BBB_02_argentine.pdf","filesize":"15295","filetype":"application\/pdf","data":null,"user":"Jyhem","author":"","hits":"0","maxhits":null,"lastDownload":null,"votes":null,"points":null,"path":"90792de52961c34118f976ebe4af3a75","reference_url":null,"is_reference":null,"hash":"7a035db1d92779f8dcdefe083b292d94","search_data":"\n","metadata":"","lastModif":"1554159196","lastModifUser":"Jyhem","lockedby":"","comment":"","archiveId":"0","deleteAfter":null},"syntax":"{img fileId=\"5788\" thumb=\"box\"}"},{"size":15741,"name":"document_BBB_01_bresil.pdf","type":"application\/pdf","fileId":"5789","galleryId":"137","md5sum":"50d71753a6487af8c023f28d8df58d24","info":{"fileId":"5789","galleryId":"137","name":"Document BBB 01 Bresil","description":"","created":"1554159196","filename":"document_BBB_01_bresil.pdf","filesize":"15741","filetype":"application\/pdf","data":null,"user":"Jyhem","author":"","hits":"0","maxhits":null,"lastDownload":null,"votes":null,"points":null,"path":"c84d5b2eb5e278b26a0d60ab7bc4c606","reference_url":null,"is_reference":null,"hash":"50d71753a6487af8c023f28d8df58d24","search_data":"\n","metadata":"","lastModif":"1554159196","lastModifUser":"Jyhem","lockedby":"","comment":"","archiveId":"0","deleteAfter":null},"syntax":"{img fileId=\"5789\" thumb=\"box\"}"}]}


The issue seems to be one or more invisible BOM (zero-length nonbreaking spaces) character before the json string.

My guess is, this regression is related to our changing the way pdfs are indexed. Since Tiki18, we use a php library bundled with Tiki. Before, we relied on a command line executable. Sadly, reverting to the old way of putting the following in tiki-admin.php?page=fgal#contentfgal_admin-5 does not work:
|| application/pdf: | pdftotext -enc UTF-8 %1 - ||

I can make a user menu, but it doesn't display in the application menu. (This regression may have happened in an earlier Tiki version - probably it did, but I don't know when.)

When a user runs the user wizard, one of the few things he or she can set is country. But the information entered there is not persistent, upon reload it is forgotten.

Possibly the same bug that we had in the user preference.

user preferences are not stored in tiki_tracker_item_fields, so the query run for a user preference field 27, and value 'csabi' will not work

SELECT COUNT(*) FROM `tiki_tracker_item_fields` WHERE 1=1 AND `fieldId` = 27 AND `value` = 'csabi';

do we need a distinct_userpreference validator?
Then it would work across multiple user trackers, and we could solve the long standing ticket
https://dev.tiki.org/item3611-no-built-in-way-to-prevent-realName-user-pref-duplicates-automatically

Dear folks, if you go to this page at:
https://thepatriotwoodwiki.org/Western-White-Pine
or
https://thepatriotwoodwiki.org/Eastern-White-Pine
or
https://thepatriotwoodwiki.org/California-Incense-Cedar
or
https://thepatriotwoodwiki.org/HomePage

Basically anywhere I have list files in place, if you click on the wrench icon at the left of each file, then click on "Browser Display", you are redirected to an unrelated page in our wiki, the same page for all the files. I cannot make heads or tails on this one.

What I would expect to occur when "Browser Display" is clicked on, is the image to display in browser view.

A show instance will be created to try to reproduce this bug.
I don't recall this issue before my tiki 18.3 updgrade.

Issue was introduced in our forums at https://tiki.org/forumthread71245-Weird-Action-w-File-Browser-Display?topics_offset=13

We've just done a sucessful in situ upgrade from TW18.5 to TW18.6.

Post upgrade, Watch notification e-mails seem to have a gained a newline prefix to the message subject.
This is also evident in the TW log file where the receiving user and the subject are now on separate lines.

Taken from the source of the received e-mail...
pre upgrade Subject: wiki page "17821020_DB_1A_pp_87-88" changed by user-real-name
post upgrade Subject: =?UTF-8?Q?=0Awiki=20page=20?= =?UTF-8?Q?"18360215=5FAccounting=5Fof=5FEstate=5Fof=5FJohn=5FReaves"=20?= =?UTF-8?Q?changed=20by=20user-real-name?=

This is only affecting Watch notification emails. Email associated with notifications from the wiki's internal Message system are unaffected. That makes me think its not a generic system/sendmail subsystem issue.

Did 18.6 introduce a new configuration option I've yet to find?

I don't think I can easily demonstrate this on the "show" system since mail isn't enabled there, but I will add a couple of screen shots showing the issue in our log files.

Thanks,
M

Update #1 - I've done the best I'm able with the show instance. I've enabled both Watches and the internal Message system. I added a wiki page and the watch notification (log ID 7) shows the subject on a separate line to the receiving user. I created a new user and sent that user a message. Log ID 10 shows that receiving user and the message subject on the same line. Screen snip attached.

I've also attached two screen snips from our system showing the log entries for a Watch notification from just before and just after the TW18.5 to TW18.6 upgrade.

I can also confirm that Tracker notification e-mails are NOT affected by the addition of this newline prefix to the subject line since the upgrade.

It is not possible to place a hyperlink to this -valid- URL:
{CODE(Colors="Tiki")}
https://www.stadt-zuerich.ch/kultur/de/index/institutionen/nonam_indianer_inuit_kulturen/fuehrungen---freizeitangebote/let-s-talk---mari-boine--die-stimme-des-nordens.html
{CODE}

If you place this in square brackets or use the insert external link GUI function, Tiki will show the URL instead of a given alternative text, and interpret the double dashes as strikethrough.

Tiki should NEVER interpret Wiki syntax in URLs...

On creating a group, group is created but a false error warning is displayed wrongly.

Check adding a group on the instance.

On Safari the error is different:
{CODE()}AJAX: error 0 (rejected) for URL: tiki-ajax_services.php?controller=group&action=new_group&modal=1{CODE}

Lately I have a troubles when going to:
https://dev.tiki.org/User = WSoD
--https://dev.tiki.org/My = 503-- this must have been a coincidence when the server was unresponsive again - it does not exist so it should return 404 page {sign user="luci" datetime="2018-09-26T11:30:28+00:00"}
https://dev.tiki.org/my is working.{sign user="Bsfez" datetime="2018-09-27T07:24:04+00:00"}

But
https://dev.tiki.org/tiki-user_information.php#contentuser_information-2
Is ok

Several (all?) of my recent edits to ((Tiki18)) page here in dev.t.o send me (user "xavi") to the dev.t.o homepage . That's new, it didn't happen to me months ago (nior in earlier tiki versions).
Regression?
---
Update: reproduced similar issue in trunk (from yesterday) {sign user="xavi" datetime="2018-09-28T09:22:41+00:00"}

I used the Draw plugin in a wiki page, specifying an SVG file. After saving the page, when I click on the Edit icon for the image, the edit dialog displays with "Edit: <file name>" in the title bar, but in the body there is only a No Route Found error message.

I can select a theme stylesheet, apply it to the site, view the stylesheet , and edit the stylesheet. Checking the stylesheet update time, I can see the the edit took place, and I can find the updated CSS in the file. __But__, the site continues to use an unedited version of the stylesheet, it seems. A DOM inspector shows that my edit didn't take place (I changed the body font-size property from 14px to 16px). There's no visual evidense of this change in the page appearance.

What's worse, I can no longer change the site's theme. Using the Look & Feel selector, I can select another site theme, but the switch-theme module, which overrides the site default, can't be used (the selector dropdown is disabled in the HTML). So the theme that I edited (although in its pre-edit state) is stuck as the theme in use.

This feature should be fixed, or else killed, and people directed to use Custom Less or Custom CSS instead, IMO.

This is a duplicate of the bug report submitted by Xavi...

On a file gallery description if you copy/paste or insert an emojis from your mobile on save you’ll lost your edit and get a error 500.

Currently, German legislature is pondering the implementation of the dreaded article 17 (formerly Article 13) of the EU Copyright Directive into German law. Similar implementations must be under way in all member states.

This Article demands that "platform providers" (as general as this term sounds, this means everyone from Youtube down to a privately run Tiki installation) MUST provide online upload filtering of media that could possibly be copyrighted, which translates into "ALL media" AND a "red button" with which copyright holders are enabled to immediately (!) block content they find and deem infringes their held copyrights.

As the IT magazine "c't" informes, the proposed "German copyright service providers law" describes several stages that user uploaded media MUST go through before they may go online.

Platforms shall sign contracts with copyright organizations such as GEMA (for music) etc. Licensed content may go online directly. Other content will have to undergo online filtering. Depending on filtering results, content may be blocked or the copyright owner may be directly informed of the suspected infringement.

It has been speculated previously, that only VERY large companies like Youtube (Google) will at all be (technically) able to run such filter services, looking at the sheer amount of computing power and I/O bandwidth necessary. Youtube and Co could offer filter services for smaller platforms that lack the ressources, but possibly not free of charge. This has been critized as giving Youtube and Co. huge power and wide control over the internet, given the fact that technically there is no difference between filtering for copyright infringement and filtering for unwanted political content, in other words: Once installed, such filters could easily be used for censorship of the internet. This led to mass protest by young people all over Europe. The ruling conservative party promised angry voters that the implementation of the EU directive would not implement upload filtering, but apparently they broke their promise.

According to the government, filters SHALL be set to "mildly" filter, enabling the majority of content to go online, but mechanisms must be implemented for copyright owners to protest, as well as a "red button" with an immediate (!) takedown effect.

When you are in file galleries, some file galleries may contain more images than others. If you are on page 2 (or subsequent) of the sub-gallery you are currently browsing, the according page is loaded with parameter offset=25.

From this view, you can directly click another gallery from the tree that is displayed on the left-hand side.

But ALL subgalleries in the tree are linked with parameter offset=25, so when you click one that does not have more than 25 entries, you get the error message (information) that there is nothing to be displayed...

So either change the logic that all subgalleries in the left-hand tree are linked with their root (offset 0) or display the last possible page of that gallery, when it gets clicked. I would prefer the former.

Thanks
hman

Uploading png files to file galleries get them corrupted somehow. See screenshots (I'll upload them here in short). And a pdf file I uploaded to the file gallery, after I downloaded it again from tiki, I couldn't see its contents properly (see the other screenshot; some font seems to be missing). If I open the source pdf file (not passing through tiki file gallery but directly the one I had in my computer from elsewhere), I can see the contents of that pdf as expected
{img fileId="1191" thumb="box"}
{img fileId="1192" thumb="box"}
{img fileId="1193" thumb="box"}
{img fileId="1194" thumb="box"}

Fairly standard setup on Ubuntu 16.04 (see ((doc:Ubuntu Install)) ), with mysql 5.7.x, and php 7.0.x (originally, but same issue with php 5.6, 7.0.x, 7.1.x, 7.2.x). Using gd (imagemagick installed also after I hit the bug the first time, just in case it automagically helped, but it didn't - I didn't remove gd, btw)

I've tested also using tiki15svn, and I couldn't use it due to some weird error I had never seen before of zend session validator class not finding Id.php in place. (!). Therefore, I couldn't test tiki15svn in the same server.

I tested using tiki17svn, and file uploads worked as expected (nice!).
I tested using tiki18svn, or tiki trunk, and I got the issue I reported.

----
Gosh, similar issue might be happening on dev.t.o (at least for me; is it only me???): try to see the png files that I produced as screenshots, e.g.:
https://dev.tiki.org/tiki-list_file_gallery.php?galleryId=1&fileId=1194&view=page
----
Update: avoided the issue by means of changing the storage of files in file galleries from db to file system. {sign user="xavi" datetime="2018-05-10T14:07:57+00:00"}

Therefore, the issue might be specific to Tiki18+ and Mysql5.7 maybe? (in another production server of mine, the setup is fairly similar in Ubuntu 16.04, but with MariaDb instead of MySQL 5.7, and I didn't see the issue of images getting corrupted).
As a consequence, I removed the tag "Release blocker", since I'm not sure how many production server are out there with MySql 5.7 and storing files in database. Feel free anyone to re-tag to release blocker if this is too critical for someone else.


I removed "19.x" categorization because branch 19 doesn't exist yet. The category "regression from version 18 to 19" is accurate here and already assigned. {sign user="chibaguy" datetime="2018-07-12T07:47:53+00:00"}

The "Find" button on tiki-listpages.php only, when clicked, causes some page reloading but no form appears. I didn't see an JavaScript errors reported.

The sameas parameter was removed in Tiki 18. Therefore, if one attempts to re-use footnote number x using
{CODE(theme="default")}{footnote sameas="x"}{CODE}
the plugin call will display "Error: Empty footnote" instead of a reference to the existing footnote with the number x.

For example,
{CODE(colors="tiki" theme="default")}
Lorem ipsum dolor sit amet, pede reiciendis cras sapien, varius neque consectetuer tincidunt in ipsum, dui nec dis cras.{FOOTNOTE()}Wikipedia contributors. "George Nakashima." Wikipedia, The Free Encyclopedia. Wikipedia, The Free Encyclopedia, 3 Oct. 2017. Web.10 Oct. 2017{FOOTNOTE} Dui dapibus cras ligula, aliquam ligula. Sit eu euismod aliquam orci orci hendrerit, nullam morbi, et cursus, maecenas quisque blandit enim.{footnote sameas="1"} Lacus sagittis dapibus sed, lorem lacus donec, fusce eros arcu rutrum adipiscing eget rutrum.
{CODE}
... displays:
Lorem ipsum dolor sit amet, pede reiciendis cras sapien, varius neque consectetuer tincidunt in ipsum, dui nec dis cras.{FOOTNOTE()}Wikipedia contributors. "George Nakashima." Wikipedia, The Free Encyclopedia. Wikipedia, The Free Encyclopedia, 3 Oct. 2017. Web.10 Oct. 2017{FOOTNOTE} Dui dapibus cras ligula, aliquam ligula. Sit eu euismod aliquam orci orci hendrerit, nullam morbi, et cursus, maecenas quisque blandit enim.{footnote sameas="1"} Lacus sagittis dapibus sed, lorem lacus donec, fusce eros arcu rutrum adipiscing eget rutrum.
---
{footnotearea}
---
You can also go to this page at https://doc.tiki.org/PluginFootnote and please see the "Would produce" example, the same issue occurs.

After uploading .h5p files to unlock the different content types, some of the creation wizards do not display all of the necessary information, preventing the creation of the new content. I've compiled a list of the different content types and how functional the editor is with each:

✅ Accordion - Fully functional
? Agamotto - Only an option for a title
✅ Arithmetic Quiz - Fully functional
✅ Audio Recorder - Fully functional
? Chart - Partially functional - bar/slice color and text color cannot be set
❌ ~np~Collage - Only the text string '[field:group:collage:collage]' gets displayed~/np~
✅ Column - Appears to be fully functional
❌ ~np~Course Presentation - Only the text string '[field:group:coursepresentation:presentation]' gets displayed, as well as behavior and text overrides.~/np~
? Dialog Cards - Only some text boxes, no entries for changing/adding cards
? Documentation Tool - Only an option for a title
❌ ~np~Drag and Drop - Shows the text string '[field:group:wizard:question]', an empty collapse, and a collapse for text overrides~/np~
? Drag the Words - Functional, but has an empty collapse after the other content
? Fill in the Blanks - Functional, but has an empty collapse after the other content
❌ ~np~Find Multiple Hotspots - Just the text string '[field:group:wizard:imageMultipleHotspotQuestion]' gets displayed~/np~
❌ ~np~Find the Hotspot - Just the text string '[field:group:wizard:imageHotspotQuestion]' and a dropdown for text overrides get displayed~/np~
? Flashcards - Only a textbox for 'Task description' gets displayed
✅ Guess the Answer - Fully functional
❔ Iframe Embedder - Does not appear to get parsed by Tiki, which is probably for the best.
❌ ~np~Image Hotspots - Some inputs get displayed, but a number are only text, such as '[field:text:colorSelector:color]' and '[field:group:imageCoordinateSelector:position]'~/np~
? Image Juxtaposition - Mostly functional. When editing an image, error message comes up indicating 'Invalid format'.
✅ Image Sequencing - Fully functional
? ~np~Image Slider - Mostly functional, but appears to not parse one input, '[field:group:showWhen:aspectRatio]'~/np~
❌ ~np~Impressive Presentation - Only displays '[field:group:impressPresentationEditor:viewsGroup]', but it appears this content type is still in alpha~/np~
❌ ~np~Interactive Video - Only displays '[field:group:wizard:interactiveVideo]', behavioral settings, and text overrides. From my experience in other H5P editors, this input has something akin to tabs.~/np~
? Mark the Words - Appears functional, but has empty collapse after other inputs
❌ Memory Game - Displays nothing at all.
? Multiple Choice - Appears fully functional, but has blank collapse after other inputs
? ~np~Personality Quiz - Mostly functional, but has missing inputs '[field:text:colorSelector:buttonColor] and '[field:text:colorSelector:progressbarColor]'~/np~
❔ Questionnaire - Not parsed by tiki
? Quiz (Question Set) - No inputs for editing/adding questions, but everything else seemed functional
✅ Single Choice Set - Fully functional
Speak the Words - Not tested (requires browser with speech recognition)
Speak the Words Set - Not tested (requires browser with speech recognition)
✅ Summary - Fully functional
✅ Timeline - Fully functional
? ~np~True/False Question - No option to select correct answer, '[field:select:radioGroup:correct]'~/np~
✅ Twitter User Feed - Fully functional
---
''Legend:''
✅ Fully functional
? Partially working/partially broken
❌ Completely Unusable
❔ Unclear