Category: TRIM

This should be migrated to the community site, and handled with ((doc:Organic groups)) and ((doc:User Trackers))

This should be migrated to the community site, and handled with ((doc:Organic groups)) and ((doc:User Trackers))

* make sure all is OK since TRIM was built before ((Composer)) was added to Tiki. Perhaps Jonny fixed some of these?
* Some commands made via TRIM should perhaps use the newer ((doc:Console)) commands? (which is a risk to break older installs. Perhaps use the command depending on the Tiki version?)
* If all this is too complicated, we may have to limit support to 12.x, but that would be a shame since 9.x LTS is still supported

I create an 2 new instances (one using SVN one using GIT) using the CLI interface and it worked:

{CODE(caption="installing trunk using CLI")}
[root@server app]# php tiki-manager instance:create

Create a new instance
=====================
.../...
[OK] Please test your site at https://xxxx.xxxx.com
{CODE}

Doing the same (installing 20.x) using the web manager interface I got an error:

{img fileId="1335" thumb="box"}

{img fileId="1336" thumb="box"}

---
!!!Database information question ?

I don’t usually use root for the database but I tried to check if there was a permission issues.
I filled information based on : https://doc.tiki.org/Manager#instance:create

The database part need little documentation or tips.
It differs from the way we use the Tiki-install.

What is expected ?
Does Tiki Manager create the db, does it expect the db to be created prior the instance creation ?
I usually create my db for each Tiki with specific USER/DB/PASSWORD directly.

The field "Database Prefix" is adding to the confusion. Why a prefix ?
Can’t I directly give my database name ?

---
Import an existing Tiki throw me the same error:
{CODE()}
SQLSTATE[HY000]: General error: 8 attempt to write a readonly database INSERT OR REPLACE INTO instance (instance_id, name, contact, webroot, weburl, tempdir, phpexec, app) VALUES (NULL, 'gallery.xxxxx.com', 'me@xxxxx.com', '/var/www/virtual/gallery.xxxxx.com/html', 'https://gallery.xxxxx.com', '/tmp/trim_temp', NULL, NULL) ; 
{CODE}

Is there a CLI command to import an existing Tiki ?

{syntax type="tiki" editor="plain"}

fix 'make viewdb' command in trim (sqlite3 missing: add dependency check & info?)
https://doc.tiki.org/TRIM#make_viewdb

See this output I got when I attempted to use this command on a Ubuntu 16.04 (64 bit):
{CODE(colors="shell")}
root@coprinus:~/code/trim# make viewdb
sqlite3 data/trim.db
make: sqlite3: Command not found
Makefile:22: recipe for target 'viewdb' failed
make: *** [viewdb] Error 127
root@coprinus:~/code/trim#
{CODE}

With TRIM svn r58809
^Last Changed Rev: 58718
Last Changed Date: 2016-05-27 21:34:31 +0200 (dv, 27 mai 2016) ^

I had installed in my machine:
* libsqlite3-0
* libsqlite3-0:i386
* php-sqlite3 (for all php versions in my computer)

but not
* sqlite3

Installing sqlite3 package allowed to get the output from the sqlite console:
{CODE(colors="scss", ln="1")}
root@coprinus:~/code/trim# make viewdb
sqlite3 data/trim.db
SQLite version 3.11.0 2016-02-15 17:29:24
Enter ".help" for usage hints.
sqlite> .help
.backup ?DB? FILE Backup DB (default "main") to FILE
.bail on|off Stop after hitting an error. Default OFF
.binary on|off Turn binary output on or off. Default OFF
.changes on|off Show number of rows changed by SQL
.clone NEWDB Clone data into NEWDB from the existing database
.databases List names and files of attached databases
.dbinfo ?DB? Show status information about the database
.dump ?TABLE? ... Dump the database in an SQL text format
If TABLE specified, only dump tables matching
LIKE pattern TABLE.
.echo on|off Turn command echo on or off
.eqp on|off Enable or disable automatic EXPLAIN QUERY PLAN
.exit Exit this program
.explain ?on|off|auto? Turn EXPLAIN output mode on or off or to automatic
.fullschema Show schema and the content of sqlite_stat tables
.headers on|off Turn display of headers on or off
.help Show this message
.import FILE TABLE Import data from FILE into TABLE
.indexes ?TABLE? Show names of all indexes
If TABLE specified, only show indexes for tables
matching LIKE pattern TABLE.
.limit ?LIMIT? ?VAL? Display or change the value of an SQLITE_LIMIT
.load FILE ?ENTRY? Load an extension library
.log FILE|off Turn logging on or off. FILE can be stderr/stdout
.mode MODE ?TABLE? Set output mode where MODE is one of:
ascii Columns/rows delimited by 0x1F and 0x1E
csv Comma-separated values
column Left-aligned columns. (See .width)
html HTML <table> code
insert SQL insert statements for TABLE
line One value per line
list Values delimited by .separator strings
tabs Tab-separated values
tcl TCL list elements
.nullvalue STRING Use STRING in place of NULL values
.once FILENAME Output for the next SQL command only to FILENAME
.open ?FILENAME? Close existing database and reopen FILENAME
.output ?FILENAME? Send output to FILENAME or stdout
.print STRING... Print literal STRING
.prompt MAIN CONTINUE Replace the standard prompts
.quit Exit this program
.read FILENAME Execute SQL in FILENAME
.restore ?DB? FILE Restore content of DB (default "main") from FILE
.save FILE Write in-memory database into FILE
.scanstats on|off Turn sqlite3_stmt_scanstatus() metrics on or off
.schema ?TABLE? Show the CREATE statements
If TABLE specified, only show tables matching
LIKE pattern TABLE.
.separator COL ?ROW? Change the column separator and optionally the row
separator for both the output mode and .import
.shell CMD ARGS... Run CMD ARGS... in a system shell
.show Show the current values for various settings
.stats on|off Turn stats on or off
.system CMD ARGS... Run CMD ARGS... in a system shell
.tables ?TABLE? List names of tables
If TABLE specified, only list tables matching
LIKE pattern TABLE.
.timeout MS Try opening locked tables for MS milliseconds
.timer on|off Turn SQL timer on or off
.trace FILE|off Output each SQL statement as it is run
.vfsinfo ?AUX? Information about the top-level VFS
.vfslist List all available VFSes
.vfsname ?AUX? Print the name of the VFS stack
.width NUM1 NUM2 ... Set column widths for "column" mode
Negative values right-justify
sqlite> .quit
root@coprinus:~/code/trim#
{CODE}

make backup 9 puts the data in trim/backup/10

Because instance IDs start with 0. Maybe just change IDs in the GUI so as to not affect backup locations?

2015-07-30 fixed by Rodrigo
2015-07-15: with latest svn up with Rodrigo's fixes, "Undefined index" notices are gone, but the files are still not backed up. TRIM should look in database to find the paths, fetch the data, and indicate the info in manifest.txt

TRIM's backup solution is really nice as is checks where the files are stored on disks and fetches them, which is great when these files are stored outside the web directory (which is good practice). However, this feature is currently broken because of an "Undefined index" notice

Testing running TRIM on LXLE 12.x (based on Ubuntu 12.04 LTS)

{CODE()}
Which instances do you want to backup?
Performing backup for example.org
Downloading files locally.
Unexpected local arg: Undefined
If arg is a remote file/dir, prefix it with a colon (:).
rsync error: syntax or usage error (code 1) at main.c(1246) [Receiver=3.0.9]
Obtaining database dump.
Creating archive.
{CODE}

manifest.txt reports
{CODE()}
600c2b0fb28a9b63c4d5f821255c3968 /var/www/virtual/example.org
61e97f1f6eec8ad65cfed643c55af672 /var/www/virtual/example.org/Notice: Undefined index: REQUEST_METHOD in /home/root/trim_temp/2d3155a297396b83caf09aabb4837b4f on line 2
{CODE}

Backups should exclude index tables like index_54b7e87271b52 and index_pref_en files such as templates_c/en_classic^d48aca48ad50d46d1f033585608.file.find.tpl.php

{CODE}
[root@marclaporte trim]# make delete
php -d memory_limit=256M scripts/delete.php
Default editor used (vim). You can change the EDITOR environment variable.
Default diff used (diff). You can change the DIFF environment variable.
Which instances do you want to remove? (This will NOT delete the
software itself, just your instance connection to it.)

(snip)

>>> 1
make: *** No rule to make target `1'. Stop.
{CODE}

Instead, it should report something like: "The instance has been removed"

(still a problem as of 2015-07-30)

__make update__

{CODE()}
[root@marclaporte trim]# make update
Locking website.
Obtaining latest checksum from source.
svn: url 'https://svn.code.sf.net/p/tikiwiki/code/tags/12.4svn' doesn't exist
{CODE}
(After a long wait, and some error messages, it seems to work)

__make check__

{CODE()}
[root@notrewiki trim]# svn up
At revision 56016.
[root@notrewiki trim]# make check
php -d memory_limit=256M scripts/check.php
Default editor used (vim). You can change the EDITOR environment variable.
Default diff used (diff). You can change the DIFF environment variable.

Hosts you can verify:
[0] trunk.ourwiki.net http://trunk.ourwiki.net marc.laporte@avantech.net
Which ones do you want to verify? (can select multiple, blank for all) 0

No checksums exist. What do you want to do?
[current] Use the files currently online for checksum
[source] Get checksums from repository (best option)
[skip] Do nothing
>>> source
svn: url 'https://svn.code.sf.net/p/tikiwiki/code/tags/14.0svn' doesn't exist
{CODE}

(After a long wait, and some error messages, it seems to work)

InvalidArgumentException
There are no commands defined in the "clear" namespace.

Obtaining remote checksums.
rm: cannot remove `/var/www/virtual/(snip)/templates_c/*!index.php': No such file or directory

New files were found on remote host :
0 ./maintenance.php

We are documenting some ((info:Use Cases)) which will become profiles. To be able to developer/test/improve these profiles, we would need a site like [http://www.opensourcecms.com/index.php?option=com_content&task=view&id=180|Open Source CMS] but for all profiles. This site only shows one profile.

These 20+ demo sites would provide admin access to easily test any profile. It would encourage people to generate and improve various profiles as well.

Related:
((Profile Manager))
((TRIM))

http://alexandria.wiki.sourceforge.net/Hosted+Apps

http://profiles.tikiwiki.org/SourceForge_Software_Project


((SourceForge Hosted Apps))

TRIM should use ssh-rsa keys instead of ssh-dss. For more information see https://www.archlinux.org/news/openssh-70p1-deprecates-ssh-dss-keys/

Various *.tikiwiki.org sites are managed by different volunteers on various hosts. That is good.

Each domain should be systematically copied over to someone else.

Something like:
||domain|managed by|backed up by
fr.tikiwiki.org|mose|marclaporte
themes.tikiwiki.org|marclaporte|luci||


Related:
http://dev.tikiwiki.org/tiki-view_tracker_item.php?itemId=482

Document for ((Suite:ClearOS)) for backup on same server, and these backups archives can backed up off-server with ((suite:Syncthing))

Why does this get deleted:

cvs update: warning: templates_c/.cvsignore was lost
U templates_c/.cvsignore
cvs update: warning: templates_c/.htaccess was lost
U templates_c/.htaccess
cvs update: warning: templates_c/README was lost
U templates_c/README
cvs update: warning: templates_c/index.php was lost
U templates_c/index.php



2009-04-17 It's better for branches/3.0 but it still happens somethinges. (ex.: in temp) Need to be able to duplicate and solve.

2009-04-19 Should be ok now.

Like many web applications, to install TikiWiki, you need to have already created your database (via phpMyAdmin or cPanel).

Maybe TikiWiki could handle this task using the mysql root/super user account?


Otherwise, maybe try via cPanel API if available (TRIM as well could try this)

We should brainstorm on this.

Trim fails to install a Tiki instance.

First time using TRIM. It failed to install tiki. Won't validate my database credentials.

I've attached a screenshot of the terminal window showing trim, the database credential file of a working install, and running version of tiki, to show that the server is running, with the exact credentials that trim fails with.

It worked before but...
Using TRIM with make commands does not work anymore here:

{CODE()}
[root@vm5163 trim]# make instance
PHP Parse error: syntax error, unexpected '.', expecting ',' or ';' in /var/local/trim/src/libs/audit/Checksum.php on line 64

Parse error: syntax error, unexpected '.', expecting ',' or ';' in /var/local/trim/src/libs/audit/Checksum.php on line 64
make: *** [instance] Error 255
[root@vm5163 trim]# php -v
PHP 5.5.38 (cli) (built: Jul 21 2016 12:51:12)
Copyright (c) 1997-2015 The PHP Group
Zend Engine v2.5.0, Copyright (c) 1998-2015 Zend Technologies
{CODE}

__Use case 1- mirror a site__
Be able to provide on same server (different URL) or different server a fresh identical copy of Tiki with all data, including files that are not in DB.

a) Could be to offer a backup site on a different server in case main server is down. This backup site could be in the customer's office, so avoid any cloud lock-in: "You have a fully working instance with all data (less than x hours old) and all the FLOSS code on a computer you physically control" And this sticker can go on the box :-)
https://www.stickermule.com/marketplace/3442-there-is-no-cloud

b) Could be part of a dev/staging/prod routine. Ex. push data from prod to staging and/or dev to 'reset' and now we start developing again.
http://12factor.net/dev-prod-parity

c) Could conceivably be used to have several copies of a site and load balance via DNS but there would likely be better ways to achieve this... (ex. MariaDB Galera Cluster)

d) demos (OpenSourceCMS type demo to test/develop and show off profiles)

Perhaps:
make clone : a one-time copy
make mirror: setup automated recurring copy

This script should have access to ((doc:system configuration)) and to run a ((doc:profile)). An example is $site_closed eq 'y' and $site_closed_msg="This is a copy of XYZ..."

__ Use case 2- pre-dogfood (test upgrade)__
Like:
* https://sourceforge.net/p/tikiwiki/code/HEAD/tree/trunk/doc/devtools/update.dogfoodserver.sh
* https://tiki.org/Pre-Dogfood+Server

That script works but it's a manual configuration every time. TRIM can backup, deploy and upgrade so why not combine? :-)

a) Check at any time how an upgrade would impact.
Could be to the tip of same branch or to the tip of a future branch or trunk.

b) Could be part of a dev/staging/prod routine

And adding a conflict alert with this would be really nifty:
https://dev.tiki.org/Check+if+the+update+would+cause+conflicts

Especially combined to the automated updates:
https://doc.tiki.org/TRIM#To_setup_automated_updates

Perhaps:
make cloneandupdate (test minor update)
make cloneandupgrade (test minor upgrade)

This script should have access to ((doc:system configuration)) and to run a ((doc:profile)). An example is $site_closed eq 'y' and $site_closed_msg="This is a copy of XYZ..."

PECL's ssh2 extension is poorly maintained, hard to install and unreliable even when it has been successfully installed. Testament to just how difficult to install are all the comments located on the third website that comes up when you do a search for "php ssh" on Google (without the double quotes):

http://kevin.vanzonneveld.net/techblog/article/make_ssh_connections_with_php/

Testament to it's unreliability even after it has been successfully installed is this:


http://www.frostjedi.com/phpbb/viewtopic.php?f=46&t=13223

In light of this, I think TRIM ought to use phpseclib (http://phpseclib.sourceforge.net/). It would save everyone a lot of heartache, from the end users, who wouldn't need to ask for support, to the developers, who wouldn't have to spend as much time providing support for the deficiencies in PECL's ssh2 extension.