TS3 crashing, disk I/O error

[serano]

Hi,

A few weeks ago on a new box I installed Teamspeak 3. Everything has been running smoothly until today. The server crashed and there was no way to actually get it started. No pid was created, no process started nor was there an entry in the logfile that the startscript generated.

In a desperate attempt I decided to reinstall the whole thing and start from scratch. Install went smooth as always, server was up within a matter of seconds.
1 hour later the server crashed with the same errors it did before.

The teamspeak account has its own linux user and folder and runs no other processes whatsoever.

Underneath you can find the full, albeit edited, log that server generated.

serverlog

2011-09-17 16:45:30.897823|INFO    |ServerLibPriv |   | Server Version: 3.0.0 [Build: 14957], Linux
2011-09-17 16:45:30.899752|INFO    |DatabaseQuery |   | dbPlugin name:    SQLite3 plugin, Version 2, (c)TeamSpeak Systems GmbH
2011-09-17 16:45:30.900051|INFO    |DatabaseQuery |   | dbPlugin version: 3.7.3
2011-09-17 16:45:30.901570|INFO    |DatabaseQuery |   | checking database integrity (may take a while)
2011-09-17 16:45:30.951699|INFO    |SQL           |   | pruning old database log entries where timestamp is older than 90 days
2011-09-17 16:45:31.096423|INFO    |Accounting    |   | Licensing Information
2011-09-17 16:45:31.096595|INFO    |Accounting    |   | type              : Non-profit
2011-09-17 16:45:31.096988|INFO    |Accounting    |   | starting date     : Mon Sep 12 00:00:00 2011
2011-09-17 16:45:31.097076|INFO    |Accounting    |   | ending date       : Wed Sep 12 00:00:00 2012
2011-09-17 16:45:31.097152|INFO    |Accounting    |   | max virtualservers: 10
2011-09-17 16:45:31.097222|INFO    |Accounting    |   | max slots         : 512
2011-09-17 16:45:31.116889|INFO    |FileManager   |   | listening on 0.0.0.0:30033
2011-09-17 16:45:31.119162|INFO    |VirtualSvrMgr |   | executing monthly interval
2011-09-17 16:45:31.119433|INFO    |VirtualSvrMgr |   | reset virtualserver traffic statistics
2011-09-17 16:45:31.290545|INFO    |VirtualServer |  1| listening on 0.0.0.0:9987
2011-09-17 16:45:31.291878|INFO    |VirtualServer |  1| client 'server'(id:0) added privilege key for servergroup 'Server Admin'(id:6)
2011-09-17 16:45:31.291911|WARNING |VirtualServer |  1| --------------------------------------------------------
2011-09-17 16:45:31.291929|WARNING |VirtualServer |  1| ServerAdmin privilege key created, please use the line below
2011-09-17 16:45:31.291946|WARNING |VirtualServer |  1| token=AXoq78IeieggBhAKDKH7ShFiAQQ1vQziDYlrzGnG
2011-09-17 16:45:31.291962|WARNING |VirtualServer |  1| --------------------------------------------------------
2011-09-17 16:45:31.299786|INFO    |CIDRManager   |   | updated query_ip_whitelist ips: 127.0.0.1,
2011-09-17 16:45:31.300380|INFO    |Query         |   | listening on 0.0.0.0:10011
2011-09-17 16:45:57.277591|INFO    |VirtualServer |  1| client (id:2) was added to servergroup 'Server Admin'(id:6) by client 'server'(id:0)
2011-09-17 16:45:57.280127|INFO    |VirtualServer |  1| client 'Serano'(id:2) used privilege key 'AXoq78IeieggBhAKDKH7ShFiAQQ1vQziDYlrzGnG' and was added to servergroup 'Server Admin'(id:6)
2011-09-17 16:46:43.570450|INFO    |VirtualServer |  1| client 'Serano'(id:2) added privilege key for servergroup 'Server Admin'(id:6)
2011-09-17 16:48:02.322058|INFO    |VirtualServer |  1| client (id:3) was added to servergroup 'Server Admin'(id:6) by client 'server'(id:0)
2011-09-17 16:48:02.323231|INFO    |VirtualServer |  1| client 'Scania'(id:3) used privilege key 'c2PFF2lMltpQBpIhOEpbcNUdlkCtVRS8ZWJi7sLv' and was added to servergroup 'Server Admin'(id:6)
2011-09-17 16:56:48.399650|INFO    |VirtualServer |  1| client 'Scania'(id:3) was added to channelgroup 'Channel Admin'(id:5) by client 'Scania'(id:3) in channel 'Lobby'(id:1)
2011-09-17 17:11:24.346810|ERROR   |DatabaseQuery |   | db_exec failed disk I/O error
2011-09-17 17:11:24.346998|ERROR   |DatabaseQuery |   | db_exec() insert into clients( server_id,  client_unique_id,  client_nickname,   error: disk I/O error
2011-09-17 17:11:24.347869|CRITICAL|Client        |  1| Assertion "m_ClientDBID != 0" failed at common/chanclients/client.cpp:237;

folder permissions

teamspeak@surreal:~/teamspeak3-server_linux-amd64$ ls -l
total 6740
-rw-r--r-- 1 teamspeak teamspeak   33571 2011-08-09 10:38 CHANGELOG
drwxr-xr-x 2 teamspeak teamspeak    4096 2011-08-09 10:38 doc
drwx------ 3 teamspeak teamspeak    4096 2011-09-17 18:45 files
-rwxr-xr-x 1 teamspeak teamspeak  216264 2011-08-09 10:38 libts3db_mysql.so
-rwxr-xr-x 1 teamspeak teamspeak 1055464 2011-08-09 10:38 libts3db_sqlite3.so
-rw-r--r-- 1 teamspeak teamspeak   24099 2011-08-09 10:38 LICENSE
-rw-r--r-- 1 teamspeak teamspeak     835 2011-09-17 18:29 licensekey.dat
drwx------ 2 teamspeak teamspeak    4096 2011-09-17 18:45 logs
-rw-r--r-- 1 teamspeak teamspeak       1 2011-09-17 18:45 query_ip_blacklist.txt
-rw-r--r-- 1 teamspeak teamspeak      10 2011-09-17 18:45 query_ip_whitelist.txt
-rw-r--r-- 1 teamspeak teamspeak     112 2011-09-17 18:30 serverkey.dat
drwxr-xr-x 2 teamspeak teamspeak    4096 2011-08-09 10:38 serverquerydocs
drwxr-xr-x 4 teamspeak teamspeak    4096 2011-08-09 10:38 sql
-rwxr-xr-x 1 teamspeak teamspeak 5266920 2011-08-09 10:38 ts3server_linux_amd64
-rwxr-xr-x 1 teamspeak teamspeak     432 2011-08-09 10:38 ts3server_minimal_runscript.sh
-rw-r--r-- 1 teamspeak teamspeak       5 2011-09-17 18:45 ts3server.pid
-rw-r--r-- 1 teamspeak teamspeak  219136 2011-09-17 18:56 ts3server.sqlitedb
-rwxr-xr-x 1 teamspeak teamspeak    2842 2011-08-09 10:38 ts3server_startscript.sh
drwxr-xr-x 2 teamspeak teamspeak    4096 2011-08-09 10:38 tsdns
teamspeak@surreal:~/teamspeak3-server_linux-amd64$

Could someone please help me out what to do. I've been managing multiple servers for the past few years with teamspeak running on them. And so far I haven't encountered a problem like this before.

[serano]

The problem was troubleshooted and solved.

It is worth mentioning that this error also occurs when the disk space is full as it was in my case. Imo a check about that could be integrated into the log files.

Possible reasons, pointed to me by pcgod on #teamspeak irc, why you might get this error are:

* database corrupt
* Out of disk space / out of diskspace in the program/database directory.
* /tmp is full

[crasy_andi]

I'm running a ts3 server on Linux 10.04 LTS x86 and it use MySQL not Sqlite.
The server.ini looks like this:
machine_id=
default_voice_port=10000
voice_ip=0.0.0.0
licensepath=
filetransfer_port=30033
filetransfer_ip=0.0.0.0
query_port=10011
query_ip=0.0.0.0
query_ip_whitelist=query_ip_whitelist.txt
query_ip_blacklist=query_ip_blacklist.txt
dbplugin=ts3db_mysql
dbpluginparameter=ts3db_mysql.ini
dbsqlpath=sql/
dbsqlcreatepath=create_mysql/
dbconnections=10
dblogkeepdays=90
logpath=logs
logquerycommands=0
dbclientkeepdays=30
I changed the server-ip in this post.
Since I updated my server it crashs nerly every day with this message:
2012-03-17 16:19:51.363041|ERROR |DatabaseQuery | | db_exec() insert into clients ( server_id, client_unique_id, client_nickname error: Query was empty
2012-03-17 16:19:51.366972|CRITICAL|Client | 1| Assertion "m_ClientDBID != 0" failed at common/chanclients/client.cpp:237;
I don't know where the problem is.
Can anyone help me with this?