No. The ping is the same all the time, even when the problem occures.
(When someone is downloading something ping jumps high.)
---post's merged-------
Any other ideas anyone? Maybe TS3 ports are blocked or something? I don't even know where should I look to solve this problem...