rescuetimelinuxuploader says uploading succeeds but no activity can be seen on website

Bug #522046 reported by Erdem Bayer
44
This bug affects 7 people
Affects Status Importance Assigned to Milestone
RescueTime Linux Uploader
Fix Released
Critical
Dirk T

Bug Description

Hi

I have been using rescutimelinuxuploader for more than a week now. I run the program from bash and see that it correctly logs all my usage data. I have installed the firefox plug-in and able to see that is logs the exrtended info correctly. The output says the program succeeds uploading encoded data, and I have verified it by:

$ find .rescuetime/finished/ -type f |wc -l
252
find .rescuetime/replys/ -type f |wc -l
284

Yes, some of the data fails to upload, however I can not see any data on website, even the ones that it says uploaded successfully.

What could be the problem and how may I fix this?

Thanks in advance
Erdem Bayer

Revision history for this message
Piotr Kilczuk (p-kilczuk) wrote :

Hope to find some time to reseach this, any help is greatly apperciated.

I experience the same both with new and old installations but I'm just too overloaded to look into this...

Changed in rescuetime-linux-uploader:
importance: Undecided → Critical
status: New → Confirmed
Revision history for this message
Erdem Bayer (ebayer) wrote :

Hi

Although I am not an experinced hacker, I may still be able to help you on this one. Feel free to tell me what needs to be done.

Thanks in advance
Erdem Bayer

Revision history for this message
Gabor SUVEG (gsuveg) wrote :

i have same bug.
os: ubuntu Karmic

Revision history for this message
dmitry (dmazin) wrote :

This also happens to me [Karmic]

Revision history for this message
Piotr Kilczuk (p-kilczuk) wrote :

Seems to upload today, waiting for answer from RescueTime team....

Revision history for this message
zygmurti (zygmunt) wrote :

I had this problem with the uploader. I am not sure whether this is what fixed the problem but I noticed that the app is not working when I've got the information icon on the panel instead of the control icon. After I changed the info icon for the control icon everything's working perfectly. Hope this helps

Revision history for this message
Dirk T (miriup) wrote :

I suspect the API changed and the old one doesn't return an error message. RescueTime has released a python API, maybe we should use it.

Revision history for this message
Joseph Lisee (jlisee) wrote :

I gave the API a look and it does not appear be for data uploading and it hasn't been update since the release 1.5 years ago.

Revision history for this message
Joseph Lisee (jlisee) wrote :

I should mention that my data is still uploading properly from a few different Linux machines using the Chrome extension.

Revision history for this message
Dirk T (miriup) wrote :

That is interesting, Joseph, as it means that whatever the chrome extension is doing is different enough to make it work. If I get some time, I'll look into it.

I have also a support ticket open. But they asked me to wait a bit as they are busy with new stuff.

Revision history for this message
Joseph Lisee (jlisee) wrote :

I should clarify that all my usage is currently being tracked, the programs I use and the websites via the google chrome extension.

Here is a snippet of one of my "finished" files (the entries just continue on like this):
---
- os_username: 'XXXXX'
  app_name: 'Google-chrome'
  window_title: 'Some website'
  extended_info: 'http://example.com'
  start_time: 2010-09-25 20:54:58
  end_time: 2010-09-25 20:55:06

Here is the corresponding reply file:
<hash><successes>86</successes><total-records>86</total-records></hash>

You can also check the ".rescuetime/failed/" directory.

Revision history for this message
Dirk T (miriup) wrote :

Joseph, could you then do me a favor: Could you try to find an application that gets reported successfully for you and that you can reasonably well assume I have installed as well. Because if I get a single successfully reported use I could use that data API of rescuetime to check which apps make it and which don't in an automated way.

I have a number of successes in the finished files, but as I said: they don't show up. Even the reply files are there with numbers of successes greater than 0. Still they don't show up for me.

For the Google Chrome: I'd like to start off with something that doesn't have a special extension. Something that is representative of many applications and gets parsed reasonably well.

Revision history for this message
Joseph Lisee (jlisee) wrote :

So there is only one reporting mechanism I know of and it's using the X11 libraries to figure out the current running application window. So if it works one application it will work for everything and things like the google chrome extension are built on top of that X11 information. I believe I saw your patch on another bug and it messed with the X11 part of the application a little, is that the version you are still running?

Revision history for this message
Dirk T (miriup) wrote :

Regarding the reporting mechanism: you have to admit that Google Chrome is dealt with specially. What I meant is I need one tool that is not dealt with in an extension that works. Does the gnome-calculator for example get reported for you properly?

Regarding the X11 modification. Yes, that is the version I'm running. A little explanation here: It doesn't really mess with the X11 part. The client is using the python ctypes extension to access functionality in libX11 and another library. But it was implemented incorrectly in that it didn't specify the result value for XOpenDisplay. When you don't specify one, python ctypes will assume it being "int". On 64bit Linux the C type "int" is 32bit, but the C type "void *" (that is returned from XOpenDisplay) is 64bit. Thus running the uploader causes python to be terminated with "segmentation fault". The patch only addresses that difference. It only lets the rescuetime uploader access these libraries correctly, but it doesn't interfere with the way the client obtains information about windows.

When I run the client from the command line (which I normally do), I can see captured windows correctly. Also it generates YAML files for these windows and uploads them and just as in your example rescuetime will give me the <hash> with how many successes we had. But for some reason, when I search for these programs in the rescuetime interface, they don't show up.

Revision history for this message
Dirk T (miriup) wrote :

Joseph and everyone, I rechecked the rescuetime logs and double-checked with the rescuetime website and yes, some records actually made it. When records don't make it, the rescuetime website will reply that it parsed 0 records, so everything seems to be working as expected. When it does report it parsed 0 records, then it is because my client didn't log anything. That effect might be indeed related to my local branch.

I really don't understand right now how I didn't see that before. Thanks for pointing it out.

Revision history for this message
Dirk T (miriup) wrote :

For me this bug has been fixed - I had a self-made software bug in it. ;)
Is there anyone else still having this issue? If not I'll close this bug.

Changed in rescuetime-linux-uploader:
assignee: nobody → Miriup (dirk-miriup)
Revision history for this message
Lukas Ruge (lukeslog) wrote :

I still have the problem. Do I need to reinstall anything?

Revision history for this message
Dirk T (miriup) wrote :

Lukas, what version are you using?

Revision history for this message
Dirk T (miriup) wrote :

And what OS?

Revision history for this message
Lukas Ruge (lukeslog) wrote :

I'm using Ubuntu 11.04 and the rescue time linux uploader 99.

Revision history for this message
Dirk T (miriup) wrote :

Yes, you're correct. There's currently a malfunction with their interface. I have the same problem. I'll escalate it with them.

Revision history for this message
Dirk T (miriup) wrote :

FYI: I have created a trouble-ticket with them, as I haven't seen my contact online the last 48h.

Revision history for this message
Dirk T (miriup) wrote :

To better deal with this situation in the future, I created a blueprint for a new feature:
https://blueprints.launchpad.net/rescuetime-linux-uploader/+spec/missing-records-testing

You input is highly appreciated.

Revision history for this message
Dirk T (miriup) wrote :

I received an update from the team at Rescuetime and they say they have located and fixed the problem. For it seems to be working again, will know for sure once I implemented the feature mentioned above.

Lukas and Nima, can you confirm that the service is back to normal for you as well?

Changed in rescuetime-linux-uploader:
status: Confirmed → In Progress
Revision history for this message
Nima (nimlaunch) wrote :

I have been working for an hour or so, but nothing on the dashboard still:

nima@office-ubuntu:~$ find .rescuetime/finished/ -type f |wc -l
1367
nima@office-ubuntu:~$ find .rescuetime/replys/ -type f |wc -l
1669

Revision history for this message
Dirk T (miriup) wrote :

Could you please post the contents of the last reply file you have?

Basically:
cd .rescuetime/replys/; ls -tr | tail -n 1 | xargs cat

Revision history for this message
Nima (nimlaunch) wrote :

Hi,

<hash><successes>57</successes><total-records>57</total-records></hash>

it works! Thanks, I have data on my dashboard as well.

Revision history for this message
Dirk T (miriup) wrote :

The rescuetime uploader has been working a while now. I close this bug, so people open a new one next time.

Changed in rescuetime-linux-uploader:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Related questions

Remote bug watches

Bug watches keep track of this bug in other bug trackers.