Freezes up

Got questions or helpful tips/tricks? Ask here!

Freezes up

Postby ericrwalker » Thu Jan 09, 2014 5:27 pm

So far I am impressed with this software. I had over 300k pictures stored from about 20 years of my life (now down to about 90k after using this software, and counting). I randomly make backup CD/DVD's over the years. I have taken all of my backups and put them on my home server and started organizing them. Pictures were my top priority. I had anywhere from 2 to 6 copies of each photo, so I put a lot of faith in snoop-de-dupe to clear out duplicates. In the beginning I keep checking the files to make sure they were really dupes seeing that file names didn't always match.

Anyway I found that it keep freezing up when it hit a certain photo, and I removed that phone. Now it freezes up every time I hit a different photo. I have rebooted the computer, restarted the service, and it looks like it works until it hits that photo every single time. Any advice?

log file:

09:35:43:652 : MainWorkerThread - one-time initialization complete
09:35:43:652 : StartupEngine - exiting
09:35:43:652 : updating job cpu settings: Monday, July 15, 2013 1:15:19 PM 50 1
09:35:43:652 : processing job : Monday, July 15, 2013 1:15:19 PM
09:35:43:652 : +ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
09:35:43:652 : -ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
09:35:43:652 : stop processing job : Monday, July 15, 2013 1:15:19 PM
09:35:43:652 : scan for next job
09:35:43:652 : MainWorkerThread - start waiting -1
09:35:43:730 : MainWorkerThread - JobIndex=0. end waiting -1
09:35:43:730 : processing job : Monday, July 15, 2013 1:15:19 PM
09:35:43:730 : +ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
09:35:43:730 : -ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
09:35:43:730 : Found file in queue : O:\ServerFolders\Pictures\!cid_004101c67318$06a035d0$0b00a8c0@Barry.jpg
09:35:43:730 : start processing file in queue: O:\ServerFolders\Pictures\!cid_004101c67318$06a035d0$0b00a8c0@Barry.jpg
09:35:43:245 : remove file in queue : O:\ServerFolders\Pictures\!cid_004101c67318$06a035d0$0b00a8c0@Barry.jpg
09:35:43:542 : add file to history : O:\ServerFolders\Pictures\!cid_004101c67318$06a035d0$0b00a8c0@Barry.jpg
09:35:46:897 : stop processing job : Monday, July 15, 2013 1:15:19 PM
09:35:46:897 : scan for next job
09:35:46:897 : MainWorkerThread - start waiting 0
09:35:46:897 : MainWorkerThread - JobIndex=0. end waiting 0
09:35:46:897 : processing job : Monday, July 15, 2013 1:15:19 PM
09:35:46:897 : +ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
09:35:46:552 : -ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
09:35:47:582 : Found file in queue : O:\ServerFolders\Pictures\1119629697_l.jpg
09:35:47:582 : start processing file in queue: O:\ServerFolders\Pictures\1119629697_l.jpg
09:35:47:598 : remove file in queue : O:\ServerFolders\Pictures\1119629697_l.jpg
09:35:48:066 : add file to history : O:\ServerFolders\Pictures\1119629697_l.jpg

<removed data>

10:20:02:752 : Found file in queue : O:\ServerFolders\Pictures\Walker 034.jpg
10:20:02:752 : start processing file in queue: O:\ServerFolders\Pictures\Walker 034.jpg
10:20:02:767 : remove file in queue : O:\ServerFolders\Pictures\Walker 034.jpg
10:20:02:845 : add file to history : O:\ServerFolders\Pictures\Walker 034.jpg
10:20:02:111 : Found file in queue : O:\ServerFolders\Pictures\Walker 041.jpg
10:20:02:111 : start processing file in queue: O:\ServerFolders\Pictures\Walker 041.jpg
10:20:02:220 : remove file in queue : O:\ServerFolders\Pictures\Walker 041.jpg
10:20:02:313 : add file to history : O:\ServerFolders\Pictures\Walker 041.jpg
10:20:02:563 : Found file in queue : O:\ServerFolders\Pictures\Walker 042.jpg
10:20:02:563 : start processing file in queue: O:\ServerFolders\Pictures\Walker 042.jpg
10:20:02:563 : remove file in queue : O:\ServerFolders\Pictures\Walker 042.jpg
10:20:03:688 : add file to history : O:\ServerFolders\Pictures\Walker 042.jpg
10:20:03:906 : stop processing job : Monday, July 15, 2013 1:15:19 PM
10:20:03:906 : scan for next job
10:20:03:906 : MainWorkerThread - start waiting 0
10:20:03:906 : MainWorkerThread - JobIndex=0. end waiting 0
10:20:03:906 : processing job : Monday, July 15, 2013 1:15:19 PM
10:20:03:906 : +ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
10:22:53:666 : -ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
10:22:53:666 : stop processing job : Monday, July 15, 2013 1:15:19 PM
10:22:53:666 : scan for next job
10:22:53:666 : MainWorkerThread - start waiting -1
10:45:29:658 : SaveSettings() rc=1
ericrwalker
 
Posts: 8
Joined: Thu Jan 09, 2014 5:20 pm

Re: Freezes up

Postby ericrwalker » Thu Jan 09, 2014 5:32 pm

Here is a screenshot of the status. I have reset all settings a couple of times as well.


Image
ericrwalker
 
Posts: 8
Joined: Thu Jan 09, 2014 5:20 pm

Re: Freezes up

Postby ericrwalker » Thu Jan 09, 2014 6:24 pm

Sorry I don't mean to keep posting, but I have follow up information that might be helpful. I removed the walker 042.jpg file that was getting stuck before, and now it get stuck on a new file. The funny thing is that the "FILES PROCESSED:" it says 5022 Files. That was the same count last time it got stuck.
ericrwalker
 
Posts: 8
Joined: Thu Jan 09, 2014 5:20 pm

Re: Freezes up

Postby ericrwalker » Thu Jan 09, 2014 9:27 pm

Follow up again, I deleted 3 files now that it seemed to stop at. Now it's finally gone past the 5022 mark. I will report back if something changes. I wonder if there was something going with those few files.
ericrwalker
 
Posts: 8
Joined: Thu Jan 09, 2014 5:20 pm

Re: Freezes up

Postby sarah (electrongoo) » Fri Jan 10, 2014 3:27 am

Hi Eric,

Thank you for the detailed post. I'm glad to hear you're impressed with Snoop de dupe thus far. As for the lock-up; I've never seen anything like this before - but, I'd be interested to track this down, get the details, and get or developers busy fixing the issue.

Regarding your first post with the log file ...

10:20:03:906 : +ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
10:22:53:666 : -ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM

The "Delayed dupe scan" is a background action in which snoop de dupe temporarily stops parsing new files and reviews files it has added to its database looking for duplicate files. As you can see above, this took about 3 minutes to complete; but the time to complete will vary based on the number of files in the snoop de dupe database. While this is going on, it could appear that snoop de dupe is frozen but it will always return to import new/changed files and look for more duplicate files. I'm not certain this is what you were seeing but thought I'd mention it. How long did you let Snoop de dupe sit idle (frozen) before running a "reset all settings" action?

If you run into more issues or have more information for us please feel free to reply to this post or email me at support (at) electrongoo.com

Thanks,
Sarah.
sarah (electrongoo)
 
Posts: 52
Joined: Mon Jan 04, 2010 10:35 pm

Re: Freezes up

Postby ericrwalker » Fri Jan 10, 2014 1:16 pm

Thanks for the reply. It's been running since the last post I made and it's currently at exactly 70k files out the of the 85k or so left in that directory. There was one time where it got stuff on file 5022 and I let it run all night and when I got up it was in the same spot.

Once I am done with my photos directory I have others I am going to do before I open it up the the entire pool. If I run into the problem again I will let it run for hours and then post a log.
ericrwalker
 
Posts: 8
Joined: Thu Jan 09, 2014 5:20 pm

Re: Freezes up

Postby ericrwalker » Thu Jan 16, 2014 1:01 am

Something strange is still going on. I had it the other day looking at several different directories, but it was still looking in my pictures folder even though I removed that. So I decided to set it up to look in just one directory, I reset it and changed the watched folder to my documents folder. When it was done it moved on to each directory that I had on my watch list before. So now I reset all dupe history, rebooted computer and it starts looking through my files without me even selecting a watch folder. I am thinking about uninstalling the add-in and reinstalling it.

Here is a log, pulled out a lot of middle stuff but you can see it went through each directory on my server, even though I only had the documents one in my watch folder. Then it stayed on that last file until I stopped it. I am also posting a screen shot if it scanning files while there is nothing in the watched folder.

03:29:54:953 : MainWorkerThread - one-time initialization complete
03:29:54:953 : StartupEngine - exiting
03:29:54:953 : updating job cpu settings: Monday, July 15, 2013 1:15:19 PM 10 0
03:29:54:953 : processing job : Monday, July 15, 2013 1:15:19 PM
03:29:54:953 : +ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
03:30:44:951 : -ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
03:30:44:279 : Found file in queue : O:\ServerFolders\Documents\contacts for Walker.doc
03:30:44:279 : start processing file in queue: O:\ServerFolders\Documents\contacts for Walker.doc
03:30:45:918 : remove file in queue : O:\ServerFolders\Documents\contacts for Walker.doc
03:30:46:979 : add file to history : O:\ServerFolders\Documents\contacts for Walker.doc
<clipped>
03:54:51:907 : Found file in queue : O:\ServerFolders\Documents\Walker orders 30SEP07.pdf
03:54:51:907 : start processing file in queue: O:\ServerFolders\Documents\Walker orders 30SEP07.pdf
03:54:51:938 : remove file in queue : O:\ServerFolders\Documents\Walker orders 30SEP07.pdf
03:54:51:141 : add file to history : O:\ServerFolders\Documents\Walker orders 30SEP07.pdf
03:54:51:282 : Found file in queue : O:\ServerFolders\Videos\A Night At The Roxbury.avi
03:54:51:282 : start processing file in queue: O:\ServerFolders\Videos\A Night At The Roxbury.avi
03:55:00:033 : remove file in queue : O:\ServerFolders\Videos\A Night At The Roxbury.avi
03:55:00:236 : add file to history : O:\ServerFolders\Videos\A Night At The Roxbury.avi
<clipped>
04:38:47:418 : Found file in queue : O:\ServerFolders\Documents\123522097-1138656733-1040A.pdf
04:38:47:418 : start processing file in queue: O:\ServerFolders\Documents\123522097-1138656733-1040A.pdf
04:38:47:465 : remove file in queue : O:\ServerFolders\Documents\123522097-1138656733-1040A.pdf
04:38:48:667 : add file to history : O:\ServerFolders\Documents\123522097-1138656733-1040A.pdf
<clipped>
04:40:14:404 : Found file in queue : O:\ServerFolders\Documents\contacts for Walker.doc
04:40:14:404 : start processing file in queue: O:\ServerFolders\Documents\contacts for Walker.doc
04:40:14:420 : remove file in queue : O:\ServerFolders\Documents\contacts for Walker.doc
04:40:15:716 : add file to history : O:\ServerFolders\Documents\contacts for Walker.doc
04:40:15:200 : Found file in queue : O:\ServerFolders\Videos\Silver Linings Playbook.avi
04:40:15:200 : start processing file in queue: O:\ServerFolders\Videos\Silver Linings Playbook.avi
04:40:23:390 : remove file in queue : O:\ServerFolders\Videos\Silver Linings Playbook.avi
04:40:23:546 : add file to history : O:\ServerFolders\Videos\Silver Linings Playbook.avi
<clipped>
04:46:47:292 : Found file in queue : O:\ServerFolders\Videos\Windtalkers.mkv
04:46:47:292 : start processing file in queue: O:\ServerFolders\Videos\Windtalkers.mkv
04:47:00:256 : remove file in queue : O:\ServerFolders\Videos\Windtalkers.mkv
04:47:00:319 : add file to history : O:\ServerFolders\Videos\Windtalkers.mkv
04:47:00:459 : Found file in queue : O:\ServerFolders\Software\01000146.cab
04:47:00:459 : start processing file in queue: O:\ServerFolders\Software\01000146.cab
04:47:01:709 : remove file in queue : O:\ServerFolders\Software\01000146.cab
04:47:01:958 : add file to history : O:\ServerFolders\Software\01000146.cab
<clipped>
05:01:12:287 : Found file in queue : O:\ServerFolders\Software\zsnesw.exe
05:01:12:287 : start processing file in queue: O:\ServerFolders\Software\zsnesw.exe
05:01:12:302 : remove file in queue : O:\ServerFolders\Software\zsnesw.exe
05:01:13:630 : add file to history : O:\ServerFolders\Software\zsnesw.exe
05:01:13:770 : Found file in queue : O:\ServerFolders\Software\?????????_(??????).zip
05:01:13:770 : start processing file in queue: O:\ServerFolders\Software\?????????_(??????).zip
05:01:13:848 : remove file in queue : O:\ServerFolders\Software\?????????_(??????).zip
05:01:13:989 : add file to history : O:\ServerFolders\Software\?????????_(??????).zip
05:01:13:129 : Found file in queue : O:\ServerFolders\Games\F-Zero (E).srm
05:01:13:129 : start processing file in queue: O:\ServerFolders\Games\F-Zero (E).srm
05:01:13:176 : remove file in queue : O:\ServerFolders\Games\F-Zero (E).srm
05:01:13:332 : add file to history : O:\ServerFolders\Games\F-Zero (E).srm
05:01:14:582 : Found file in queue : O:\ServerFolders\Games\F-Zero (E).zip
05:01:14:582 : start processing file in queue: O:\ServerFolders\Games\F-Zero (E).zip
05:01:14:582 : remove file in queue : O:\ServerFolders\Games\F-Zero (E).zip
05:01:14:816 : add file to history : O:\ServerFolders\Games\F-Zero (E).zip
<clipped>
05:01:27:388 : Found file in queue : O:\ServerFolders\Games\Super Mario 64.zip
05:01:27:388 : start processing file in queue: O:\ServerFolders\Games\Super Mario 64.zip
05:01:27:450 : remove file in queue : O:\ServerFolders\Games\Super Mario 64.zip
05:01:28:012 : add file to history : O:\ServerFolders\Games\Super Mario 64.zip
<clipped>
05:01:29:525 : Found file in queue : O:\ServerFolders\Music\01_Miranda_Lambert_-_White_Liar_(Revolution).mp3
05:01:29:525 : start processing file in queue: O:\ServerFolders\Music\01_Miranda_Lambert_-_White_Liar_(Revolution).mp3
05:01:30:634 : remove file in queue : O:\ServerFolders\Music\01_Miranda_Lambert_-_White_Liar_(Revolution).mp3
05:01:30:884 : add file to history : O:\ServerFolders\Music\01_Miranda_Lambert_-_White_Liar_(Revolution).mp3
<clipped>
05:27:14:904 : Found file in queue : O:\ServerFolders\Music\You Walked In.mp3
05:27:14:904 : start processing file in queue: O:\ServerFolders\Music\You Walked In.mp3
05:27:14:060 : remove file in queue : O:\ServerFolders\Music\You Walked In.mp3
05:27:14:356 : add file to history : O:\ServerFolders\Music\You Walked In.mp3
05:27:14:496 : Found file in queue : O:\ServerFolders\Pictures\!cid_004101c67318$06a035d0$0b00a8c0@Barry.jpg
05:27:14:496 : start processing file in queue: O:\ServerFolders\Pictures\!cid_004101c67318$06a035d0$0b00a8c0@Barry.jpg
05:27:14:512 : remove file in queue : O:\ServerFolders\Pictures\!cid_004101c67318$06a035d0$0b00a8c0@Barry.jpg
05:27:15:684 : add file to history : O:\ServerFolders\Pictures\!cid_004101c67318$06a035d0$0b00a8c0@Barry.jpg
<clipped>
06:18:36:452 : Found file in queue : O:\ServerFolders\Pictures\Walker 041.jpg
06:18:36:452 : start processing file in queue: O:\ServerFolders\Pictures\Walker 041.jpg
06:18:36:483 : remove file in queue : O:\ServerFolders\Pictures\Walker 041.jpg
06:18:37:608 : add file to history : O:\ServerFolders\Pictures\Walker 041.jpg
06:18:37:795 : stop processing job : Monday, July 15, 2013 1:15:19 PM
06:18:37:795 : scan for next job
06:18:37:795 : MainWorkerThread - start waiting 0
06:18:37:795 : MainWorkerThread - JobIndex=0. end waiting 0
06:18:37:795 : processing job : Monday, July 15, 2013 1:15:19 PM
06:18:37:795 : +ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
06:20:22:268 : -ProcessDelayedDupeScan on job : Monday, July 15, 2013 1:15:19 PM
06:20:22:268 : stop processing job : Monday, July 15, 2013 1:15:19 PM
06:20:22:268 : scan for next job
06:20:22:268 : MainWorkerThread - start waiting -1
19:14:39:537 : SaveSettings() rc=1
Image
ericrwalker
 
Posts: 8
Joined: Thu Jan 09, 2014 5:20 pm

Re: Freezes up

Postby sarah (electrongoo) » Thu Jan 16, 2014 2:23 am

Hi Eric,

It sounds as if the de-dupe file scan settings were not flushed to your hard drive during reboot. Can you open the file named "C:\ProgramData\FileDeDupe\filescan.xml" and let me know if there's any content in that file? It should be empty (i.e. just a simple xml header structure) if you removed all your watched folders and restarted your server.

On that note, since you don't have any folders selected for scanning ... if you terminate the snoop-de-dupe service named DDServe.exe using Windows Task Manager and then delete the filescan.xml file noted above and restart the DDServe.exe service (or simply restart your server) then de-dupe scanning will definitely stop. After which you should be able to add a new set of folders.

I'll let our testers know about this issue so they can try to reproduce the issue in house. Thank you for the detailed post ... this is very helpful.

Thanks,
Sarah
sarah (electrongoo)
 
Posts: 52
Joined: Mon Jan 04, 2010 10:35 pm

Re: Freezes up

Postby ericrwalker » Thu Jan 16, 2014 2:35 am

I see all my folders listed in the file, I will do as you stated, thanks again for the help.


Still think this is a great addin, just a little hiccup. I wonder if it's a service or setting on my side that caused this.
ericrwalker
 
Posts: 8
Joined: Thu Jan 09, 2014 5:20 pm

Re: Freezes up

Postby ericrwalker » Thu Jan 16, 2014 2:43 am

That worked, thanks again.
ericrwalker
 
Posts: 8
Joined: Thu Jan 09, 2014 5:20 pm

Next

Return to Snoop-de-dupe Questions



Who is online

Users browsing this forum: No registered users and 1 guest

cron