Author Topic: Similarity stops scanning after a few songs  (Read 35059 times)

Michel

  • Guest
Similarity stops scanning after a few songs
« on: February 23, 2011, 19:17:08 »
I am trying Similarity for the first time now. It looks promising, but it stops scanning after a few files (for example "Cache: 92  New: 92/3141). The duplicates that it found until then were nice matches.

I tried searching the forums, but it did not give much.
Based on some search results I did disable all decoders except for the WMF and MMF decoders.

I noticed the following things.
- CPU usage drops when Similarity stops increasing the numbers. It seems to be waiting for something.
- After closing Similarity and restarting I get "Can't open cache" error. After closing Similarity again I noticed that there was still a Similarity.exe in the taskmanagers process list so I killed it. On next startup there was no error.
- I temporarily removed some files in the folder that was scanned and the numbers changed. For example I removed the first 172 files in the folder (until the letter B) and the number changed from the one earlier to Cache:3   New: 3/2969 before it stops/hangs. So it might be hanging on a specific file, but I don't know how to see which file is being processed.

Any ideas what could be the problem and how to solve it?
BTW I am using Windows Vista x64 and Similarity 1.5.3.

I pasted the logfile below because I could not find a way to attach it.

Code: [Select]
2011-02-23 18:41:25 4236 Config init...
2011-02-23 18:41:25 4236 Config init complete
2011-02-23 18:41:25 4236 Module init...
2011-02-23 18:41:25 4236 Module init complete
2011-02-23 18:41:25 4236 Externals init...
2011-02-23 18:41:25 4236 Loading dll "E:\Program Files (x86)\Similarity\decoders.dll"
2011-02-23 18:41:25 4236 Loaded dll "E:\Program Files (x86)\Similarity\decoders.dll"
2011-02-23 18:41:25 4236 Externals init complete
2011-02-23 18:41:25 4236 Translator init...
2011-02-23 18:41:25 4236 Translator init complete
2011-02-23 18:41:25 4236 Comparer init...
2011-02-23 18:41:25 4236 Comparer init complete
2011-02-23 18:41:25 4236 Start program
2011-02-23 18:41:25 4236 Tagger "Windows Media Format" init starting...
2011-02-23 18:41:25 4236 Tagger "Windows Media Format" init complete
2011-02-23 18:41:25 4236 Net init...
2011-02-23 18:41:25 4236 Net init complete
2011-02-23 18:41:25 4236 Menu creating...
2011-02-23 18:41:25 4236 Menu creating complete
2011-02-23 18:41:25 4236 Toolbar creating...
2011-02-23 18:41:25 4236 Toolbar creating complete
2011-02-23 18:41:25 4236 Statusbar creating...
2011-02-23 18:41:25 4236 Statusbar creating complete
2011-02-23 18:41:25 4236 Tabs creating(1)...
2011-02-23 18:41:25 4236 Tabs creating(2)...
2011-02-23 18:41:25 4236 Tabs creating(3)...
2011-02-23 18:41:25 4236 Tabs creating(4)...
2011-02-23 18:41:25 4236 Tabs creating complete
2011-02-23 18:41:25 4236 Adding tab pages complete
2011-02-23 18:41:25 4236 Loading cache...
2011-02-23 18:41:25 4236 Loading cache complete
2011-02-23 18:41:25 4236 Loading skips...
2011-02-23 18:41:25 4236 Loading skips complete
2011-02-23 18:41:25 4236 Loading ignores...
2011-02-23 18:41:25 4236 Loading ignores complete
2011-02-23 18:41:25 4236 Adding worker threads...
2011-02-23 18:41:25 4236 Adding worker threads complete
2011-02-23 18:41:25 4236 Taskbar init complete (no taskbar)
2011-02-23 18:41:25 4236 Begin checking update
2011-02-23 18:41:25 4236 Mainframe initialized...
2011-02-23 18:41:25 4120 Decoder "FLAC" skipped...
2011-02-23 18:41:25 4120 Decoder "Ogg Vorbis" skipped...
2011-02-23 18:41:25 4120 Decoder "Monkey Audio" skipped...
2011-02-23 18:41:25 4120 Decoder "WavPack" skipped...
2011-02-23 18:41:25 4120 Decoder "Musepack" skipped...
2011-02-23 18:41:25 4120 Decoder "Windows Media Format (WMF)" init starting...
2011-02-23 18:41:25 4120 Decoder "Windows Media Format (WMF)" init complete
2011-02-23 18:41:25 4120 Decoder "Microsoft Media Foundation (MMF)" init starting...
2011-02-23 18:41:25 4120 Decoder "Microsoft Media Foundation (MMF)" init complete
2011-02-23 18:41:25 4120 Decoder "Apple QuickTime Framework" skipped...
2011-02-23 18:41:25 4120 Decoder "DirectShow" skipped...
2011-02-23 18:41:25 4120 Decoder "Audio Compression Manager (ACM)" skipped...
2011-02-23 18:41:25 4352 Decoder "FLAC" skipped...
2011-02-23 18:41:25 4352 Decoder "Ogg Vorbis" skipped...
2011-02-23 18:41:25 4352 Decoder "Monkey Audio" skipped...
2011-02-23 18:41:25 4352 Decoder "WavPack" skipped...
2011-02-23 18:41:25 4352 Decoder "Musepack" skipped...
2011-02-23 18:41:25 4352 Decoder "Windows Media Format (WMF)" init starting...
2011-02-23 18:41:25 4352 Decoder "Windows Media Format (WMF)" init complete
2011-02-23 18:41:25 4352 Decoder "Microsoft Media Foundation (MMF)" init starting...
2011-02-23 18:41:25 4352 Decoder "Microsoft Media Foundation (MMF)" init complete
2011-02-23 18:41:25 4352 Decoder "Apple QuickTime Framework" skipped...
2011-02-23 18:41:25 4352 Decoder "DirectShow" skipped...
2011-02-23 18:41:25 4352 Decoder "Audio Compression Manager (ACM)" skipped...
2011-02-23 18:41:25 4416 Decoder "FLAC" skipped...
2011-02-23 18:41:25 4416 Decoder "Ogg Vorbis" skipped...
2011-02-23 18:41:25 4416 Decoder "Monkey Audio" skipped...
2011-02-23 18:41:25 4416 Decoder "WavPack" skipped...
2011-02-23 18:41:25 4416 Decoder "Musepack" skipped...
2011-02-23 18:41:25 4416 Decoder "Windows Media Format (WMF)" init starting...
2011-02-23 18:41:25 4416 Decoder "Windows Media Format (WMF)" init complete
2011-02-23 18:41:25 4416 Decoder "Microsoft Media Foundation (MMF)" init starting...
2011-02-23 18:41:25 4416 Decoder "Microsoft Media Foundation (MMF)" init complete
2011-02-23 18:41:25 4416 Decoder "Apple QuickTime Framework" skipped...
2011-02-23 18:41:25 4416 Decoder "DirectShow" skipped...
2011-02-23 18:41:25 4416 Decoder "Audio Compression Manager (ACM)" skipped...
2011-02-23 18:41:25 2524 Decoder "FLAC" skipped...
2011-02-23 18:41:25 2524 Decoder "Ogg Vorbis" skipped...
2011-02-23 18:41:25 2524 Decoder "Monkey Audio" skipped...
2011-02-23 18:41:25 2524 Decoder "WavPack" skipped...
2011-02-23 18:41:25 2524 Decoder "Musepack" skipped...
2011-02-23 18:41:25 2524 Decoder "Windows Media Format (WMF)" init starting...
2011-02-23 18:41:25 2524 Decoder "Windows Media Format (WMF)" init complete
2011-02-23 18:41:25 2524 Decoder "Microsoft Media Foundation (MMF)" init starting...
2011-02-23 18:41:25 2524 Decoder "Microsoft Media Foundation (MMF)" init complete
2011-02-23 18:41:25 2524 Decoder "Apple QuickTime Framework" skipped...
2011-02-23 18:41:25 2524 Decoder "DirectShow" skipped...
2011-02-23 18:41:25 2524 Decoder "Audio Compression Manager (ACM)" skipped...


Admin

  • Administrator
  • Hero Member
  • *****
  • Posts: 664
    • View Profile
    • https://www.smilarityapp.com
Re: Similarity stops scanning after a few songs
« Reply #1 on: February 23, 2011, 20:22:01 »
Please, download latest beta version http://www.music-similarity.com/downloads/similarity.beta.zip, it creates very detailed log of scanning files. We think you have some decoder that hang up on some file, please, use beta version and attach or send us the log files.

hsei

  • Jr. Member
  • **
  • Posts: 70
    • View Profile
Re: Similarity stops scanning after a few songs
« Reply #2 on: February 24, 2011, 10:00:46 »
Had the same problem (not after a few but after several thousand files). Reappeared after restart.
I disabled all codecs except ACM (I only examined MP3s). It didn't stop every time at the same file. Seems to depend on processing history, too. Trial with debug version (build 1033) is on the way.
My bug fix: I split the task in groups (e.g. A-N + O-Z) using the /portable switch in order to to keep two separate caches. They can then be run sequently or even parallel on a multicore system.
Hint:
If I want to know which file is being processed, I use resource monitor (included in windows 7). For former windows versions the process monitor in the sysinternals suite does the same job. Task manager does not deliver enough information.

Michel

  • Jr. Member
  • **
  • Posts: 1
    • View Profile
Re: Similarity stops scanning after a few songs
« Reply #3 on: February 28, 2011, 22:17:34 »
Actually in my case the log showed that it got stuck on a .jpg file (cover art). I setup the filters so they only scan audio formats and then it worked fine (except for the last 2 songs).

BTW sorry for the late reply on this forum. I already had contact with the support through mail and forgot to reply here.

Springdream

  • Jr. Member
  • **
  • Posts: 51
    • View Profile
Re: Similarity stops scanning after a few songs
« Reply #4 on: April 17, 2011, 10:50:24 »
Hello, I've the same problem, most of the time stops after two day's calculation... very annoying..
But how did you solve it?
Where can filters like exclude .jpg be set (1.5.4 beta)?

Admin

  • Administrator
  • Hero Member
  • *****
  • Posts: 664
    • View Profile
    • https://www.smilarityapp.com
Re: Similarity stops scanning after a few songs
« Reply #5 on: April 17, 2011, 11:00:46 »
You can specify scanning extensions in Options decoders tab:

Springdream

  • Jr. Member
  • **
  • Posts: 51
    • View Profile
Re: Similarity stops scanning after a few songs
« Reply #6 on: April 17, 2011, 11:04:38 »
Actually the manual does not really describe the details..
How do I know which converter is doing what?
From your picture it looks like many are doing mp3?! What is the purpose?
May I change all "*" to Mp3 although I also got flac, ape, mv, ogg?

Admin

  • Administrator
  • Hero Member
  • *****
  • Posts: 664
    • View Profile
    • https://www.smilarityapp.com
Re: Similarity stops scanning after a few songs
« Reply #7 on: April 20, 2011, 20:31:13 »
You can specify any extensions by space delimeter, many decoders is universal that mean they use 3rd party components to decode and that format they support unknown, and Similarity set "*".
In screenshot only example - only process mp3 files in unversal decoders.
See this help topic

Springdream

  • Jr. Member
  • **
  • Posts: 51
    • View Profile
Re: Similarity stops scanning after a few songs
« Reply #8 on: April 20, 2011, 20:50:56 »
OK, but sorry to say, the help does not explain why more than one decoder is used for MP3.
Shouldn't just one do?
Anyway in the meantime I reduced and changed a lot (see picture) and this seems to work without problems till now.

Why don't you recommend those or similar settings as default?
Otherwise so many problems occour and many users just feel Similarity is too faulty?!
« Last Edit: May 01, 2011, 11:22:07 by Springdream »

Admin

  • Administrator
  • Hero Member
  • *****
  • Posts: 664
    • View Profile
    • https://www.smilarityapp.com
Re: Similarity stops scanning after a few songs
« Reply #9 on: May 02, 2011, 09:20:49 »
We trying to set most universal set (we already disable DirectShow decoder by default), but some users installs codecs pack that contain too many unnecessary and problematic decoders. And sometimes some decoders have native problems (example QuickTime can't correctly decode stereo MP3, not joint-stereo like most, native stereo). We can't solve all problems, but we try cover as many supported formats as we can.