Yikes! (shntool help request) -b- -e -a-t-

[texizjtexiz]

Hi folks,

Here is the shntool -len output from a shn set (md5 check ok) decoded to wav with mkwACT:

length expanded size cdr WAVE problems filename
0:25.62 4555875 -b- -e -a-t- Track 01.wav
4:32.65 48133731 -b- -e -a-t- Track 02.wav
4:33.31 48230163 -b- -e -a-t- Track 03.wav
4:05.60 43359171 -b- -e -a-t- Track 04.wav
3:56.11 41656323 -b- -e -a-t- Track 05.wav
5:29.72 58204995 -b- -e -a-t- Track 06.wav
4:29.11 47477523 -b- -e -a-t- Track 07.wav
5:32.29 58633059 -b- -e -a-t- Track 08.wav
2:50.44 30091539 -b- -e -a-t- Track 09.wav
4:22.74 46390899 -b- -e -a-t- Track 10.wav
3:56.57 41764515 -b- -e -a-t- Track 11.wav
1:50.56 19535763 -b- -e -a-t- Track 12.wav
1:30.36 15960723 -b- -e -a-t- Track 13.wav
3:29.09 36888819 -b- -e -a-t- Track 14.wav
3:55.23 41508147 -b- -e -a-t- Track 15.wav
1:06.42 11741235 -b- -e -a-t- Track 16.wav
1:02.73 11108547 -b- -e -a-t- Track 17.wav
0:58.62 10377075 -b- -e -a-t- Track 18.wav
58:09.67 615618102 B (totals for 18 files, 1.0000 overall compression ratio)

Yowza!

Can someone out there assist? There's lots of great threads here about SBEs & such, but nothing with errors of this magnitude. Etree forum searches yield little. The shntool readme & help are great, but

-strip & -fix modes give "may be truncated" errors.

I ran a shntool info, the text file of whch is too large to attach to this message, so here is an excerpt:

file name: Track 04.wav
handled by: wav format module
length: 4:05.60
WAVE format: 0x0001 (Microsoft PCM)
channels: 2
bits/sample: 16
samples/sec: 44100
average bytes/sec: 176400
rate (calculated): 176400
block align: 4
header size: 44 bytes
data size: 43359119 bytes
chunk size: 43359163 bytes
total size (chunk size + 8): 43359171 bytes
actual file size: 43359164
file is compressed: no
compression ratio: 1.0000
CD-quality properties:
CD quality: yes
cut on sector boundary: no
sector misalignment: 2351 bytes
long enough to be burned: yes
WAVE properties:
non-canonical header: no
extra RIFF chunks: yes (7 or 8 bytes)
Possible problems:
file contains ID3v2 tag: no
data chunk block-aligned: no
inconsistent header: no
file probably truncated: yes (missing 7 bytes)
junk appended to file: no
odd data size has pad byte: unknown

All of the wavs have similar data.

This is confusing to me - the info suggests there are extra RIFF chunks but that there is also some missing...

-pad mode results in tracks being skipped because "warning: tried to read 7 bytes, but only read 1 - possible truncated/corrupt file."

Sorry for the length of this post. How does one go about fixing the block alignment as well? Or are the shns trash? They listen OK <grin>

thanks in advance!

tjt

[range_hood]

Could you please do a -len on the original shns please?

[texizjtexiz]

Originally Posted by range_hood

Could you please do a -len on the original shns please?

Sure!

length expanded size cdr WAVE problems filename
0:25.62 4555875 -b- -e -a-xx Track 01.shn
4:32.65 48133731 -b- -e -a-xx Track 02.shn
4:33.31 48230163 -b- -e -a-xx Track 03.shn
4:05.60 43359171 -b- -e -a-xx Track 04.shn
3:56.11 41656323 -b- -e -a-xx Track 05.shn
5:29.72 58204995 -b- -e -a-xx Track 06.shn
4:29.11 47477523 -b- -e -a-xx Track 07.shn
5:32.29 58633059 -b- -e -a-xx Track 08.shn
2:50.44 30091539 -b- -e -a-xx Track 09.shn
4:22.74 46390899 -b- -e -a-xx Track 10.shn
3:56.57 41764515 -b- -e -a-xx Track 11.shn
1:50.56 19535763 -b- -e -a-xx Track 12.shn
1:30.36 15960723 -b- -e -a-xx Track 13.shn
3:29.09 36888819 -b- -e -a-xx Track 14.shn
3:55.23 41508147 -b- -e -a-xx Track 15.shn
1:06.42 11741235 -b- -e -a-xx Track 16.shn
1:02.73 11108547 -b- -e -a-xx Track 17.shn
0:58.62 10377075 -b- -e -a-xx Track 18.shn
58:09.67 615618102 B (totals for 18 files, 0.7238 overall compression ratio)

[ffooky]

-f- -u- -c- -k- -e- -d-

[Five]

looking at the shntool readme.txt reveals what shntool is reporting but not how to deal with it. the errors with the riff chunks and truncated stuff I've never dealt with before. What I would do is join them into one big wav. then open it in a wav editor and do some zooming and listening looking for errors, especially at the points where the cuts were originally made. assuming that goes well, properly recut them on sector boundaries, including padding the last track with silence at the end. the files are 16bit/44.1kHz so hopefully the funny riff chunk (missing or extra?? ) problems will go away. If you use audacity don't forget to set the export to 16bit/44.1kHz in the preferences. keep a backup of the original shn files somewhere until you're positive you've fixed everything.

I've never seen a show with this many errors reported by shntool, I would be hard pressed to find a way to create these kinds of errors intentionally!

please post back and let us know how you're doing with it, also feel free to ask any questions about cutting, padding et al.

[range_hood]

Maybe mkwACT just can´t convert these files properly. Seems it caused the truncated files. Have you tried this with shntool or Traders Little Helper on the original shns?

Originally Posted by shntool-tutorial

all columns:

'-' this particular entry is OK
'x' this particular entry is not applicable or cannot be determined

cdr column:

'c' data is not [C]D-quality
'b' CD-quality WAVE data is not cut on a sector [b]oundary
's' CD-quality WAVE data is too [s]hort to be burned

WAVE column:

'h' WAVE [h]eader is not canonical
'e' WAVE file contains [e]xtra chunks

problems column:

'3' file contains an ID[3]v2 tag
'a' audio data is not block-[a]ligned
'i' WAVE header is [i]nconsistent about data size and/or file size
't' WAVE file seems to be [t]runcated
'j' WAVE file seems to have [j]unk appended to it

[texizjtexiz]

Originally Posted by range_hood

Maybe mkwACT just can´t convert these files properly. Seems it caused the truncated files. Have you tried this with shntool or Traders Little Helper on the original shns?

Hi there, and thanks range_hood! Yes I had a similar thought. Trader's Little Helper had caused the same errors. I did not try to decode with shntool, but the problem is now 'fixed.' (After a fashion).

A shntool -join on the decoded WAVs resulted in the same "may be truncated error;" the job could not be performed.

A shntool -join on the original SHNs seemed to work at first, but in the resulting joined WAV file, every other 'track' of the original tracks was loud constant static. Then the following 'track' sounded fine, and the next was static again.

What seemed to work around this was importing each of the WAVs decoded from the original SHNs into Audacity & basically copy/pasting them into one big file. Zooming in on & listening to the former track splits did not reveal any obvious nonconformities (though I am not an expert at such things).

This WAV file was then split with CD Wave Editor & run through shntool -len again (last track was then post padded). Now happy tagged FLACs

Another odd thing I noticed, Five, was that the original lineage from the seeder stated the files were FLAC, yet they are obviously SHN. Perhaps there was some poor conversion from one format to the other, a CDR gen in there too? <shrug>

Thanks all for your help!

I am documenting all the errors and fixes in a text file & am keeping the original files in case it ever gets traded - perhaps a reseed is in order soon.

tjt

[feralicious]

Phew! That sounds like a lot of work!

What show was it? I haven't grabbed too many lately since I'm all full up, but I tend to not look at them until a while later, so just in case it would be good to know, also so I don't grab it if it's still alive.

[texizjtexiz]

Originally Posted by feralicious

Phew! That sounds like a lot of work!

What show was it? I haven't grabbed too many lately since I'm all full up, but I tend to not look at them until a while later, so just in case it would be good to know, also so I don't grab it if it's still alive.

It was fun though!

It was the Fabulous Poodles, Live at the Bottom Line NYC 2-14-79, posted to DIME (?) back in July.

The original lineage is kind of sketchy, not sure if it meets seeding guidelines here.

Lineage: FM broadcast > cassette > unknown generations > cassette > WAV > CDR > WAV > Flac Level 5

(But the files seeded were SHN).

[feralicious]

Yeah, with all that history I'm sure it doesn't belong here.

[Five]

I'm glad that the suggestion to use a wav editor worked out for ya

just guessing, sounds like it was burned from FLAC > audio cdr > ?unknown extraction software > bad encoding job > SHN

the original FLACs should be out there somewhere, but hang onto it just in case.

[feralicious]

I just looked at a couple dvd-rs I got from a vine full of R.E.M. shows that are a total mess!

So is there an easier fix for just the -a- error than having to bring them into Audition or Audacity?

[feralicious]

Well I don't really know what it means to have "audio data is not block-[a]ligned" but fixing the SBEs as shns took care of the -a- problem as well:

ORIGINAL SHNS:

length expanded size cdr WAVE problems filename
3:23.05 35820670 -b- -- -a-xx 01 - Track 1.shn
3:47.68 40201874 -b- -- -a-xx 02 - Track 2.shn
5:23.64 57127028 -b- -- ---xx 03 - Track 3.shn
3:55.56 41584768 -b- -- ---xx 04 - Track 4.shn
3:09.35 33422022 -b- -- -a-xx 05 - Track 5.shn
4:27.33 47177534 -b- -- -a-xx 06 - Track 6.shn
3:14.14 34254206 -b- -- -a-xx 07 - Track 7.shn
4:01.48 42624998 -b- -- -a-xx 08 - Track 8.shn
3:29.60 37007756 -b- -- ---xx 09 - Track 9.shn
2:52.51 30460426 -b- -- -a-xx 10 - Track 10.shn
2:01.72 21514448 -b- -- ---xx 11 - Track 11.shn
3:51.59 40887202 -b- -- -a-xx 12 - Track 12.shn
3:39.28 38696600 -b- -- ---xx 13 - Track 13.shn
2:51.01 30166714 -b- -- -a-xx 14 - Track 14.shn
3:48.08 40238588 -b- -- ---xx 15 - Track 15.shn
2:49.63 29958668 -b- -- ---xx 16 - Track 16.shn
3:00.39 31843320 -b- -- ---xx 17 - Track 17.shn
1:57.55 20767930 -b- -- -a-xx 18 - Track 18.shn
3:48.71 40385444 -b- -- ---xx 19 - Track 19.shn
5:01.43 53198630 -b- -- -a-xx 20 - Track 20.shn
70:36.46 712.72 MB (totals for 20 files, 0.6903 overall compression ratio)

FIXED SHNS:

length expanded size cdr WAVE problems filename
3:23.04 35818652 --- -- ---xx rem1984-06-27t01-fixed.shn
3:47.68 40202780 --- -- ---xx rem1984-06-27t02-fixed.shn
5:23.64 57127772 --- -- ---xx rem1984-06-27t03-fixed.shn
3:55.55 41583404 --- -- ---xx rem1984-06-27t04-fixed.shn
3:09.35 33421964 --- -- ---xx rem1984-06-27t05-fixed.shn
4:27.34 47178812 --- -- ---xx rem1984-06-27t06-fixed.shn
3:14.14 34254572 --- -- ---xx rem1984-06-27t07-fixed.shn
4:01.47 42622988 --- -- ---xx rem1984-06-27t08-fixed.shn
3:29.60 37008764 --- -- ---xx rem1984-06-27t09-fixed.shn
2:52.51 30460796 --- -- ---xx rem1984-06-27t10-fixed.shn
2:01.72 21513788 --- -- ---xx rem1984-06-27t11-fixed.shn
3:51.59 40887212 --- -- ---xx rem1984-06-27t12-fixed.shn
3:39.28 38697500 --- -- ---xx rem1984-06-27t13-fixed.shn
2:51.01 30166796 --- -- ---xx rem1984-06-27t14-fixed.shn
3:48.08 40238060 --- -- ---xx rem1984-06-27t15-fixed.shn
2:49.62 29957468 --- -- ---xx rem1984-06-27t16-fixed.shn
3:00.39 31843772 --- -- ---xx rem1984-06-27t17-fixed.shn
1:57.55 20768204 --- -- ---xx rem1984-06-27t18-fixed.shn
3:48.71 40386236 --- -- ---xx rem1984-06-27t19-fixed.shn
5:01.44 53199932 --- -- ---xx rem1984-06-27t20-fixed.shn
70:36.46 712.72 MB (totals for 20 files, 0.6911 overall compression ratio)

WAVS FROM EACH:

length expanded size cdr WAVE problems filename
3:23.04 35818652 --- -- ----- rem1984-06-27t01-fixed.wav
3:23.05 35820670 -b- -- -a--- rem1984-06-27t01.wav
3:47.68 40202780 --- -- ----- rem1984-06-27t02-fixed.wav
3:47.68 40201874 -b- -- -a--- rem1984-06-27t02.wav
14:21.69 145.00 MB (totals for 4 files, 1.0000 overall compression ratio)