Large Number Of Photoshop And Jpeg Files Corrupted

On Nov 11, 11:11 am, wrote:

Is it possible that a Photoshop file made up of a composite of jpegs contained in the same folder would corrupt the jpegs used to create the composite, or vice versa? I’ve been doing large scale panoramas made up of jpegs and I stored the panoramas and jpegs in the same folder which was probably a very stupid idea. Over time the photoshop files would become corrupted along with some of the jpegs. I’ve ruled out virus, malware and bad hard drive. I’m hoping this is the problem since I’m freaking every time I open a folder on the storage drive, a 160 gig Seagate Sata drive. I’m using W2K SP4 and BreezeBrowser Pro for an image viewer. Some of the images had been originally worked on in Photoshop 7, then Photoshop CS2. The corruption hasn’t happened in all of the folders with this arrangement; I’m wondering if the corruption occurs as the images in the folders are being worked on with greater frequency? I’ve subsequently placed the panoramas in different folders and now have only jpegs in separate folders. I burned everything to disc so I’m hoping the problem has been solved but I’m not that sure. The strange thing is photoshop (psd) files and some jpegs in many of the folders became corrupt, but there were some folders where this didn’t happen. I suppose the solution is to burn hard copies ASAP, but I’d sure like to definitively know why this has happened. Thanks for any assistance.

Generally one would blame a hardware problem (RAM, controller, cable, drive, power) – and you’re also running Windows – so all bets are off. Backups are essential.

I don’t see how you can "rule out" faulty hardware (did you do a thorough memory test?) I can’t speak for Windows but in UNIX based filesystems that are generally used, you are very unlikely to ever see a software fault. Sun’s ZFS offers additional and unique data integrity guarantees. How valuable is your data?

In article ,
says…

Is it possible that a Photoshop file made up of a composite of jpegs contained in the same folder would corrupt the jpegs used to create the composite, or vice versa? I’ve been doing large scale panoramas made up of jpegs and I stored the panoramas and jpegs in the same folder which was probably a very stupid idea. Over time the photoshop files would become corrupted along with some of the jpegs. I’ve ruled out virus, malware and bad hard drive. I’m hoping this is the problem since I’m freaking every time I open a folder on the storage drive, a 160 gig Seagate Sata drive. I’m using W2K SP4 and BreezeBrowser Pro for an image viewer. Some of the images had been originally worked on in Photoshop 7, then Photoshop CS2. The corruption hasn’t happened in all of the folders with this arrangement; I’m wondering if the corruption occurs as the images in the folders are being worked on with greater frequency? I’ve subsequently placed the panoramas in different folders and now have only jpegs in separate folders. I burned everything to disc so I’m hoping the problem has been solved but I’m not that sure. The strange thing is photoshop (psd) files and some jpegs in many of the folders became corrupt, but there were some folders where this didn’t happen. I suppose the solution is to burn hard copies ASAP, but I’d sure like to definitively know why this has happened. Thanks for any assistance.

I’ve been using PS since it hit the PC. In all of those years (actually decades), I’ve never seen corruption, like you suggest. In that time, the only file corruption, that has ever happened has been from hardware – SyQuest, SyJet, HDD (and this goes back to MFM HDDs). Some was from SCSI chains/cables, that just went south, while others were with the disks, themselves.

Now, I have worked mainly with TIFFs and PSDs, leaving JPGs for the final output, if going to the Web, but one still should not encounter what you describe.

I did have two images that went strangely dark, but we tracked this down to the output house, which was using MAC and their wanting to mount that SyQuest disk to their MAC/PC network, import to a PC and then transfer it to their MAC, rather than just mount it (it was a MAC formatted disk, that I output from PC, with the proper software, but they did not trust this and messed things up with their cobbled network). That was once, out of thousands.

Though you state that it is NOT hardware, I’d rule out hardware 100%.

Hunt

On 14 Nov 2007 04:34:43 GMT, (Hunt) wrote:

In article ,
says…

Is it possible that a Photoshop file made up of a composite of jpegs contained in the same folder would corrupt the jpegs used to create the composite, or vice versa? I’ve been doing large scale panoramas made up of jpegs and I stored the panoramas and jpegs in the same folder which was probably a very stupid idea. Over time the photoshop files would become corrupted along with some of the jpegs. I’ve ruled out virus, malware and bad hard drive. I’m hoping this is the problem since I’m freaking every time I open a folder on the storage drive, a 160 gig Seagate Sata drive. I’m using W2K SP4 and BreezeBrowser Pro for an image viewer. Some of the images had been originally worked on in Photoshop 7, then Photoshop CS2. The corruption hasn’t happened in all of the folders with this arrangement; I’m wondering if the corruption occurs as the images in the folders are being worked on with greater frequency? I’ve subsequently placed the panoramas in different folders and now have only jpegs in separate folders. I burned everything to disc so I’m hoping the problem has been solved but I’m not that sure. The strange thing is photoshop (psd) files and some jpegs in many of the folders became corrupt, but there were some folders where this didn’t happen. I suppose the solution is to burn hard copies ASAP, but I’d sure like to definitively know why this has happened. Thanks for any assistance.

I’ve been using PS since it hit the PC. In all of those years (actually decades), I’ve never seen corruption, like you suggest. In that time, the only file corruption, that has ever happened has been from hardware – SyQuest, SyJet, HDD (and this goes back to MFM HDDs). Some was from SCSI chains/cables, that just went south, while others were with the disks, themselves.
Now, I have worked mainly with TIFFs and PSDs, leaving JPGs for the final output, if going to the Web, but one still should not encounter what you describe.

I did have two images that went strangely dark, but we tracked this down to the output house, which was using MAC and their wanting to mount that SyQuest disk to their MAC/PC network, import to a PC and then transfer it to their MAC, rather than just mount it (it was a MAC formatted disk, that I output from PC, with the proper software, but they did not trust this and messed things up with their cobbled network). That was once, out of thousands.
Though you state that it is NOT hardware, I’d rule out hardware 100%.
Hunt

You’re right about this type of corruption generally being caused by hardware malfunction, but I’m not sure what else it could be beyond the drive and the ram, and both have checked out. So just to rule my situation out, you do not think that having jpegs and psd files made up of the jpegs that are residing in the same folder would create a corruption of the psd files or vice versa? Do you think anti virus software (Avast) registry optimizer (Winaso) or defragging software (Perfect Disk 8.0) could be part of the problem? My other thought is graphics card memory, but the card, a Matrox Parhelia 256mg. AGP card has not created any problems that I can see.

wrote:

You’re right about this type of corruption generally being caused by hardware malfunction, but I’m not sure what else it could be beyond the drive and the ram, and both have checked out.

It could also be the motherboard, or conceivably the drive cables or the power supply.

Checking the RAM even with memtest86 won’t necessarily catch all errors – for example, we had a m/b here which passed memtest86, but PS still crashed sometimes – it seems that the m/b couldn’t cope with RAM in the last slot when under intense use. Replacement m/b cured it.

It’s always worth trying to open an apparently corrupted jpeg file with IrfanView, as it seems tolerant of errors that make PS refuse to open it.

Andrew

In article ,
says…

On 14 Nov 2007 04:34:43 GMT, (Hunt) wrote:

In article ,
says…

[SNIP]

You’re right about this type of corruption generally being caused by hardware malfunction, but I’m not sure what else it could be beyond the drive and the ram, and both have checked out. So just to rule my situation out, you do not think that having jpegs and psd files made up of the jpegs that are residing in the same folder would create a corruption of the psd files or vice versa? Do you think anti virus software (Avast) registry optimizer (Winaso) or defragging software (Perfect Disk 8.0) could be part of the problem? My other thought is graphics card memory, but the card, a Matrox Parhelia 256mg. AGP card has not created any problems that I can see.

Though I usually set up my folder hierarchy so that JPGs, or TIFFs go into a sub-folder for ease of work and some automation, I’ve had the NEFs, PSDs and output files, usually JPGs, in the same folder, with no problems. I am not saying that something cannot happen, only that in almost 2 decades, nothing has.

As for other software issues, I do not use the products, that you mention, but do use others. Of the ones in your list, first suspect would be the defrag utility. I’ve used others, with no problem, and this goes back to MFM HDDs, with no problem. However, that would be a possible area.

By the seat of my pants, I’d rule out the Matrox. It could play a role in display, but does not process any files in the IO chain, except to view them.

Yout problem is interesting, and just because I’ve not had them with years of this sort of thing, doesn’t mean that there is not some little glitch, that I have not encountered. I still keep coming back to the HDDs. That is the most likely culprit, though you say that that system checks out fine.

Have you encountered any re-booting of the machine? One problem that often causes that situation is a faulty power supply, or cooling of the CPU and HDDs. Problems there could lead to corruption, especially if the files are going through the CPU, either in processing, or Moving/Copying, etc.

Wish that I had some more ideas, other than, "hey, ain’t happened to me… " I did have some corruption on the HDDs of a system that died, and then the files were recovered by Stellar-Phoenix, however, in that situation, I was glad to get about 90% of the files back, and just let the other 10% pass as part of not having a 100% up to date backup. Actually, I was gathering the files to burn a Ghost image of them, when the system went south – I was but a few minutes too late.

I wish you the best and all of the luck that I can muster,

Hunt

In article ,
says…

wrote:

You’re right about this type of corruption generally being caused by hardware malfunction, but I’m not sure what else it could be beyond the drive and the ram, and both have checked out.

It could also be the motherboard, or conceivably the drive cables or the power supply.

Checking the RAM even with memtest86 won’t necessarily catch all errors – for example, we had a m/b here which passed memtest86, but PS still crashed sometimes – it seems that the m/b couldn’t cope with RAM in the last slot when under intense use. Replacement m/b cured it.

It’s always worth trying to open an apparently corrupted jpeg file with IrfanView, as it seems tolerant of errors that make PS refuse to open it.
Andrew

Good ideas. I had assumed that the OP was ending up with files that were only partial, from the corruption. If it was a problem of PS not opening the file, I agree completely. Irfanview, or ThumbsPlus, etc., can open a lot of JPGs, that PS refuses to touch. If so, Open in (other app.), do a Save_As, into another folder, and then re-try in PS. It is sensitive to all sorts of little glitches in files, especially JPGs.

Maybe you have helped the OP,
Hunt

On 17 Nov 2007 04:13:55 GMT, (Hunt) wrote:

In article ,
says…

On 14 Nov 2007 04:34:43 GMT, (Hunt) wrote:

In article ,
says…

[SNIP]

You’re right about this type of corruption generally being caused by hardware malfunction, but I’m not sure what else it could be beyond the drive and the ram, and both have checked out. So just to rule my situation out, you do not think that having jpegs and psd files made up of the jpegs that are residing in the same folder would create a corruption of the psd files or vice versa? Do you think anti virus software (Avast) registry optimizer (Winaso) or defragging software (Perfect Disk 8.0) could be part of the problem? My other thought is graphics card memory, but the card, a Matrox Parhelia 256mg. AGP card has not created any problems that I can see.

Though I usually set up my folder hierarchy so that JPGs, or TIFFs go into a sub-folder for ease of work and some automation, I’ve had the NEFs, PSDs and output files, usually JPGs, in the same folder, with no problems. I am not saying that something cannot happen, only that in almost 2 decades, nothing has.

As for other software issues, I do not use the products, that you mention, but do use others. Of the ones in your list, first suspect would be the defrag utility. I’ve used others, with no problem, and this goes back to MFM HDDs, with no problem. However, that would be a possible area.
By the seat of my pants, I’d rule out the Matrox. It could play a role in display, but does not process any files in the IO chain, except to view them.
Yout problem is interesting, and just because I’ve not had them with years of this sort of thing, doesn’t mean that there is not some little glitch, that I have not encountered. I still keep coming back to the HDDs. That is the most likely culprit, though you say that that system checks out fine.
Have you encountered any re-booting of the machine? One problem that often causes that situation is a faulty power supply, or cooling of the CPU and HDDs. Problems there could lead to corruption, especially if the files are going through the CPU, either in processing, or Moving/Copying, etc.
Wish that I had some more ideas, other than, "hey, ain’t happened to me… " I did have some corruption on the HDDs of a system that died, and then the files were recovered by Stellar-Phoenix, however, in that situation, I was glad to get about 90% of the files back, and just let the other 10% pass as part of not having a 100% up to date backup. Actually, I was gathering the files to burn a Ghost image of them, when the system went south – I was but a few minutes too late.

I wish you the best and all of the luck that I can muster,
Hunt

Thanks for all the replies. This site which pretty much sums up the reasons for possible data corruption:

http://www.datarecovery.com.sg/data_recovery/data_corruption .htm

but it doesn’t appear to be uncommon. Basically it’s important to back up asap. The more research I do the more I see people perplexed by their psd corruption.

I found this on a digital camera forum:

http://forums.dpreview.com/forums/read.asp?forum=1004&me ssage=25429810

And then I found this on Microsoft site about write caching:

http://support.microsoft.com/?kbid=259716

Thanks again for the help.

On Nov 14, 1:45 pm, "Andrew Morton"
wrote:

wrote:

You’re right about this type of corruption generally being caused by hardware malfunction, but I’m not sure what else it could be beyond the drive and the ram, and both have checked out.

It could also be the motherboard, or conceivably the drive cables or the power supply.

Checking the RAM even with memtest86 won’t necessarily catch all errors – for example, we had a m/b here which passed memtest86,

Did you run it for a long period?

but PS still crashed
sometimes – it seems that the m/b couldn’t cope with RAM in the last slot when under intense use. Replacement m/b cured it.

Yes, that is the PC world.

It’s always worth trying to open an apparently corrupted jpeg file with IrfanView, as it seems tolerant of errors that make PS refuse to open it.

I’ve also written a (free) PSD/PSB recovery tool:
http://telegraphics.com.au/sw/#psdrecover

Andrew

Are you using Vista? I have known Vista to corrupt jpg data, especially when using Photo Gallery to import and organise files. It sometimes overwrites markers put there by cameras and other devices with its own markers that indicate where the files have been put.

"Hunt" wrote in message

In article ,

says…

Is it possible that a Photoshop file made up of a composite of jpegs contained in the same folder would corrupt the jpegs used to create the composite, or vice versa? I’ve been doing large scale panoramas made up of jpegs and I stored the panoramas and jpegs in the same folder which was probably a very stupid idea. Over time the photoshop files would become corrupted along with some of the jpegs. I’ve ruled out virus, malware and bad hard drive. I’m hoping this is the problem since I’m freaking every time I open a folder on the storage drive, a 160 gig Seagate Sata drive. I’m using W2K SP4 and BreezeBrowser Pro for an image viewer. Some of the images had been originally worked on in Photoshop 7, then Photoshop CS2. The corruption hasn’t happened in all of the folders with this arrangement; I’m wondering if the corruption occurs as the images in the folders are being worked on with greater frequency? I’ve subsequently placed the panoramas in different folders and now have only jpegs in separate folders. I burned everything to disc so I’m hoping the problem has been solved but I’m not that sure. The strange thing is photoshop (psd) files and some jpegs in many of the folders became corrupt, but there were some folders where this didn’t happen. I suppose the solution is to burn hard copies ASAP, but I’d sure like to definitively know why this has happened. Thanks for any assistance.

I’ve been using PS since it hit the PC. In all of those years (actually decades), I’ve never seen corruption, like you suggest. In that time, the only
file corruption, that has ever happened has been from hardware – SyQuest, SyJet, HDD (and this goes back to MFM HDDs). Some was from SCSI chains/cables,
that just went south, while others were with the disks, themselves.
Now, I have worked mainly with TIFFs and PSDs, leaving JPGs for the final output, if going to the Web, but one still should not encounter what you describe.

I did have two images that went strangely dark, but we tracked this down to
the output house, which was using MAC and their wanting to mount that SyQuest
disk to their MAC/PC network, import to a PC and then transfer it to their MAC, rather than just mount it (it was a MAC formatted disk, that I output from PC, with the proper software, but they did not trust this and messed things up with their cobbled network). That was once, out of thousands.
Though you state that it is NOT hardware, I’d rule out hardware 100%.
Hunt