Is this by any chance a NetApp Filer with an NFS file system you're trying to write to ?
If so, we've encountered this problem a couple of times due to a "bug", that kicks in once in a while, making the filsystems "read only" !
It happened when we did "some operation" on the Filer and then the ESX lost contact...