X
PrevPrev Go to previous topic
NextNext Go to next topic
Last Post 09 May 2012 11:53 AM by  anon
Writing large HDF5 datasets
 0 Replies
Sort:
You are not authorized to post a reply.
Author Messages

anon



New Member


Posts:3
New Member


--
09 May 2012 11:53 AM
    IDL 8.1 { x86_64 darwin unix Mac OS X 8.1 Mar 9 2011 64 64} Mac OS X 10.7.3 I am trying to write a large data array to an HDF5 file using the IDL libraries, and it appears as though I can not write a dataset that is larger than 4.3GB. I can write multiple datasets to a file that add up to more than 4.3GB. I get an error at the H5D_WRITE proceedure with "H5D_WRITE: can't write data: Object ID:83886083" or some such number. More specifically, if I am writing out floats, I can not write more than 2ll^31/4-1. If writing doublefloat 2ll^31/8-1 Here is a test code: PRO Testhdf5file filename = 'test.hdf5' npoints = 2ll^31/8-1 ; This works ;npoints = 2ll^31/8 ; This does not work data = DINDGEN(npoints) file_id = H5F_CREATE(filename) datatype_id = H5T_IDL_CREATE(data) dataspace_id = H5S_CREATE_SIMPLE([npoints]) temp_ds_id = H5D_CREATE(file_id, 'Fake Data', datatype_id,dataspace_id) H5D_WRITE, temp_ds_id, data H5D_CLOSE, temp_ds_id H5F_CLOSE, file_id END
    You are not authorized to post a reply.