[ic] Large file uploads failing

[jimbo]

Mike Heins wrote:

> What are you doing with the file? If you are parsing it, like putting
> it in a [tmp] or [seti] tag, then it might take some parsing....

Using [value-extended] to write the data to a file. Nothing more.

> We would need to see the application code to go further. Also, how
> much memory do you have?

Here's the code:

[calc]&Log('We've made it!'); return;[/calc]

[tmp bulk_count]10[/tmp]

[if cgi bulk_creation]
<pre>[loop list="0..[calc][scratch bulk_count]-1[/calc]"
            ranges=1]
Upload: [value-extended name="media_[loop-code]"]
Test isfile: [value-extended name="media_[loop-code]" test=isfile]
[if type=explicit
     compare=|[value-extended name="media_[loop-code]" test=isfile]|]
writing file: [value-extended name="media_[loop-code]" umask=113
                               outfile="media_[loop-code]"][/if]
[/loop]</pre>[/if]

Please bear in mind, for the purposes of this exercise, only a single 
file is being uploaded.

As for memory, from dmesg:

real memory  = 1072234496 (1022 MB)
avail memory = 1035632640 (987 MB)

The &Log() call never shows up.

> If we can make it more efficient somehow and get bigger sizes, it
> would be nice I guess. But HTTP upload of 20MB files is not really
> the way I would choose to run my particular railroad.... 8-)

Ok, Mr. Fat Controller, how would you choose to do it? :)

If I can find a way to integrate some other means of uploading files 
while not losing the UI table editor interface, I'm all ears. But the 
problem is, we've sold them on using the IC UI to do all their content 
management tasks. They use the 'New Entry' tab and enter the file meta 
data, choose the file to upload, click 'Ok' and all is well. Or it 
should be. For large-ish files, it all goes pear-shaped.

They've been using a bespoke system (Perl and CGI.pm and LibXML) for 
more than 5 years. They've never had any trouble uploading, regardless 
of file size. All uploading is done over an internal LAN.

(Just in case, the Fat Controller reference is to the well known 
character in The Railway Series of books by Rev. W. V. Awdry that 
includes that most famous engine of engines, Thomas the Tank Engine. 
Please don't be offended.)

jimbo
;-)


-- 
Jim Brewer
Sound Images
12 Whins Close
Camberley
Surrey
GU15 3NW
T +44 (0) 1276 64405
E jimbo at soundimages.co.uk
W http://www.soundimages.co.uk/

------------------------------------------------------------------------
The information in this email is confidential and the contents are not
to be disclosed to anyone other than the addressee, except with their
permission. The opinions expressed represent those of the individual and
not necessarily those of Sound Images. If received in error please
advise the sender and remove from your system.

Sound Images does not guarantee this message, or any attachments, are
free from viruses or other defects.
------------------------------------------------------------------------