[ic] Trying to import 50,000 items

Mike Heins interchange-users@icdevgroup.org
Tue Aug 6 13:20:00 2002


Quoting Nicholas Cook (ncook@foxmillpets.com):
> I am trying to import a catalog of roughly 50,000 items and I am finding 
> the import from the admin ui too slow (timing out on webserver). 
> Database is PostgreSQL 7.1.3 and Interchange 4.8.3.  Is there a command 
> line utility to allow this from a tab delineated file.  Also, curiosity 
> question.  For those other people that have done the same, roughly how 
> long did it take for your import to finish.
> 

I would check out the latest Interchange from CVS (the devel branch) and
get the file:

	code/UI_Tag/import_fields.coretag.

Replace

    lib/UI/usertag/import_fields.tag

with that, for I think Dan Browning just fixed this problem.

This is due to Postgres by default doing a sync with every write. The
[import-fields ..] tag was also suboptimal in the way it did things.

-- 
Mike Heins
Perusion -- Expert Interchange Consulting    http://www.perusion.com/
phone +1.513.523.7621      <mike@perusion.com>

Being against torture ought to be sort of a bipartisan thing.
-- Karl Lehenbauer