Live Chat Software by Kayako |
Knowledgebase: Additional Modules
|
Why it can take so long to import several hundreds of listings through CSV import module ?
Posted by Esvon Support on 20 January 2010 12:52 PM
|
|
|
Most probably you import listings with images and your CSV file has images specified as URLs. For example, if you have 500 listings in CSV file and each listing has 3 images as URLs to files, it means PHP will have to make 500x3 = 1500 external web requests to download images for all your listings from CSV file. If each image web request will take 1 second (it may be even more for slow or distant image servers), it means 1500 seconds (25 minutes) will be necessary to download images only. Solutions ? 1/ if it's possible, it's better to have all the images from CSV feed on your server hard drive in one directory, for example in "/var/www/csv_images/" - if your CSV file provider can provide all the images in one archive, you can upload them to your server before doing CSV import task; - you can create a tool (script) to pre-process your CSV file and pre-download all the images into one place at your server and update CSV file to have correct local image file references; - find some other way to have as many remote image as possible as local files at your server If all images are at the same place, you can specify path to images directory in "Path to images" field (see "CSV Import" screen). In this case you can use simple image filenames for [Images] column data (e.g. image1.jpg,image2.jpg,image3.jpg). 2/ just split your CSV file into several smaller CSV files to have reasonable listings import time and make several data import steps. If you have significant amount of entries in CSV feed, it is hardly a sweet way and the 1st solution is preferred. For more details, don't forget that module-specific instructions you can find by clicking "Help" link next to the module ("CSV Import" in our case) under "Admin Area -> Manage Modules" section. | |
|
|
|
Comments (0)