Duplicate Attributes/Values on CSV Combination Import

[drooney]

HI all,

 

 

using Prestashop 1.6.09: As the situation is, there are around 1000 products on the store which imported but some images (those with the "+" symbol in the name) failed to get an image, the categories had issues with the "/" symbol in the names of categories that lead to hundreds of duplicates.  simple fix was remove the offending symbol.  However the Combinations import is proving rather impossible,

 

there is around 14000 combinations covering the 1000+ products, alot import just fine but every so often an attribute is duplicated that results in a rather tedious shop enviroment of say a product with 2 Black entries that link to different values of a second attribute, so the first Black + M is valid but the first Black + L is not a combination, then the second Black + M isnt valid and the second Black + L is valid. 

 

My question: "Is there situations that cause issues on combination import?".

 

I ask as I mentioned the issue with the "/" symbol importing categories and "+" for images.  CSV subset of the most offending combinations for reference (Reference is Blank intentionally).  Worth Noting, a value thats used only once for one product is also duplicated and I have also ensured that there are no trailing spaces in strings.

 

--EDIT--

Through testing it seems it could be due to the fact that the shop is on a shared host, limited php script time forced me to use multiple small csv files and it seems to be, as more attribute/values are added to the database each successive line adds more time to the importController, as far as i can tell the first file finishes with about 10-30 seconds (100 records) and the final file takes around 30-60 seconds per record, I spaced the imports 5 minutes apart based on the timing of a mostly emtpy database.  This results in multiple files importing simultaneously resulting in the possibility that duplicates appear.  Would this assumption be accurate?

--EDIT--

ProductID;Attributes (Name:Type:Position);Values (Name:Position);Price;Reference
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 2500Wx1000D:1;0;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 2500Wx1200D:1;40;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 3000Wx1200D:1;65;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 3500Wx1200D:1;153;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 4000Wx1200D:1;231;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 4500Wx1200D:1;263;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 5000Wx1200D:1;296;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 2500Wx1000D + Cable Management ( WT):1;226;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 2500Wx1200D + Cable Management ( WT):1;266;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 3000Wx1200D + Cable Management ( WT):1;382;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 3500Wx1200D + Cable Management ( WT):1;572;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 4000Wx1200D + Cable Management ( WT):1;702;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 4500Wx1200D + Cable Management ( WT):1;785;
1099;oldColour:select:0, oldOption:select:1;Natural Oak:0, 5000Wx1200D + Cable Management ( WT):1;912;

Edited February 11, 2015 by drooney (see edit history)