EasyPopulate 4.0 Support Thread

I think your question was clear, so I provided the requirements that must be met. How they are met is up to the updater.

So there is issue of making changes, making unintentional changes and there is the issue of potentially undesired addition of products.

Product is added when a model number is provided that doesn't already exist. (Don't change a model number, don't add a product with a new model number if no product is to be added.) Not exactly a product addition, but by changing a category/sub-category assigned to a product will provide a linked version of the product. Download of a linked product will look like there are two products with the same model number... Change of the first without change of the second (with both still in the upload file) will result in the product having the last version of the changed/non-changed data. See below.

A product is updated (whether any change is made or not) if a row exists with a model number that exists in the database. It also gets updated to the last row of data that has the same model number as one that already exists (don't duplicate model numbers in the store, won't update the model numbered product with the last row of data found.) Further, if a model number is blank after a model numbered product, then I thought that the previous model numbered product would get updated with that data. (Don't have a blank model number, but also see the previous about adding a model number.)

Then there is the minimum columns for which EP4 expects in order to update the desired column(s). Currently the code requires the product name column in order to process the product description. There are a few other similar minimum requirements, but those were not asked about nor would they impact the column(s) described as needing to be updated. So to update the description of a product, the products name must be one of the columns included.

So, of the few thousand products to be updated, all but the rows to be updated could be removed from the file being uploaded. Therefore the list of items to be touched would be reduced to just those to be edited. (Filter on the data by category, model number starting with, description contains, etc... And keep/remove the resulting rows placing them on some other sheet/csv file.)

Then as for column reduction/ease of editing, either all of the columns end up remainging "adjacent" to the original data, but visually separated during editing so as to minimize accidentally clicking in a field, or all columns except for the minimum to achieve the desired upload as required by the code are removed.

Regardless, it is not a download, change, update one field only one time and blindly upload process... There are some criteria that have to be met in order to meet the desired: no additions, no inadvertent changes, make the desired changes requirements...

If you have no linked products, all products have a model number and every model number is unique, no product quantities change between the download and reupload, and you only change the description field, then yes could download, open in open office, save in the format to be read, and upload the new file, then it could be that simple... (Hint, probably going to want to remove the quantity field/column in the upload file unless the inventory is also part of the upload update.)

On the issue of instructions, there are generic instructions in the wiki on using Easy Populate in general. None of those instructions get into the details of which columns must remain/can be deleted. It is not anticipated that such detailed instructions will exist (ZC periodically adds/modifies table field names, and this way it is not up to the instructions to pin-point a field, but how it interfaces with the store) and is why it is suggested to 1) try the desired changes on a test store to validate results especially when starting out with developing the process that works for a specific store, and 2) to backup the store's database before uploading/updating with EP4.

Thank you for such a complete answer. I went back and read it a second time to help it sink in good...

I do have 1 last (hopefully last) question about importing and exporting, and it is in regards to certain characters in the v_products_model, v_products_name_1, and v_products_description_1.

I sell parts (thousands of different ones), and I'm finally getting around to adding product lines that use decimals and fractions in the v_products_model, and I will also need to use the part numbers in the v_products_name_1 and v_products_description_1 columns too.

I do NOT use attributes, nor options, nor linked products, nor will I ever (if that matters), and ONLY use English.

Can the period/decimal point be used in these fields (v_products_model = "A10.7" for example), and can ¼, ½, and ¾ be used (v_products_model = "B10½" for example)? And if so, what is recommended, the characters directly (¼, ½, and ¾), or the html "&frac14" "&frac12" and "&frac34" ?

Thank you again

Although I have read at least once that periods may need to be escaped (\ put in front of the character to escape) I have not seen issue with using a period in the text fields without such an escape. (Notice also the direction of the slash, it is what is often called a backslash and located near the backspace key of a "typical" keyboard US version anyways.) If you go and start using quotes and single quotes, then you will more than likely need to escape those.

As for the use of numbers with slashes, or "generated" versions of them, I would recommend the html version, but doesn't hurt to also try and see what types of results you get. (Test site right?) May give you an opportunity to do more with it as well, could surround the character(s) with span tags. And the use CSS on the products pages to do more, etc.... Maybe some others that have gone one route or the other have some ideas/can share their experience.. :)

Yeah that's one of the things about EP4, I kinda think of it as pumped up ZC... And while is relatively easy to use, has it's own set of rules to follow, but as you do know or will soon find out allows large/several changes at ones fingertips. :)

Is there a way to export/import products with a reference to the additional images that are defined by image handler? Right now when I import it back to another zen cart, I only retain the main image.

mydanilo:

Is there a way to export/import products with a reference to the additional images that are defined by image handler? Right now when I import it back to another zen cart, I only retain the main image.

The "main" image is all that is ever in the database. To get the other images, they would need to be loaded/transferred from one site to the other through ftp. Image Handler then does it's magic on the base file(s) to create the resized images for display. There is nothing further that EP4 does with the images other than populate the database with the location at which the main image is expected.to be found, whether there or not.

OK, so if these are new products to be imported and additional images are at hand I would have to name them with xy_01.jpg and next xy_02.jpg if the main image is xy.jpg. Correct? How about resizing, do I have to upload correct sizes or will IH still kick in and do the resizing for me? If IH does the resizing, I could upload all images in my largest wanted size, let's say 700x700px.

Edit: I just tried and uploaded the extra pictures with the correct naming and they are now showing up. Thank you for the IH lesson! I should have really known that, :blush:

mydanilo:

OK, so if these are new products to be imported and additional images are at hand I would have to name them with xy_01.jpg and next xy_02.jpg if the main image is xy.jpg. Correct? How about resizing, do I have to upload correct sizes or will IH still kick in and do the resizing for me? If IH does the resizing, I could upload all images in my largest wanted size, let's say 700x700px.

Filenaming: correct
IH resizing: truly appropriate to ask in the applicable forum for the version run, but yes it will resize as necessary.
Largest image: that is the intent of IH, but there are limits of the software IH calls for resizing. Again applicable to address in the applicable IH forum (version 4 for ZC 1.5.x)

I am trying to import a few items with new categories. Getting the following error:
SKIPPED! - Model: xxxxxx - No category provided for this new product

There is a category provided in the cvs as I exported it from another zen cart. Just does not want to take it.

So I then tried to just export categories and import at the new one. Complaining too.
SKIPPED! - Category ID: 62 - Not Found!
So I thought maybe if the category does not exist yet I need to delete the Cat ID field from my import, well that did not work ether. Any idea what I'm doing wrong?

Well, solved it myself. Looked at the header in the two exports. Turns out that in one DB the field names are like v_categories_name_2 in the other DB v_categories_name_1. I now remember that this threw me off before. Not sure when this naming in the db happened that everything ends in _2 in one cart. Any idea how I could finally correct this? Maybe I should post that somewhere else just not sure where. Anyway, problem solved. New categories and products now import fine. Thank you for a great mod.

mydanilo:

Well, solved it myself. Looked at the header in the two exports. Turns out that in one DB the field names are like v_categories_name_2 in the other DB v_categories_name_1. I now remember that this threw me off before. Not sure when this naming in the db happened that everything ends in _2 in one cart. Any idea how I could finally correct this? Maybe I should post that somewhere else just not sure where. Anyway, problem solved. New categories and products now import fine. Thank you for a great mod.

That would do it... Basically what it seems has happened is that in the database that ends with a 2, the original language was removed at some point and language 2 was installed (perhaps really the same language as the first one, but the language received an identification number of 2... One of those additional features I have been considering is to replace the number with some form of a language abbreviation... That said, if you still have access to the "old" store, you will see in the EP4 admin panel in the upper right the designation (2) and the language to which that is associated.... In your new store, you would see something similar, but a 1 next to the language...

No, had the right forum as this naming convention is unique to Ep4. Now what to do to shift the old store from 2 to 1 or the new store from 1 to 2... Yeah, new thread. :)

I have about 13K linked items in a product category folder. I thought that the category could contain sub categories or items not both. Somehow I have done this and created duplicate items from another product sub-category. I understand about deleting the items with product status 9. That removes both items because they are linked and the ID number is the same. I'm ok with reloading the file which re installs the item with a different master ID.

Since I am trying to submit a file for google shopping this action makes my product link invalid and ruins my day. Is there a way to download the master ID number so I can update the product link so it works? In previous version I used the froogle tab to download the file. Since upgrading I am limping along trying to keep my old files updated.

I am using Zen cart 1.54 and Easy Populate 4.0.28 - Beta 01-03-2015

keith z:

I have about 13K linked items in a product category folder. I thought that the category could contain sub categories or items not both. Somehow I have done this and created duplicate items from another product sub-category. I understand about deleting the items with product status 9. That removes both items because they are linked and the ID number is the same. I'm ok with reloading the file which re installs the item with a different master ID.

Since I am trying to submit a file for google shopping this action makes my product link invalid and ruins my day. Is there a way to download the master ID number so I can update the product link so it works? In previous version I used the froogle tab to download the file. Since upgrading I am limping along trying to keep my old files updated.

I am using Zen cart 1.54 and Easy Populate 4.0.28 - Beta 01-03-2015

So, yes it is correct that a category should contain either sub-categories or products not both. It is something that is still allowed to be done (though doesn't provide desired results) in ZC, but typically requires the sub-categories to be disabled in order to add a product to the category that has a sub-category(ies)... So, yes the same thing could end up happening while using EP4 at this time.

It would be better to not go and "recreate" the store with all new product ids, but instead to resolve the current issue and a process to not have it reoccur. First things first, do you normally have linked product or was this something that mistakenly happened? Depending on the status of things, and the expected condition, may be able to run a SQL command to remove the linked items from the undesirable location(s)... But a little bit of information would help (if assistance is being sought... If able to do on your own, maybe would share the solution discovered.)

The additional product data field values can be pulled using the **User Defined Products Fields **field in admin->configuration->Easy Populate 4.
Provide the field name that is desired to obtain from the Products table as listed in the products table (ie. master_categories_id). Do not add the prefix ("v_") that you are accustomed to seeing in the export file.

As for froogle, the ability to download/export the full URI was provided to support froogle related/historical download of information.. Admin->configuration->Easy Populate 4->Export URI with Prod and or Cat. Is there something more that is needed to support that "effort"? Just because I'm a non-user doesn't mean the additional information/formatting can't be added, just need some help/input... :)

Thank you for your help. I have just a handful of linked products of about 18K products.

I went to User Defined Products Fields field in admin->configuration->Easy Populate 4 and entered the field name master_categories_id. When I went back to easy populate I noticed a new file 210 in size called Values-EP2015Mar08-084448.csv.

When I download Complete Products (with Metatags) I get the message "an error occurred while processing this directive". Tried to reload and I have 2 different size easy populate files. I am guessing that is because of the file size.

The Export URI with Prod and or Cat setting worked great! I was able to download the text file with URLs.

keith z:

Thank you for your help. I have just a handful of linked products of about 18K products.

I went to User Defined Products Fields field in admin->configuration->Easy Populate 4 and entered the field name master_categories_id. When I went back to easy populate I noticed a new file 210 in size called Values-EP2015Mar08-084448.csv.

When I download Complete Products (with Metatags) I get the message "an error occurred while processing this directive". Tried to reload and I have 2 different size easy populate files. I am guessing that is because of the file size.

The Export URI with Prod and or Cat setting worked great! I was able to download the text file with URLs.

So, a little confused, but...

Are there any unresolved issues at this time? Do you still get an error when using the Download Complete Products (with Metatags)?
Files do not just get randomly created, so how did Values-EP2015Mar08-084448.csv get created? (Notice the filename includes a timestamp basically.. So should be able to closely figure out the issue.)

If an error occurred when selecting the Complete Products (with Metatags) link, a debug file should have been created in your download files section of EP4... Please post/provide the contents of that file except do not expose your admin directory.

Yes size reports the filesize, the two different files should also have two different filenames...

But really trying to ensure to identify any issues with the base product. I just installed it on a ZC 1.5.3 system and hadn't come across any unexpected issues yet..

Are there any unresolved issues at this time? Yes I still need to remove the unwanted linked items in the product category list.

Do you still get an error when using the Download Complete Products (with Metatags)? Yes the same error message comes up but I can download the file just fine if I use the browser back button.

Files do not just get randomly created, so how did Values-EP2015Mar08-084448.csv get created? (Notice the filename includes a timestamp basically.. So should be able to closely figure out the issue.) Don't know what to do with this file. Here is the text of the file Values-EP2015Mar08-084448.csv:

v_products_options_values_id v_language_id v_products_options_values_name v_products_options_values_sort_order
0 1 TEXT 0
1 1 http://home1/my domain.com/download/C_8752_8752KFT_-_2M-70988-E 10

If an error occurred when selecting the Complete Products (with Metatags) link, a debug file should have been created in your download files section of EP4... Please post/provide the contents of that file except do not expose your admin directory. - NO debug file is present.

Yes size reports the filesize, the two different files should also have two different filenames... Yes

keith z:

Are there any unresolved issues at this time? Yes I still need to remove the unwanted linked items in the product category list.
So if you know what category the linked product(s) are to stay in, then I think there is even a SQL query back a few pages to address removing the product from the linked category, otherwise, the first thing to do is to make sure that the product's master_categories_id is set to a value that the product is expected to remain under, then to remove the product from the category(ies) (products_to_categories table) that it is not supposed to be related.

keith z:

Do you still get an error when using the Download Complete Products (with Metatags)? Yes the same error message comes up but I can download the file just fine if I use the browser back button.
keith z:

If an error occurred when selecting the Complete Products (with Metatags) link, a debug file should have been created in your download files section of EP4... Please post/provide the contents of that file except do not expose your admin directory. - NO debug file is present.
Confused... When is the error identified? Please read the questions carefully and respond appropriately. Is an error generated when selecting: Complete Products (with Metatags), or when selecting: Download?
If the error is from selecting: Download, then the following more than likely applies:
Okay, so this is when clicking on the file to actually download it, not to generate the file so that it can be clicked on to download... More than likely as reported recently, the temporary file that is being used is in a sub-directory not in the admin folder... The instructions suggest pointing the temporary directory (download directory) into the admin folder, and further identifies that when the folder is in the admin directory that the .htaccess file for the admin directory may need some modification to permit download of the csv from the menu. (File download would always be possible via ftp, though that also complicates things a little.)

keith z:

Files do not just get randomly created, so how did Values-EP2015Mar08-084448.csv get created? (Notice the filename includes a timestamp basically.. So should be able to closely figure out the issue.) Don't know what to do with this file. Here is the text of the file Values-EP2015Mar08-084448.csv:

v_products_options_values_id v_language_id v_products_options_values_name v_products_options_values_sort_order
0 1 TEXT 0
1 1 http://home1/my domain.com/download/C_8752_8752KFT_-_2M-70988-E 10

This file basically can be used to identify the sort order of the option values that are provided.. It's use is fairly limited and is basically for viewing only as the screen of EP4 indicates... If you don't need the file(s) anymore it/they can be deleted, though the above issue of where the folder is located may need to be addressed...

mc12345678:

So if you know what category the linked product(s) are to stay in, then I think there is even a SQL query back a few pages to address removing the product from the linked category, otherwise, the first thing to do is to make sure that the product's master_categories_id is set to a value that the product is expected to remain under, then to remove the product from the category(ies) (products_to_categories table) that it is not supposed to be related.

Not sure how familiar you are with phpmyadmin, but the following sql would identify any product that is listed in two or more categories:

SELECT ptc. * , p.master_categories_id AS mci
FROM  `prefix_products_to_categories` ptc,  `prefix_products` p
WHERE p.products_id = ptc.products_id
AND p.master_categories_id != ptc.categories_id

where prefix_ should be replaced with whatever DB_PREFIX is in your includes/configure.php file... If the DB_PREFIX is '' then simply remove prefix_ leaving behind all the rest...

Once more information is known about either which product(s) to keep or which category(is) are to be untouched, then the above can be modified... Suggestion is to continue using the above as a SELECT query until the result(s) identify the row(s) that are to be deleted... Then substitute everything up to the FROM statement with DELETE so that it would read DELETE FROM...

mc12345678:

Not sure how familiar you are with phpmyadmin, but the following sql would identify any product that is listed in two or more categories:

SELECT ptc. * , p.master_categories_id AS mci
FROM prefix_products_to_categories ptc, prefix_products p
WHERE p.products_id = ptc.products_id
AND p.master_categories_id != ptc.categories_id

> 
> where prefix_ should be replaced with whatever DB_PREFIX is in your includes/configure.php file... If the DB_PREFIX is '' then simply remove prefix_ leaving behind all the rest...
> 
> Once more information is known about either which product(s) to keep or which category(is) are to be untouched, then the above can be modified... Suggestion is to continue using the above as a SELECT query until the result(s) identify the row(s) that are to be deleted... **BACKUP FIRST----->**Then substitute everything up to the FROM statement with DELETE so that it would read DELETE FROM...

Added a cautionary note... The database should be saved before running such a delete query, just in case...

mc12345678:

That would do it... Basically what it seems has happened is that in the database that ends with a 2, the original language was removed at some point and language 2 was installed (perhaps really the same language as the first one, but the language received an identification number of 2... One of those additional features I have been considering is to replace the number with some form of a language abbreviation... That said, if you still have access to the "old" store, you will see in the EP4 admin panel in the upper right the designation (2) and the language to which that is associated.... In your new store, you would see something similar, but a 1 next to the language...

No, had the right forum as this naming convention is unique to Ep4. Now what to do to shift the old store from 2 to 1 or the new store from 1 to 2... Yeah, new thread. :)
Great, was enough of a pointer, just edited language table with phpMyAdmin SET languages_id = '1'. Now it all works together better. Thank you.

mydanilo:

Great, was enough of a pointer, just edited language table with phpMyAdmin SET languages_id = '1'. Now it all works together better. Thank you.

Glad that fixed it. :)