EasyPopulate 4.0 Support Thread

Umm, unless can point to where this issue is addressed in this forum, nothing about that content has to do with this version of EP

an error occurred while processing this directive

I'm trying to upload a new product list, with approx 6,800 products. Each time I do the upload, it crashes with the above error message displayed on a white screen. Also, the last product uploaded is different each time I run the upload, so I don't think there is an issue with uploaded data causing the crash. If I split the file into multiple uploads, (It splits this one into 2 uploads), the first one crashes, the second uploads fine.

I have looked for any error logs, but can't find one.

Any ideas??? Thanks!

RFree190:

an error occurred while processing this directive

I'm trying to upload a new product list, with approx 6,800 products. Each time I do the upload, it crashes with the above error message displayed on a white screen. Also, the last product uploaded is different each time I run the upload, so I don't think there is an issue with uploaded data causing the crash. If I split the file into multiple uploads, (It splits this one into 2 uploads), the first one crashes, the second uploads fine.

I have looked for any error logs, but can't find one.

Any ideas??? Thanks!

From my quick internet search, it would appear that the issue is more related to your host to some extent than to EP4 and that the error logs will be logged with your host or wherever they store logs related to the site's operation as compared to the ZC cache (ZC < 1.5.1)/logs (ZC >= 1.5.1) folder. The next thought is that the problematic file be split again (and again) until the culprit entry(ies) are identified. It may also be necessary to split the files to a more refined limit... What is the difference in number of entries between the two files? (Ie. what was the record split number as compared to the total number?) If say the cutoff were 5,000, then the second file would only contain about 1,800... But if the split were 3,400 then basically they are equal files in rows of content. The difference in row last seen before the error is probably a result of caching in one respect or another or because there is different system response and action for an update as compared to an insertion. About how long is it taking for the data to be processed? I don't recall which setting(s) affect it, but I have seen something about timeouts occurring when trying to process a larger file even if the code is still actively processing the file. Just some ideas. :) The other thing that I found was to verify your file and folder permissions, but not so sure I see that as the issue here... (644 for files, and 755 for folders)

mc12345678:

From my quick internet search, it would appear that the issue is more related to your host to some extent than to EP4 and that the error logs will be logged with your host or wherever they store logs related to the site's operation as compared to the ZC cache (ZC < 1.5.1)/logs (ZC >= 1.5.1) folder. The next thought is that the problematic file be split again (and again) until the culprit entry(ies) are identified. It may also be necessary to split the files to a more refined limit... What is the difference in number of entries between the two files? (Ie. what was the record split number as compared to the total number?) If say the cutoff were 5,000, then the second file would only contain about 1,800... But if the split were 3,400 then basically they are equal files in rows of content. The difference in row last seen before the error is probably a result of caching in one respect or another or because there is different system response and action for an update as compared to an insertion. About how long is it taking for the data to be processed? I don't recall which setting(s) affect it, but I have seen something about timeouts occurring when trying to process a larger file even if the code is still actively processing the file. Just some ideas. :) The other thing that I found was to verify your file and folder permissions, but not so sure I see that as the issue here... (644 for files, and 755 for folders)

Thanks for the quick reply.
I was doing some troubleshooting, using your idea of smaller "Splits" and think I tracked down the problem. I was using MS Access to compile a CSV of all my products. I have been doing this for years and have been using "chr(10) & chr(13)" to put line breaks and carriage returns into my product descriptions. For some reason, this broke my imports. Maybe it's the latest version of MS Access. I had been using Access 2007 for years, with success. This is my first time using Access 2013. I'm going to blame MS, as EP4 has worked for me in the past.

Thanks for your input. It helped me track down my issue.

reetp:

...code

Slight mod - needed to allow the file 'full-ep'

--- easypopulate_4-orig.php 2015-06-17 19:03:42.000000000 +0200
+++ easypopulate_4.php 2015-06-18 14:47:28.000000000 +0200
@@ -28,9 +28,9 @@
$ep_music = (int)EASYPOPULATE_4_CONFIG_MUSIC_DATA; // 0-Disable, 1-Enable
$ep_uses_mysqli = (PROJECT_VERSION_MAJOR > '1' || PROJECT_VERSION_MINOR >= '5.3' ? true : false);

-@set_time_limit($ep_execution); // executin limit in seconds. 300 = 5 minutes before timeout, 0 means no timelimit
+@set_time_limit($ep_execution); // execution limit in seconds. 300 = 5 minutes before timeout, 0 means no timelimit

-if (!$error) {
+if (!isset($error)) {
$upload_max_filesize=ini_get("upload_max_filesize");
if (preg_match("/([0-9]+)K/i",$upload_max_filesize,$tempregs)) $upload_max_filesize=$tempregs[1]*1024;
if (preg_match("/([0-9]+)M/i",$upload_max_filesize,$tempregs)) $upload_max_filesize=$tempregs[1]10241024;
[root@home myadmin]# diff -ruN easypopulate_4_import-orig.php easypopulate_4_import.php
--- easypopulate_4_import-orig.php 2015-06-18 11:18:05.000000000 +0200
+++ easypopulate_4_import.php 2015-06-26 15:19:07.000000000 +0200
@@ -8,6 +8,34 @@

$file = array('name' => $_GET['import']);
$display_output .= sprintf(EASYPOPULATE_4_DISPLAY_LOCAL_FILE_SPEC, $file['name']);

+/*

• • These are the filenames that we look for

+strtolower(substr($file['name'],0,11)) == "featured-ep")
+strtolower(substr($file['name'],0,15)) == "attrib-basic-ep"
+strtolower(substr($file['name'],0,18)) == "attrib-detailed-ep")
+strtolower(substr($file['name'],0,15)) == "sba-detailed-ep")
+strtolower(substr($file['name'],0,12)) == "sba-stock-ep")
+strtolower(substr($file['name'],0,15)) <> "categorymeta-ep")
+strtolower(substr($file['name'],0,7)) <> "attrib-")
+strtolower(substr($file['name'],0,4)) <> "sba-")
+strtolower(substr($file['name'],0,14)) == "pricebreaks-ep")
+*/
+
+$fileNameArray = array ("full-ep", "featured-ep", "attrib-basic-ep", "attrib-detailed-ep", "sba-detailed-ep", "categorymeta-ep", "attrib-", "sba-", "pricebreaks-ep");
+$discoveredFile = false;
+
+foreach ($fileNameArray as $key) {
+

• $length = strlen ($key);
• // probably better to do stristr but all the lines then need changing further down
• if (strtolower(substr($file['name'],0,$length)) == $key) {

•   $discoveredFile = true;
  

•   }
  

+}
+
+if ($discoveredFile == true) { // we'll proceed

$ep_update_count = 0; // product records updated 
$ep_import_count = 0; // new products records imported

@@ -1637,5 +1665,17 @@
} else {
$messageStack->add("File Import Completed.", 'success');
}
+}
+else {

• $display_output .= '<h3>Finished Processing Import File</h3>';
• $display_output .= '<br /><h3 style="color:red">Filename is wrong</h3> ';
• $display_output .= '<br />Please check that the filename <b>starts</b> with the correct term';
• $display_output .= '<br />The following are the permissible names :';
• foreach ($fileNameArray as $key) {

•   $display_output .= "<br />" . $key;
  

• }
• $messageStack->add("File Import Failed.", 'error');

+} // End file check loop
} // END FILE UPLOADS
-?>
\ No newline at end of file
+?>

And a small patch to easypopulate.php itself to clear a small warning that was annoying me :-)

--- easypopulate_4-orig.php 2015-06-17 19:03:42.000000000 +0200
+++ easypopulate_4.php 2015-06-18 14:47:28.000000000 +0200
@@ -28,9 +28,9 @@
$ep_music = (int)EASYPOPULATE_4_CONFIG_MUSIC_DATA; // 0-Disable, 1-Enable
$ep_uses_mysqli = (PROJECT_VERSION_MAJOR > '1' || PROJECT_VERSION_MINOR >= '5.3' ? true : false--- easypopulate_4-orig.php 2015-06-17 19:03:42.000000000 +0200
+++ easypopulate_4.php 2015-06-18 14:14:01.000000000 +0200
@@ -30,7 +30,7 @@

@set_time_limit($ep_execution); // executin limit in seconds. 300 = 5 minutes before timeout, 0 means no timelimit

-if (!$error) {
+if (!isset($error)) {
$upload_max_filesize=ini_get("upload_max_filesize");
if (preg_match("/([0-9]+)K/i",$upload_max_filesize,$tempregs)) $upload_max_filesize=$tempregs[1]*1024;
if (preg_match("/([0-9]+)M/i",$upload_max_filesize,$tempregs)) $upload_max_filesize=$tempregs[1]10241024;);

-@set_time_limit($ep_execution); // executin limit in seconds. 300 = 5 minutes before timeout, 0 means no timelimit
+@set_time_limit($ep_execution); // execution limit in seconds. 300 = 5 minutes before timeout, 0 means no timelimit

-if (!$error) {
+if (!isset($error)) {
$upload_max_filesize=ini_get("upload_max_filesize");
if (preg_match("/([0-9]+)K/i",$upload_max_filesize,$tempregs)) $upload_max_filesize=$tempregs[1]*1024;
if (preg_match("/([0-9]+)M/i",$upload_max_filesize,$tempregs)) $upload_max_filesize=$tempregs[1]10241024;

This entire week I've been trying to figure out how to provide comment to your code without running you away because these things don't get better without someone pointing out an issue. I have no control over your response and if it is to walk away or otherwise be upset, then so be it. Hopefully now you can look back at the suggestions of the last several posts, including the goal of being helpful to the newbie as well as not unnecessarily forcing existing users to make changes in how they operate and maybe see things a little differently.

In regards to the most recent post:

1. Wondered when you would figure that one out, and now 2) have added a restriction that didn't exist before and is truly unnecessary other than to suppport this error message. With that one single addition now all files must follow a specific naming convention not just the ones that require special/unique handling. I'll have my mod up in a bit, been trying to come up with decent terminology to display and maybe be acceptable to the eye. It doesn't restrict the ability to process files of any name, shows the naming convention expected to process that type of file, and provides the info on the first screen shot rather than after import "after the damage is done". The display of all file types on the first screen is switchable from all, to all in the designated directory to no help provided (ie, current view for those classic users :) ) with the default operation/install being all help. So those installing the update and wnting to not have this extra assistance will need to run a smidge of sql or store a constant somewhere to change the display of the min page away from the "full help".

Version 4.0.30 has been pushed to github: https://github.com/mc12345678/EasyPopulate-4.0/ If found to be acceptable will have it merged into the version presented at the first post of this thread.

Adds a new switch to the configuration menu. If this switch is not entered, set, or reset then the full new method of filename display will be provided which may be considered annoying by those that have become accustomed to using EP4 as it is and understand the need to name certain files a certain way as outlined in the instructions. (If so, I suggest installing the below SQL through the tools -> Install SQL patches option or by selecting the un-install/reinstall links on the EP4 page and the SQL will take care of itself. Though remember to note any special settings on the admin's configuration panel before uninstalling.)

Also, the generation of a warning has been corrected. Previous use of if (!$error) would result in execution if $error was not set, was = null, was = false, or any other non-true type result. Problem is that now in certain versions of PHP, if the variable hasn't been declared (not set), then a warning is thrown so, to maintain continued functionality and prevent those warnings, the statement has been changed to ```
if ((isset($error) && !$error) || !isset($error))

So that SQL if you want to be lazy and install the software but only incorporate the one additional change:

SELECT @config_id:=configuration_group_id FROM configuration_group where configuration_group_title= 'Easy Populate 4' and configuration_group_description = 'Configuration Options for Easy Populate 4';

INSERT INTO configuration (configuration_title, configuration_key, configuration_value, configuration_description, configuration_group_id, sort_order, last_modified, date_added, use_function, set_function) VALUES ('Show all EP4 Filetypes with Files', 'EP4_SHOW_ALL_FILETYPES', 'True', 'When looking at the EP4 Tools screen, should the filename prefix for all specific file types be displayed for all possible file types (True [default]), should only the method(s) that will be used to process the files present be displayed (False), or should there be no assistance be provided on filenaming on the main page (Hidden) like it was until this feature was added? (True, False, or Hidden)', @config_id , '25', NULL, now(), NULL, 'zen_cfg_select_option(array("True", "False", "Hidden"),');

I just had the module installed by my hosting company. I cannot download the Complete .csv file to edit (Attributes Not Included). I keep getting "WARNING: An Error occurred, please refresh the page and try again." even after I refresh the page.
I can download all the other files except this one (both the regular download and the temporary).

Thank you for any help or insight.

Did you ask them to fix it? I mean if they installed it for you they should do it correctly. Just a thought.

Linda

kpshira:

I just had the module installed by my hosting company. I cannot download the Complete .csv file to edit (Attributes Not Included). I keep getting "WARNING: An Error occurred, please refresh the page and try again." even after I refresh the page.
I can download all the other files except this one (both the regular download and the temporary).

Thank you for any help or insight.

While it helps to identify information contained in the posting tips, this first "step" can be offered without that information. If you have ZC 1.5.0 and below, check your cache directory, if ZC version 1.5.1 and above, check your logs directory for the most recent file starting with mydebug. This is likely an admin related log file, so if you could post the contents with your admin directory obscured, then perhaps the file(s) in question can be addressed. Could you also identify the version of EP4 that is being used as identified on the tools->Easy Populate v4 screen?

What suggested improvements are there for the new disply formats provided on the tools screen based on the version identified at this post: https://www.zen-cart.com/showthread.php?190417-EasyPopulate-4-0-Support-Thread&p=1285820#post1285820

I am running 1.5.4, this is the first mod installed on this configuration.

I installed this just fine on a client's site. Today, I installed it on mine (same hosts, etc.) and am getting a blank white page.
The error logs report ```
[07-Jul-2015 23:50:57 EST5EDT] [client 64.7.70.206 ] PHP Fatal error: Call to undefined function ep_4_chmod_check() in /big/dom/xwhatwouldwaltdo/www/.../easypopulate_4.php on line 74

The corresponding line is:
```php
73. // Pre-flight checks start here
74. $chmod_check = ep_4_chmod_check($tempdir);
75. if ($chmod_check == false) { // test for temporary folder and that it is writable
76. 	// $messageStack->add(EASYPOPULATE_4_MSGSTACK_INSTALL_CHMOD_FAIL, 'caution');
77. }

I already created the /temp directory within the Admin folder, I know that blew it up on my client's site.

I don't know what else to do to fix this. Any ideas?

Reupload the admin/includes/functions/extra_functions/easypopulate_4_functions.php file.

That is the file that should contan the function.

I just downloaded and installed EP4 and have to say install was easy and so far export and import is doing just fine. I had my reservations coming from Easy Populate after getting 'WARNING: An Error occurred, please refresh the...", then reading that someone with EP4 also had same issue. But took the dive and looking great!!

my ZC version is 1.5.4 with PHP Version: 5.5.26 (Zend: 2.5.0)

gcampos:

I just downloaded and installed EP4 and have to say install was easy and so far export and import is doing just fine. I had my reservations coming from Easy Populate after getting 'WARNING: An Error occurred, please refresh the...", then reading that someone with EP4 also had same issue. But took the dive and looking great!!

my ZC version is 1.5.4 with PHP Version: 5.5.26 (Zend: 2.5.0)

Glad that thngs are working for you. One thing seen about Easy Populate related posting is that the version reported by the poster is not always the version installed, unfortunately... Yes, though there have been those occassions where software had to be removed and reinstalled or because of incomplete/inaccurate ZC/plugin upgrades an issue with the cart was identified. Mind indicating which version of EP4 was installed? Version number is provided on the tools->Easy Populate 4 screen.

mc12345678:

Glad that thngs are working for you. One thing seen about Easy Populate related posting is that the version reported by the poster is not always the version installed, unfortunately... Yes, though there have been those occassions where software had to be removed and reinstalled or because of incomplete/inaccurate ZC/plugin upgrades an issue with the cart was identified. Mind indicating which version of EP4 was installed? Version number is provided on the tools->Easy Populate 4 screen.

Yes no problem it is: Easy Populate 4.0.28 - Beta 01-03-2015

Thanks

gcampos:

Yes no problem it is: Easy Populate 4.0.28 - Beta 01-03-2015

Thanks

Asked because I was a smidge confused about the post... Everything is working correctly thus far?

Ignore this one.

Blenderite:

Ignore this one.

Mind identifying what the issue was to all of those that received the first notification? :)

Otherwise, glad that the issue was resolved.

What is the best program to edit the CSV files? I am having troubles with OpenOffice. I tried Notepad++ but it got pretty confusing.