[Module] Tidy - database clean up and optimization, data consistency fix

[Daresh]

Prestashop Tidy module will help you keep your store fast and clean. I've noticed that cleaning up millions of old stat rows can improve the performance and increase stability of prestashop.

The module allows you to perform the following operations:

Cleanup

• delete old abandoned carts
• delete old connections stats
• delete old search stats
• delete old email logs
• delete old logs
• delete old guests with no addresses
• delete old customers with no addresses (useful if your shop suffered from bots registering fake accounts)
• delete expired specific prices from products
• delete expired vouchers
• clear all cache

You can set number of days to only delete data older than this setting (but not for cache, it gets cleared totally).

Data consistency

• regenerate friendly URL’s for products (for all languages)
• regenerate friendly URL’s for categories
• set product's cheapest combination as default

Fix images

• delete products’ broken images (the ones that appear as question marks)
• delete unused image files (cleans all leftovers in the img/p/ folder along with empty folders)
• set first image as cover for products without cover
• set product’s cover as it’s first image
• delete temporary images

Fix associations

• set product’s deepest category as default
• assign all products to parent categories (usefull if some products are assigned only to some deep categories, but you want them to appear also in parent categories)
• assign all customer groups to all categories

Mass activation and deactivation

• deactivate active categories without active products
• deactivate active products not assigned to any active categories
• activate inactive categories with active products
• deactivate active manufacturers without active products
• activate inactive manufacturers with active products

You can also automate each of the above operations with cron tasks, making your shop clean itself on a daily basis.

[Click here to speed up and clean your shop - module's page on CodeCanyon]

Edited February 1, 2020 by Daresh (see edit history)

[Daresh]

I just added some new features to the module:

• delete broken images (the ones that appear as question marks)
• delete unused image files (cleans all leftovers in the img/p/ folder)

[goldies]

Just bought your module and it is working perfect with expired prices...

 

Best Regards

Igor

[Daresh]

Thanks!

[urisa1]

Hi, I read that it has implemented the ability to delete images that remained after the cancellation of the products in the famous img / p / folder. We realized that in the famous folder there are hundreds of unused empty numbered folders 0-9 which however increase the number of files / folders writing with the consequent increase in the use of inodes. Does your form also delete these folders in addition to the images left by mistake? Thank you.
(sorry for any errors but it has been translated by software)

[Daresh]

Currently it does not delete the folders, but it's a good idea for a future update.

[urisa1]

 

I assure you that this is a big problem, since infinite folders are created, like Chinese boxes that increase the number of inodes even after a total cancellation of products (as in our case, to start from scratch). If he does this update he will surely have a response in higher sales (we among the first). Anyway, thank you for your quick reply.

[Daresh]

And there you have it - I just updated the Tidy module to remove empty folders after it finished removing unused images.

So it should also remove empty folders even when there are no unused images, that's probably your case.

[urisa1]

Great!!! Well done. I proceed immediately with the purchase and put it to work. I hope the installation is simple.
Regards

[urisa1]

I purchased the form, but still receive nothing on the email. What to do??

[urisa1]

Module downloaded and installed, however it does not seem to delete all empty folders under the -img / p directory (with names: 1,2,3,4,5, .. etc.). I will do other tests !!
Regards

[Daresh]

Thanks for your feedback, the folders got deleted during my tests, but maybe there's something that needs to be added, what is your prestashop version?

And the module with that feature  should be v.1.3.8.

[urisa1]

Hello, the Prestashop version is 1.7.5.2 and your submitted form is 1.3.8. I also noticed that some unused photos that nestle in folders have not been deleted. I have some screenshots to send you. As you can see the famous folders 1,2,3, eccc which are 99% empty have not been deleted and in none of them (image 2) there are photos not deleted.

[Daresh]

I don't see any empty folders on your screenshots, I think I would need to get access to your shop in order to analyze it.

[urisa1]

By empty folders, I mean those numbered from 1 to 9, which internally have folders from 1 to nine and so on. It seems to me that these folders are created when I enter products and contain images, which are then not deleted with the deletion of the products themselves. Writing these folders and files makes me increase the number of inodes, which should decrease with their deletion, I think. There are no problems to analyze everything, tell me everything you need in the private email: [email protected]

[dandumit]

Hello ,

I have bought the module especially to clean up images.

Unfortunately there are issues with it :

- on calling "delete unused images" from button I get the error :

"Error: Maximum execution time of 30 seconds exceeded"

- on calling from cron url I get : 

Notice: Undefined offset: 1 in /home/asdasd/public_html/modules/gmtidy/gmtidy.php on line 596

Fatal error: Maximum execution time of 30 seconds exceeded in /home/asdasd/public_html/modules/gmtidy/gmtidy.php on line 558

 

if I try to call delete temporary files I get :

Warning on line 419 in file /home/asdasd/public_html/modules/gmtidy/gmtidy.php
[2] unlink(/home/asdasd/public_html/img/tmp//mp_temp_dir): Is a directory

 

thank you,

Daniel

[Daresh]

30 seconds is a very low script execution limit for a task like this.

Ask your admin to either increase this limit, launch the script by a CRON task (often has higher or no execution limits).

Also refer to the documentation, because the module is able to view only part of the img/p tree, for example you can only make it look for unused images in img/p/1 and all subfolders. And then img/p/2 and so on. Some customers even start deeper like img/p/1/1 img/p/1/2...

[dandumit]

HEllo DAresh,

Thank you for answering even sunday. I have tried to launch from url like a CRON but same timeout encounter. 

I think that this timeout -1 has to be set inside of script . ..

What should I do ?

Thank you,

Daniel

[Daresh]

Sometimes the server admin is able to launch the script not by an URL but by it's path on the server and have less limits, but it all depends if your server gives you SSH access.

Try to limit the tree the module is trying to view by adding a parameter to the URL: &sub=1 or any other subtree of the img/p folder.

If still not enough time, try with &sub=1/1 or even &sub=1/1/1

[ahs1478]

Is this modules still available? Where?

[Daresh]

Yes it is, you have links in the first post. 

[GrinGEO]

Dear Daresh

I just purchased your module. Is it possible to improve it so that the data that is deleted, can be displayed before cleanup? For example I cannot see wich customers will be deleted if I click on those withouth adress....

Also is there any way to cleanup newsletter registration? I have a lot of spam there that I would avoid to send any newsletter out

[Daresh]

I think making such a preview is a very good idea, something to consider for the next update of the module.

Regarding the newsletter - how do you distinguish spam from non-spam there?

[Daresh]

I just updated the module with the preview function. So now it's much safer to perform each of the tasks

[azurtem]

Hi

How does your module differ from the "PrestaShop Cleaner" native module ?

regards
yann

[Daresh]

Hi,

it differs a lot. The native module is like a nuclear bomb, it deletes all the data. My module looks for and cleans excessive, unnecessary or old data. And it has a few times more features.

[azurtem]

thanks for your swift response

How does it determine whether a cart is in use or not ? e.g. my quote module adds a cart entry to store the products included in a quote

 

 

Edited January 12, 2022 by azurtem (see edit history)

[azurtem]

Really appreciate the "preview" option : better safe than sorry

[Daresh]

And thanks for purchasing the module, hope it will keep your store nice and fast

[Guest]

On 1/12/2022 at 7:33 AM, azurtem said:

thanks for your swift response

How does it determine whether a cart is in use or not ? e.g. my quote module adds a cart entry to store the products included in a quote

 

 

I use the Settings > Interval Days. I set this to 60 so when I clean the carts it only deletes carts older than 60 days. You could set it for however long your quotes are valid

[gray]

Does this delete/remove sample data ??

[Daresh]

No it does not, it's rather for shops working a longer time that were able to gather some junk on the way. To clear the sample data the free pscleaner module should be enough.