Release date: May 30, 2016
Build up with Sphider: v.1.3.5
New feature:
- Index only e-mail accounts like 'my-name@gmail.com' :
(Will extract all e-mail accounts from page content).
And as inverse function:
- Do not index any e-mail account as part of page content.
Both to be enabled in admin backend.
New feature:
Block all queries sent by known spammer IPs.
The IPs will automatically be updated every 24 hours, containing about 190.000 URLs.
To be activated in admin backend.
Improved index procedure:
No longer aborting the complete indexation for 'NOHOST' and 'Too many re-directions'.
If detected on single links (pages), only the involved links will be bypassed.
Improved index and search procedures:
Convert all kind of accents and diacritics like á, ç, ê, ì, ü, into their basic vowels
Will present the same results for queries with and without accents.
Improved index and search procedures:
Now removing all emoji characters (smileys) from full text,
so that systems still using MySQL versions older than 5.5.3
will be able to highlight search results correctly.
Corrected Apache glitch which causes a %252F instead of %2F in URLs. Instead of using the Apache rewrite module and NE flag, a PHP solution was implemented. So, those links will not break during index procedure.
Improved error report for false function of PDF converter during index procedure.
Updated bot and harvester list (black IPs) to prevent unwanted queries.
Bug fixed: More than 3 redirections applied to one page URL forced the index procedure to abort.
Bug fixed in highlighting Urdu language text.
Bug fixed in authentication script for first call.
Some small bugs fixed.
Involved files that have been modified / added for this release:
.../admin/admin.php
.../admin/admin_search.php
.../admin/auth.php
.../admin/configset.php
.../admin/db_copy.php
.../admin/db_main.php
.../admin/messages.php
.../admin/spider.php
.../admin/spiderfuncs.php
.../admin/url_backup.php
.../admin/settings/backup/Sphider-plus_default-configuration.php
.../include/commonfuncs.php
.../include/commons.php
.../include/search_10.php
.../include/search_40.php
.../include/search_media.php
.../include/searchfuncs.php
.../include/suggest.php
.../include/common/black_ips_priv.txt
.../templates/html/020_search-form.html
.../templates/html/025_search-form.html
.../templates/html/080_most_pop.html