28 replies to this topic

[mikesound]

have tested but am not 100% sure yet
but does seems at first look that the archives are not included in the default forum search (sphinx)

you have to go to advanced search and then tick archive option

if the above is right then can i ask why has it been done this way

if there are separate searches for forum and archive then for my own uses this makes the whole archive feature unusable

please someone tell me that I am wong

[mikesound]

mmmm seems above is right

sphinx can search multiple indexes and so in theory could have a complete all in one forum/archive search, yes?
(and so in theory could have a complete site wide search)
but would guess there's no plans for this, or at least in the near future

so it looks like one of the major improvements is going to be unusable for anyone who needs to offer a decent search service that can search every past forum post with no fuss


all a bit disappointing really
do have to wonder yet again about invision logic when it comes to features like this

I mean why archive posts if the only way members can then find them is by then using the advanced search ?
how many casual members are going to be aware of that requirement when using the top search or indeed if even aware are then going to bother searching and viewing two sets of results ?

still have slight hope that have got this wrong and am missing something

[Rimi]

I would assume it's because the archived posts are moved to a different table (kind of the point) and that searching in multiple tables at once is a no no.

[mikesound]

I would assume it's because the archived posts are moved to a different table (kind of the point) and that searching in multiple tables at once is a no no.

sphinx apparently can search multiple indexes/tables

http://sphinxsearch....ew.html?id=6575



would think that chances are the ones who may have a lot of posts to archive may use sphinx

Edited by mikesound, 25 March 2012 - 11:18 AM.

[Charles]

The point of the archive system is to take stress of your database by moving posts to a table that will be rarely queried. If every search was auto-queried to the archive table that sort of defeats the purpose

[mikesound]

The point of the archive system is to take stress of your database by moving posts to a table that will be rarely queried. If every search was auto-queried to the archive table that sort of defeats the purpose

removing large amounts of posts from the default search should not be the answer

do you seriously think people are going to do one search, browse the results and then find the advanced link and do another search and browse results all off their own back

would that work on this board ? are you going to archive posts on here then?
try it and see how it goes am sure having to double search in such an akward manner will go down a treat

the disapointing thing is that the basic sphinx setup to give the option to search two or one different tables is fairly easy to implement
in fact it could be said it is easier as there would be less duplication of code and you could still offer search 1 or 2 option

would it have hurt to think a bit about this before giving such an dismissive answer to my feedback

invision it seems has either missed or dropped the whole sphinx search more than one index aspect and by doing so have imo made a useful feature useless to anyone who runs a site that gets searched a lot for info/research etc

[bfarber]

Please keep in mind that sphinx is a secondary search method, so sometimes it can do more than we take advantage of.

This is something we can keep in mind for future versions in any event.

[mikesound]

Please keep in mind that sphinx is a secondary search method, so sometimes it can do more than we take advantage of.

This is something we can keep in mind for future versions in any event.

thanks for reply
fair enough, I think at times my requirements from the software must be a bit different than the out of the box solution
hence the frustration creeping in when that difference comes up
guess way to look at archive for myself is for content that doesn't require being made available for searching

[Charles]

If you want full functionality of topics then you should not archive them.

The archive system is designed as a sort of "deep freeze" for topics so normal day-to-day operations like search, reply, moderation actions, etc. are not available.

[h2ojunkie]

Being a forum admin of a 10,000,000 post site. The archive in theory is a great idea.

However, I have to agree with mikesound on this one.

The entire reason big sites run things like sphinx is to keep searching of a large database fast.

There is really no reason I can see to not take advantage of the power of sphinx and the archive feature together.

Sphinx can eaisly handle a single result across both the live and archive tables. I can't speak to using mysql full text search (since I stopped using that 9 million posts ago). But for a sphinx search setup, it should absolutly search the archive and live posts at the same time. There's just no downside to doing it that way.

[TSP]

If you want full functionality of topics then you should not archive them.

The archive system is designed as a sort of "deep freeze" for topics so normal day-to-day operations like search, reply, moderation actions, etc. are not available.

But Sphinx is not using a connection to the DB when searching, is it? I thought it made it's own indexes and copies of the post?

We're not using sphinx, but a custom made search that are using the Solr-engine. We export posts from the database to Solr for indexing and when searching it's only looked up to the information Solr have gathered. No DB-queries are used in the actual search. I would expect it to be similar for your built-in sphinx option?

As mentioned in the post above I can't see any harm in including the archive as part of the search results when using Sphinx. If you're having so many posts that you need to archive them, I wouldn't expect them to still be using the mysql full text search in the first place.

There is really no reason I can see to not take advantage of the power of sphinx and the archive feature together.

Indeed.

[Wolfie]

What about a system setting along with a front end option? System setting would toggle the front end feature to be available or not (and if on, minimum access required to use it.. guest, registered member, moderator, global moderator, admin) and that front end feature (when enabled) would let a member know that the search results don't include the archived content, with a link to do the same search but in the archived posts.

Would let the powers-that-be have the ability to do searches themselves while not letting regular members use it (save resources) or might just not let guests use it, or whatever else.

[bfarber]

Part of the problem is that there is almost no way to do this with built in MySQL search. While we could do it with Sphinx (because Sphinx can support multiple index searches), there is then a feature-set discrepancy between using sphinx and not using sphinx, which we try to minimize.

We will be taking a very hard look at the search system as a whole as we move to the Community Suite, and will consider specific improvements in closer detail then.

[mikesound]

Part of the problem is that there is almost no way to do this with built in MySQL search. While we could do it with Sphinx (because Sphinx can support multiple index searches), there is then a feature-set discrepancy between using sphinx and not using sphinx, which we try to minimize.

We will be taking a very hard look at the search system as a whole as we move to the Community Suite, and will consider specific improvements in closer detail then.

think said it before

my suggestion is to drop sphinx from the invision core

change it to a module that can be installed by those who wish to use it

back when sphinx was a stand alone module it was easy to modify/adapt
i had full site search with drupal intergrated before ipcontent

a seperate application would allow easier development and better features (all in one site search etc)
with sphinx

[Rimi]

you have to go to advanced search and then tick archive option

I don't see it anymore. >_>;

[Marcher Technologies]

think said it before

my suggestion is to drop sphinx from the invision core

change it to a module that can be installed by those who wish to use it

back when sphinx was a stand alone module it was easy to modify/adapt
i had full site search with drupal intergrated before ipcontent

a separate application would allow easier development and better features (all in one site search etc)
with sphinx

A separate application would mean less compatibility across not only the Suite, but any third-party application's supporting sphinx, sorry, cannot agree.

[Dmacleo]

one reason I went with IP was due to advertised compatibility with sphinx, needed the 2 letter and wildcard searches.

[mikesound]

A separate application would mean less compatibility across not only the Suite, but any third-party application's supporting sphinx, sorry, cannot agree.

sphinx has been slowly phased out - its just been dropped from the gallery
new content needs to be mysql if you wish instant listings
downloads next ?

soon could end up with it just being used for the forum search

if was an application third parties could just plug in to it

i would say with arguably less coding/dev than takes now

[Dmacleo]

just noticed it does not work on gallery now.
dammit.
maybe time to dump gallery.

[Marcher Technologies]

sphinx has been slowly phased out - its just been dropped from the gallery
new content needs to be mysql if you wish instant listings
downloads next ?

soon could end up with it just being used for the forum search

if was an application third parties could just plug in to it

i would say with arguably less coding/dev than takes now

It was dropped over a year ago(Gallery 4), and that is nothing new, and it *has* to be abstracted by application in the core, a 'global' site search is infeasible, what good is searching on downloads custom fields through forums indexes? None, it is an utterly wasteful act and you know it.