Alternate search backend with sphinx fulltext search

yes you're right ! ;)

Just for info if anyone is considering this approach - here are the timings for a typical full index and delta index using the query range approach outlined above, phorum remains fully useable during indexing.

full:

Sphinx 0.9.7
Copyright (c) 2001-2007, Andrew Aksyonoff

using config file '/usr/local/sphinx/etc/sphinx.conf'...
indexing index 'phorum5_msg'...
collected 2403273 docs, 611.6 MB
sorted 113.2 Mhits, 100.0% done
total 2403273 docs, 611604677 bytes
total 924.310 sec, 661687.57 bytes/sec, 2600.07 docs/sec
indexing index 'phorum5_author'...
collected 2403278 docs, 23.4 MB
sorted 3.7 Mhits, 100.0% done
total 2403278 docs, 23395410 bytes
total 663.704 sec, 35249.78 bytes/sec, 3621.01 docs/sec
rotating indices: succesfully sent SIGHUP to searchd (pid=16152).

delta:

Sphinx 0.9.7
Copyright (c) 2001-2007, Andrew Aksyonoff

using config file '/usr/local/sphinx/etc/sphinx.conf'...
indexing index 'phorum5_msg_d'...
collected 2533 docs, 0.6 MB
sorted 0.1 Mhits, 100.0% done
total 2533 docs, 578897 bytes
total 0.338 sec, 1713914.73 bytes/sec, 7499.34 docs/sec
indexing index 'phorum5_author_delta'...
collected 2533 docs, 0.0 MB
sorted 0.0 Mhits, 100.0% done
total 2533 docs, 23526 bytes
total 0.028 sec, 830632.61 bytes/sec, 89432.65 docs/sec
rotating indices: succesfully sent SIGHUP to searchd (pid=16152).

These are from a dual-processor, dual-core woodcrest server with 4Gb RAM running MySQL 5.0.24

Jon

So I'm trying to implement this mod. I've made good progress to start, but I'm stuck with the initial indexing.

First error is:
ERROR: index 'phorum5_base': no valid sources configured; skipping.

The second error is:
ERROR: sql_query: Table 'tkbloggers.p50_000001_messages' doesn't exist (DSN=mysql://root:***@10.10.10.99:3306/tkbloggers).


I'm running 5.1.16a. I created the sph_counter table too. It does appear to successfully index phorum5_msg and phorum5_msg_d

I'm thinking my phorum installation is incomplete? We've been running it successfully for about 4 years now. I just wanted to implement a better search engine.



Edited 1 time(s). Last edit at 09/02/2007 11:33PM by polarstar.

ERROR: index 'phorum5_base': no valid sources configured; skipping.

Thats no problem as it just skipped the base index.

ERROR: sql_query: Table 'tkbloggers.p50_000001_messages' doesn't exist

Your table is named differently. Fix the data-sources!

---

Thomas Seifert

Ah!

Okay, I've just gone through the list of tables in the database and I can't find a table with those fields as listed in the conf file (other than phorum_messages).

I'm thinking this a temporary table?

phorum_messages is the right one and not p50_000001_messages.

---

Thomas Seifert

Got it! I let you know how it works out.

Hi,

I have problems with sphinx 1.0 and Phorum 5.2 for author search.
In old phorums the match_type was AUTHOR. Now it's USER_ID.

Search now returns results, but it returns a bunch of messages from any user
there is. Any known problems on this?

Regards, Zdravko

yeah, the problem is that this module was made for phorum-5.1.

---

Thomas Seifert

i just wanted to note that in some other thread i posted that there's update to the code used here:

[www.phorum.org]