I currently use Sphinx Search for alot of website on my web server, and have about 30-40 different indexes. As you can imagine this can make for a very long sphinx config file.
(40 lines per index) X (30 indexes) = 1200 lines - alot to have in one file.
I learnt this nifty trick from the sphinx search forum. You can use any command line scripting language (BASH,PHP,etc) and then include config files from another directory.
I use a global MySQL account (all databases, SELECT priveleges) this way if I change any database passwords, I can change it in one place.
#!/usr/bin/php ## data source definition source root { type = mysql # some straightforward parameters for SQL source types sql_host = 127.0.0.1 sql_user = MySQLUSER sql_pass = MySQLPASS sql_port = 3306 # optional, default is 3306 } <?php $files = scandir("/usr/local/etc/sphinx_confs/"); foreach($files as $key => $value){ if($value != "." && $value != ".." ) { include("sphinx_confs/$value"); } } ?> ## indexer settings indexer { mem_limit = 256M } ## searchd settings searchd { port = 9816 log = /var/log/searchd.log query_log = /var/log/search_query.log read_timeout = 5 max_children = 30 pid_file = /var/log/searchd.pid max_matches = 1000 seamless_rotate = 1 preopen_indexes = 1 unlink_old = 1 }
This will setup your root "source" item, and also your indexer and searchd settings
Inside my individual site files (in sphinx_confs/) is:
source site1_src : root { sql_db = idorset_co_uk_bigdaddy sql_query = \ SELECT id, keywords, attr FROM table sql_attr_uint = attr } index site1 { source = site1_src path = /var/sphinx_data/ifind_town docinfo = extern mlock = 0 morphology = none min_word_len = 2 charset_type = sbcs html_strip = 0 }
This will then be included into the main conf (on a search / index).
posted by Mark Willis
where do you assign a value to $value?!
Thanks Paolo. I’ve just updated the post – seems that the code got cut out when I posted it up.
< ?php
$files = scandir("/usr/local/etc/sphinx_confs/");
foreach($files as $key => $value){
if($value != "." && $value != ".." ) {
include("sphinx_confs/$value");
}
}
?>
after you scan the directory you want to use for configs $value holds the filename (and we ignore . and ..)
Thanks to you for the fast reply.
you do this in the sphinx.conf.dist directly?? this file suport php?? thx
adding:
#!/usr/bin/php
as the very top of the config will make it look for the php exec when the config is loaded. So you could use any type of parser (perl, ruby etc maybe?)
Mark
too much thx
)