Posts Topics Forums Images
Search videos from message boards Videos Search messages from microblogs Microblogs Search messages from imdb.com Imdb Search messages from yuku.com Yuku Search messages from lefora.com (free forums) Lefora
My account: Login | Sign Up
Loading... 

Thread: Too many open files (over 1000 indexes)

Started 3 weeks, 5 days ago by Alysum
Hi, Ever since my searchd is serving over 1000 indexes (1041 to be precise), search does not work anymore. Using the search command returns nothing and the php API from my code returns a sphinx error "index NAME: failed to open XXXX.spd: Too many open files" Is there a limit of 1000 indexes with sphinx? If so where can I lift this limitation?
Site: Sphinx - Free open-source SQL full-text search engine  Sphinx - Free open-source SQL full-text search engine - site profile
Forum: Common forum  Common forum - forum profile
Total authors: 2 authors
Total thread posts: 8 posts
Thread activity: no new posts during last week
Domain info for: sphinxsearch.com

Other posts in this thread:

Alysum replied 3 weeks, 5 days ago
Correction: search command seems to work and it's only the sphinxapi.php that is throwing the error from GetLastError() after executing Query() from the API.

barryhunter replied 3 weeks, 5 days ago
'search' works by opening just the indexes it needs - so shouldnt have this issue (its for debugging only remember) whereas the api connects to deamon (searchd) running continouslly - better for speed. That deamon preopens all files Perhaps look at the preopen_indexes config option? (check you havnt changed from default) Otherwise you probably looking at partitioning up your data to...

Alysum replied 3 weeks, 5 days ago
thanks for your response. preopen_indexes in the searchd settings is on default 0 if I do an lsof on linux it shows ALL the indexes, why would they be showing up with preopen_indexes = 0 ? I strongly believe there is a max setting for indexes somewhere!

Alysum replied 3 weeks, 5 days ago
When I restart searchd it lists all indexes precached index INDEX_NAME. Is there a way to disable precaching?

Alysum replied 3 weeks, 5 days ago
Even if I put preopen = 0 for each index { } and preopen_indexes = 0 in indexer {} and I do an lsof; all indexes are still being open by searchd. It looks like those settings are not having any effect?

Alysum replied 3 weeks, 1 day ago
Hi - can anyone offer me some more advice? cheers

barryhunter replied 3 weeks ago
> Hi - can anyone offer me some more advice? cheers It's a bit outside my experience. But as say I would recommend looking at partitioning your data across multiple searchd instances...

 

Top contributing authors

Name
Posts
Alysum
6
user's latest post:
Too many open files (over 1000...
Published (2009-11-16 01:50:00)
Hi - can anyone offer me some more advice? cheers
barryhunter
2
user's latest post:
Too many open files (over 1000...
Published (2009-11-16 11:55:00)
> Hi - can anyone offer me some more advice? cheers It's a bit outside my experience. But as say I would recommend looking at partitioning your data across multiple searchd instances...

Related threads on "Sphinx - Free open-source SQL full-text search engine":

Related threads on other sites:

Thread profile page for "Too many open files (over 1000 indexes)" on http://sphinxsearch.com. This report page is a snippet summary view from a single thread "Too many open files (over 1000 indexes)", located on the Message Board at http://sphinxsearch.com. This thread profile page shows the thread statistics for: Total Authors, Total Thread Posts, and Thread Activity