recoll fails to create index

This forum is dedicated to basic help and support :

Ask here your questions about basic installation and usage of Mageia. For example you may post here all your questions about getting Mageia isos and installing it, configuring your printer, using your word processor etc.

Try to ask your questions in the right sub-forum with as much details as you can gather. the more precise the question will be, the more likely you are to get a useful answer

recoll fails to create index

Postby drachenchen » Dec 7th, '13, 21:32

Hello. First post here. I'm running Mageia 3 with KDE 4, and added the local search program recoll from the package manager, and also the package kio-recoll so that I could access it from Konq and Dolphin. When I try to create an index, it gives me an error at the GUI: "Indexing failed." No queries are possible; no errors, but no results, either.

I have already tried deleting the xapiandb, as per the recoll manual, and found one post of a similar problem with recoll on another distro. There, the issue was a missing perl library dependency. Then, I found that mlocate had not been installed, and installed it, ran updatedb as root. Added in other programs / libraries that looked like they might assist in indexing.

No use. When I start recoll from a root terminal, I get a vanilla GUI window of it, but if I even try to set any parameters for the indexing, I get the following errors:

A GUI window pops up, saying: "Could not start process. Cannot talk to klauncher: Not connected to D-Bus server."

The terminal is far more verbose, but I've copied this excerpt:

KGlobal::locale(): Warning your global KLocale is being recreated with a valid main component instead of a fake component, this usually means you tried to call i18n related functions before your main component was created. You should not do that since it most likely will not work
klauncher(27484) kdemain: No DBUS session-bus found. Check if you have started the DBUS server.

The last line was repeated several times with different numbers in paranthesis.

I honestly don't get it. Are there dependencies missing? I'm used to Debian-family distros, and finding dependencies was a strength of Synaptic's UI. Can't find them in the Mageia package manager. A "view dependencies" entry in one of the menus would be helpful.

Fake component? :?: i18n-related functions? It's well over my head. Can anyone explain simply what's going on here? Thank you!

Addition: Tried using recollindex command from a root terminal, as per the recoll manual, and CPU load went up a bit and stayed there for several minutes. I thought maybe it was actually indexing, buth then I got the following:

recollindex
Illegal instruction
[root@localhost drach]# recollindex
:3:recollindex.cpp:371:recollindex: starting up
Illegal instruction

Time to walk away from the computer for a bit. :x
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 7th, '13, 22:00

At first, why not use the builtin Strigi indexer/search? Or kfind which is still accessible in dolphin/konqueror via Ctrl+F ?

For recoll itself, first ignore the errors your got when running as root. Mostly those come from the fact that only "su" was
used to switch to root, but "su -" is required for almost all graphical programs to run as root.
There should be no dependencies missing, only if the packager forgot some. If it's installed, all dependencies should be there.

You could try to run the indexer from the commandline, it's called
Code: Select all
recollindex

and/or take a look at the log and see if there's something interesting: https://bitbucket.org/medoc/recoll/wiki ... dexed.wiki

Also check the two pitfalls mentioned at http://askubuntu.com/a/301656
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby drachenchen » Dec 8th, '13, 04:34

Hello. Thank you for getting back to me so quickly, Doctor5000.

First, one of those links you sent explains what I mentioned in the OP, that missing helpers may be the problem. Unfortunately, the names given were for perl packages in Debian, and I can't find packages by that name in Rpmdrake. Not being a perl developer, I have no idea if any equivalent packages by different names are available.

In the recoll GUI, under File > Show Missing Helpers, I get a small window that claims there are no missing helpers, although one of those links you sent mentions that Show Missing Helpers only catches the first good helper in what may be a string of absent or failing helpers. So that check is of limited use.

I was unaware of Strigi, and it wasn't actually built-in to my install, but available from Rpmdrake. I installed every part and plugin I found for it including the GUI, only left out the development package, and I can't find it anywhere in the App Launcher menu. Maybe it's there waiting, but it's also invisible. Where might I find it lurking, please?

As for Kfind, I tried bringing it up, despite many failures with it in the past. No good. My CPU goes to 100% for several seconds, then I get the messages "idle" and "0 files found". No results, just like always. (Angry rant about Kfind available on request) Kfind just beats me, over and over... I'm starting to not like it so much.

The only reason I tried installing recoll is that at least on a friend's Arch install, and on my old Debian install, it just worked, blazingly fast, with little system load and no drama. I am unfamiliar with KDE4, have the aforementioned issues with Kfind, and am unaware if there is a KDE equivalent of recoll that will just work with no problems. I am beginning to think that recoll mixed with KDE may not be such a great idea. If I can find Strigi, I'll give that an honest try-out.

The only other thing that occurs to me is that it might be the age of this computer, but the Debian box is of nearly identical age, and runs recoll fine. I may sleep on this and try again tomorrow. Anyway, thanks for the input! :)
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 8th, '13, 12:48

Strigi is now integrated with Nepomuk, you can find the settings for it under systemsettings -> Desktop search and there's a plasma applet for it. Otherwise just use the integrated search in dolphin/krusader, it will use the Nepomuk metadata.

For the rest, i'll take a further look this afternoon, can only say that recoll indexes fine here. Did you take a look in the recoll logs? You may have to set the location/file for the log in recoll settings beforehand.
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby doktor5000 » Dec 8th, '13, 18:47

drachenchen wrote:First, one of those links you sent explains what I mentioned in the OP, that missing helpers may be the problem. Unfortunately, the names given were for perl packages in Debian, and I can't find packages by that name in Rpmdrake. Not being a perl developer, I have no idea if any equivalent packages by different names are available.

In the recoll GUI, under File > Show Missing Helpers, I get a small window that claims there are no missing helpers, although one of those links you sent mentions that Show Missing Helpers only catches the first good helper in what may be a string of absent or failing helpers. So that check is of limited use.

Well yes and no, it only shows the results after last successful indexing, for the helpers that were missing.
Here it showed those as missing (only indexed my /home folder)

Code: Select all
antiword (application/msword application/vnd.ms-office)
catppt (application/vnd.ms-powerpoint)
lyx (application/x-lyx)
pdftotext (application/pdf)
pstotext (application/postscript)
python:rarfile (application/x-rar)
unrtf (text/rtf)
xls2csv (application/vnd.ms-excel)


You can easily search in which package those commands are contained with urpmf: https://wiki.mageia.org/en/URPMI#urpmf
I've installed those packages: antiword lyx catdoc poppler unrtf the rest (pstotext and python:rarfile) seems not available from Mageia repositories.

drachenchen wrote:I was unaware of Strigi, and it wasn't actually built-in to my install, but available from Rpmdrake. I installed every part and plugin I found for it including the GUI, only left out the development package, and I can't find it anywhere in the App Launcher menu. Maybe it's there waiting, but it's also invisible. Where might I find it lurking, please?


As mentioned, the functionality has been merged into Nepomuk, so please have a look here: http://userbase.kde.org/Nepomuk
AFAICS there's no standalone plasmoid for that functionality, either you use it from krunner or within dolphin/konqueror.

drachenchen wrote:As for Kfind, I tried bringing it up, despite many failures with it in the past. No good. My CPU goes to 100% for several seconds, then I get the messages "idle" and "0 files found". No results, just like always. (Angry rant about Kfind available on request) Kfind just beats me, over and over... I'm starting to not like it so much.

Hmmm, well actually it never failed me. I'm not using indexing (Strigi/Nepomuk, see above), just using it to search ad-hoc. But as you mentioned it, Ctrl+F does not bring up kfind, kfind is standalone and integrated to dolphin/konqueror anymore. Seems I've mistaken one for another :) But both are working fine here, in kfind you just need to remember to best use asterisk before and behind your search term, so if you search for "foo" use *foo*. And make sure the box "Include subfolders" is enabled.

drachenchen wrote:The only reason I tried installing recoll is that at least on a friend's Arch install, and on my old Debian install, it just worked, blazingly fast, with little system load and no drama.

Well, compare them and use what works best for you. The indexing will always take quite some time, whatever search tool you use. And afterwards, searching the index is blazingly fast, and doesn't consume much ressources. But it also depends on how you search. I've never seen the use for such tools. I'm using a combination of locate (systemwide search for filenames) or grep -R when searching recursively for some search term inside files, and ocassionally Ctrl-F functionality in dolphin.
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby drachenchen » Dec 10th, '13, 19:54

Thanks for getting back to me again, Doctor5000. Haven't had much time to look at this in the last few days, hopefully will start collecting all the dependencies today, and try again.

Tried using Nepomuk from Dolphin, and no luck. Every type of search gave me the error: "Could not start process. Unable to create io-slave: klauncher said; Error loading 'kio_nepomuksearch'." So, no better than the default install of recoll, here in Mageia. Will look into the log location/settings. Cannot find system_settings > Desktop_search, so I do not know if Strigi is showing up there (-it is installed, though). Perhaps we are running different versions of the UI? I'm using Mageia 3, and KDE 4.10. If I can get recoll working, I may remove nepomuk/strigi, as I've read that it can be quite a hit on system resources, and not just when it is running a user's search. :)

Concerning the missing recoll helpers, that list you included has "code: select all" at the top. Was that from running recoll in terminal? Is "select all" the proper command to get the complete list of missing depends? I've already installed the ones you mentioned, plus aspell, which it complained about not having when I tried to start from terminal. Still won't index.

Tried using URPMF, and got odd-looking output: looks like something in local files, but there's nothing there. Example:
$MIRRORLIST: media/core/release/media_info/20130521-174810-files.xml.lzma
-Plus three other entries like it. Checked the squashfs image on the installation DVD, too. Nothing there. /media is empty.

Actually, one good reason to use recoll, for me, is because it supports search for short strings of text, without having to know the file name already. I have a lot of files that I've written over the years, and I don't always remember the titles I may have hung on them, exactly word-for-word. When my friend first showed me recoll, that was the thing that caught my eye about it. It really is like a local search engine. Also, it would seem to be a proper GUI tool. I can, and will, use CLI, but I hope to find a totally-GUI Linux. One I could recommend without reservations to Windows users looking for a way out. I yet have hopes for Mageia; I generally like it.

I'll try tracking down the other depends and manually installing tonight after work. Thanks! :)
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 10th, '13, 20:48

drachenchen wrote:Tried using Nepomuk from Dolphin, and no luck. Every type of search gave me the error: "Could not start process. Unable to create io-slave: klauncher said; Error loading 'kio_nepomuksearch'." So, no better than the default install of recoll, here in Mageia. Will look into the log location/settings. Cannot find system_settings > Desktop_search, so I do not know if Strigi is showing up there (-it is installed, though). Perhaps we are running different versions of the UI? I'm using Mageia 3, and KDE 4.10.

Maybe your KDE installation is not complete. You may need to install task-kde4 to get a complete one, especially when you installed from one of the KDE Live media.
I'm also using Mageia 3 and KDE (4.10).

drachenchen wrote:Concerning the missing recoll helpers, that list you included has "code: select all" at the top. Was that from running recoll in terminal? Is "select all" the proper command to get the complete list of missing depends? I've already installed the ones you mentioned, plus aspell, which it complained about not having when I tried to start from terminal. Still won't index.

Nope, that "code: select all" comes from using code tags in forum editor, and has nothing to do with recoll or Linux.
Usage is explained in ftp://ftp5.gwdg.de/pub/linux/mandriva/m ... e_tags.ogv

drachenchen wrote:Tried using URPMF, and got odd-looking output: looks like something in local files, but there's nothing there. Example:
$MIRRORLIST: media/core/release/media_info/20130521-174810-files.xml.lzma
-Plus three other entries like it. Checked the squashfs image on the installation DVD, too. Nothing there. /media is empty.

Well, it will download the hdlists, that is what you saw, but it should also show some results. As you didn't post the urpmf command you used, cannot help much more.
But you should maybe check your repositories and read up a bit on https://wiki.mageia.org/en/Software_management or maybe https://wiki.mageia.org/en/Install_and_ ... r_beginner.
Not sure what you mean by /media is empty.

drachenchen wrote:Actually, one good reason to use recoll, for me, is because it supports search for short strings of text, without having to know the file name already. I have a lot of files that I've written over the years, and I don't always remember the titles I may have hung on them, exactly word-for-word. When my friend first showed me recoll, that was the thing that caught my eye about it. It really is like a local search engine. Also, it would seem to be a proper GUI tool. I can, and will, use CLI, but I hope to find a totally-GUI Linux. One I could recommend without reservations to Windows users looking for a way out. I yet have hopes for Mageia; I generally like it.

I'll try tracking down the other depends and manually installing tonight after work. Thanks! :)

If you still encounter issues with recoll, best ask the author directly for help with troubleshooting, as it works here.

I can only repeat that you should take a look in the log after setting a logfile and raising the loglevel as mentioned in https://bitbucket.org/medoc/recoll/wiki ... dexed.wiki
Also have a look at https://bitbucket.org/medoc/recoll/wiki ... olvingData
New bug can be reported via https://bitbucket.org/medoc/recoll/issues/new

FWIW you haven't run recollindex manually as normal user yet - normally that should show why recoll is not able to index, as shown in the aforementioned links ...
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby medoc » Dec 10th, '13, 23:40

Hi,

Recoll author here. The advice from doktor5000 is perfectly good. Just for a little precision: recollindex will not generate an indexing error just because some helpers are missing. The only consequence would be that some files would not be indexed, but the indexer would report success (and some missing helpers). So you can abandon the helpers quest for now.

I think that the key point is the "illegal instruction" message. Do you have an oldish computer by any chance ? I think that the Xapian build enables sse2 instructions by default, and this would provoke this kind of error message on an older CPU (and a crash). If this is the case, the only possible solution would be to build from source (except if mageia builds alternate packages with sse2 disabled).

Cheers,

jf
medoc
 
Posts: 1
Joined: Dec 10th, '13, 23:30

Re: recoll fails to create index

Postby drachenchen » Dec 11th, '13, 11:22

Hello, Doctor5000 and Recoll author medoc!

I was so excited, because I thought I'd figured it out. I had just found this tidbit on the download page for the previous version of Recoll, 1.18:

" Note on building Xapian for older CPUs: The build configurations for Xapian releases 1.0.21 and 1.2.1 or newer enable the use of SSE2 floating point instructions. These instructions are not available in CPUs older than Intel Pentium 4 or AMD Athlon 64. When building for such a CPU, you need to add the --disable-sse flag to the Xapian library configure command. If this is not done, the problem signals itself by "Illegal instruction" crashes (SIGILL) in recollindex and recoll."

-And yes, that's exactly what happened, and medoc, you were so polite to ask if I had an "oldish" computer. In computer years, it's an antique. It probably shouldn't still be doing useful work, but it does. No part of it is more recent than 2003, stretching back to a video card from 1996. And no, the CPU can't understand these newfangled SSE2 floating point instructions, which I knew already, because it won't support FlashPlayer plugins after 11.2, either. I think of this box as being the cyber-undead.

It just hadn't occurred to me that the same antique CPU problem would pop up again with another program. :oops: It seemed so obscure when I found out about it while trying to get the flashplugin to work. Now that I know that Xapian wants SSE2, also, I'll just have to build Recoll / Xapian, and I might as well add it to the old Debian box, too, since they only have 1.13 in Squeeze Stable repos. It works, mind you, like pretty much anything in any Deb Stable, but I _need_ the spreadsheet view, and the 1.13 version hasn't got it.

medoc, my local Linux guru showed me what the latest Recoll can do, and I want it. This tool is too cool! It's just right to fill in that big empty spot in the fractal geometry of file handling in Linux. There are those pie-chart disk tools like Filelight, that are like satellite images, and then there are things like CLI tools and Krusader for pushing things around on the ground, but then Recoll is more like having your own air force. My Linux guru and I agreed, that we have both been _wishing_ for a tool like this, for years. THANKS FOR BUILDING IT! :D

Doctor5000, thanks for being so patient with me. I'm doubly embarrassed here, as I realize now that I broke one of my own rules for computer troubleshooting; check for hardware problems FIRST. I really need to learn that. -And maybe, since it's such an old computer, I should RTPM (read the previous manual), also. :oops:

As soon as I get the build done, I'll mark this SOLVED. It just may be a few days; mundane life and all that.
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 11th, '13, 16:06

You're using i586 arch on that older machine?
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby drachenchen » Dec 11th, '13, 22:01

Yes. -On two machines, actually, as the Debian box is a straight Squeeze Stable install. Why do you ask? Are you going to tell me to build the entire system from source? I've done programs and drivers before, but never an entire system.

I was going to check for hardware specs, but the command I'm used to in Debian-family distros, lshw, appears to be absent. As I recall, the CPU here is a roughly 1.7GHz single-core, Intel. The Debian box is a similar AMD. I believe they are Pentium 4, and the equivalent for AMD. I ran vanilla Ubuntu (before they wrecked it with Unity) for years on both boxes, and didn't have any major issues until these SSE-2 problems.

I'm also running a standard install of Bodhi on another partition, and have no problems that aren't directly related to E-17 :) Anyway, I'm curious to know what you're thinking. Thanks!
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 11th, '13, 22:18

No, was just asking because I've done a rebuild of xapian for i586 with --disable-sse which you might try out on your Mageia 3 box ;)
For Debian, you have to do that on your own :)

drachenchen wrote:I was going to check for hardware specs, but the command I'm used to in Debian-family distros, lshw, appears to be absent. As I recall, the CPU here is a roughly 1.7GHz single-core, Intel. The Debian box is a similar AMD. I believe they are Pentium 4, and the equivalent for AMD. I ran vanilla Ubuntu (before they wrecked it with Unity) for years on both boxes, and didn't have any major issues until these SSE-2 problems.

You may need to install lshw if you want to use it.
Another easier check would be
Code: Select all
grep sse2 /proc/cpuinfo
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby drachenchen » Dec 12th, '13, 10:33

Interesting. I tried running your code above in terminal, as user and root, on the Debian box (where I'm writing from). I get nothing. If instead I do: grep ^flags /proc/cpuinfo , then I get a list of the flags, and it only shows SSE, not SSE-2. Will try it on the Mageia box tomorrow; I'm curious to see how both commands work with Mageia. However, I already established with a pre-Mageia install of Bodhi, that the CPU on that box also has SSE, but not SSE-2. I do intend to build xapian, just haven't found the time today. It may have to wait for the weekend. -And if I can get recoll working, then I'll probably want to disable some of the KDE-native indexing software, if possible. In htop, there are several Akonadi and Nepomuk processes that are sucking up a lot of system resources, even when I'm not actively doing anything. With a box this old, that has to stop.

Just for kicks, I've also installed the E17 desktop for Mageia. Only ran it once, but it starts up, gives me a desktop, and then the mouse cursor disappears! :roll: If I recall correctly from the last time that happened with E17, the fix for that is change over from the last PS2 mouse in the house, to a USB mouse. Thank you for all the input. I'll hopefully close out this tag after I get the build done. Right now, though, I must sleeep.
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 12th, '13, 10:48

drachenchen wrote:Interesting. I tried running your code above in terminal, as user and root, on the Debian box (where I'm writing from). I get nothing. If instead I do: grep ^flags /proc/cpuinfo , then I get a list of the flags, and it only shows SSE, not SSE-2. Will try it on the Mageia box tomorrow; I'm curious to see how both commands work with Mageia

Well, if it shows no result, the box doesn't have SSE2. Simple as that. And it doesn't need to be run as root.
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby drachenchen » Dec 13th, '13, 06:34

Hello.

That's good to know. The lack of "grep" output indicates nothing there. Now that I'm thinking about that, I've used "locate" the same way. My local Linux guru, mentioned previously, wants me to build a MageiaRPM of Xapian. He sent me instructions. Seems complicated, but I think he wants me to learn this, and insists it's the right way to do it. I suppose it might actually even be usefull to the three other Mageia users with hardware this old, that want Xapian... :lol:

Anyway, I'm nearly ready to commit the package build, but it's getting too late to use this box, so maybe tomorrow. Thanks!
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 13th, '13, 12:04

Well, there's no need to build the xapian packages from scratch. You only need to get the src.rpm for Mageia 3,
install it, change what you want and then build that. Give me a shout if you need some help with the packages.
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby drachenchen » Dec 16th, '13, 06:51

Hello, Doctor5000.

Was just skimming over the previous posts; in your post of Dec. 11th, were you saying that you had already built an RPM of Xapian with the --sse-disable flag? If so, was it of their latest stable (1.2.16), or from the Mageia repos (1.2.12)? I missed what you were saying the first time around; sorry. If you have already done this, could you tell me where to get it? -Or did you mean that you've installed Xapian with sse-disabled before, and could offer tips on that process?

As for your last message, I tried searching in Rpmdrake as installed, and only got a few source packages listed, in with everything else. -And no source package for Xapian, especially. Tried searching for "Xapian source", and "xapian.src.rpm", and nothing. If I could get that particular SRPM, then really the only change would be the sse-disable during build. Also, I'm unfamiliar with KDE4 / Mageia, especially Rpmdrake. I've gone into the Mageia Control Center, to try to configure media sources, and many are listed, but nothing is listed as a sources repo. How would I find and enable that?

I was thinking about just getting the latest stable library source-rpm from Xapian, and do the ./configure (with --sse-disable flag)/ make / make install process, and be done with it, BUT my local Linux guru ibulzhik is pushing me towards: "You want to build a package custom for your distro whenever possible." I question whether it would be generally useful, but I suppose it might. So, have you done this already, or do I have a "valuable learning experience" ahead of me? Thank you!
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 16th, '13, 09:07

drachenchen wrote:Hello, Doctor5000.

Was just skimming over the previous posts; in your post of Dec. 11th, were you saying that you had already built an RPM of Xapian with the --sse-disable flag? If so, was it of their latest stable (1.2.16), or from the Mageia repos (1.2.12)? I missed what you were saying the first time around; sorry. If you have already done this, could you tell me where to get it? -Or did you mean that you've installed Xapian with sse-disabled before, and could offer tips on that process?

I've used the version from Mageia 3 repos, but you could easily use the one from Cauldron which is at 1.2.12.
Simply get the src.rpm, install it and add the flag --disable-sse to %configure and then build it (as e.g. described here: viewtopic.php?f=41&t=5530 )
A piece of cake and only takes a few minutes.

For the src.rpm I get them directly from my favourite mirror, e.g. http://ftp.nluug.nl/pub/os/Linux/distr/ ... e/release/
IIRC there was support in urpmi to automatically download this some time ago, but that would mean you need to add Cauldron repos for this.
For the name of the src.rpm that's quite easy, either rpm -qi package on any installed packaged to see the src.rpm or use urpmq --sourcerpm packagename
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby drachenchen » Dec 18th, '13, 01:24

Hello, Doctor5000!

OK, I used:
urpmq --sourcerpm xapian.src.rpm
That outputted:
xapian-1.2.12-3.mga3.src.rpm

Then, I did:
urpmf xapian-1.2.12-3.mga3.src.rpm
Output was:
http://mirrors.mageia.org/api/mageia.3.i586.list: media/core/release/media_info/20130521-174810-files.xml.lzma
http://mirrors.mageia.org/api/mageia.3.i586.list: media/core/updates/media_info/20131212-222747-files.xml.lzma
http://mirrors.mageia.org/api/mageia.3.i586.list: media/nonfree/release/media_info/20130518-182035-files.xml.lzma
http://mirrors.mageia.org/api/mageia.3.i586.list: media/nonfree/updates/media_info/20131212-222849-files.xml.lzma

Followed the URLs to the Mageia.org mirror list, but couldn't figure out how to navigate or use it. It looks like an "80s" interface of some sort, and I was as computer-literate as a garden slug back then. Pressing the "query" button gave me nothing. I tried to copy-paste a N.American mirror into my browser, and just got another full (completely unorganized) list of mirrors. I tried the link to the Netherlands mirror you posted, but from over here, it is "dog-slow", and I gave up on it. I am now officially confused. I know I have used ftp and http from text link lists in the past, but I don't remember the interface being this difficult to use. :?

In a fit of madness, I removed all my sources, and added the lot, again. I now have a lot of "tainted" repos enabled, etc., but I still cannot clearly find that src.rpm package. If I run rpm -qi xapian-1.2.12-3.mga3.src.rpm, it tells me that it is not installed, but is it available? If I run urpmf with the package name again, NOW I get nothing back. This would almost make sense, as it's not installed, except that this time, I don't even get the four results for the Mageia.org mirrors. I would just try the install command, but don't I need to download it first so that when I build it, I can set the CPU flag?

I did find a download site through the Xapian.org download page, that has src.rpms for the core, Python bindings, and Recoll, but they are VERY recent versions, (less than two weeks old), and not marked as .mga3. Considering that I need to do a build from them anyway, it seems like this should work. Am I letting myself in for a lot of grief if I don't go with building from a .mga3 package? Thank you!
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 18th, '13, 02:55

drachenchen wrote:I did find a download site through the Xapian.org download page, that has src.rpms for the core, Python bindings, and Recoll, but they are VERY recent versions, (less than two weeks old), and not marked as .mga3. Considering that I need to do a build from them anyway, it seems like this should work. Am I letting myself in for a lot of grief if I don't go with building from a .mga3 package? Thank you!


Not sure why you went through all that hassle, as I've already posted a link to the latest Mageia src.rpm for xapian.
What else do you need?
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby drachenchen » Dec 18th, '13, 04:11

As I mentioned, the mirror link you sent was VERY slow this afternoon, enough that I gave up. I went to that site again this evening and it was a little faster, so I looked for xapian, and only found an mga4.src.rpm. I thought I needed the mga3 for Mageia3, or will it not make any difference? Thanks.
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Dec 18th, '13, 14:40

Sorry, but you seem to be a bit confused :)

You mentioned the Mageia 3 package was too old, and you wanted something more recent. Most logical thing is to take the latest
Mageia src.rpm and rebuild it for Mageia 3. You could also create a new package from scratch or adapt the src.rpms which come
directly from xapian or recoll, but that's much more work and asking for more trouble.
FWIW Cauldron is the development version of Mageia (than will soon result in Mageia 4 being released) https://wiki.mageia.org/en/Cauldron

If you need another mirror, look for one of the faster servers near your location (you can filter by country)
and then in the rightmost column click on ftp or http for that mirror so you can browse it.
If you need help navigating it, best read up on https://wiki.mageia.org/en/Mirrors_poli ... ors_layout for the general structure.
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany

Re: recoll fails to create index

Postby dglent » Jan 3rd, '14, 08:33

Great tool, in Mageia 4 will be available a rpm proposing packages for the various file types:
http://sophie.zarb.org/distrib/Mageia/c ... 39e22b095e

and the full recoll installation:
http://sophie.zarb.org/distrib/Mageia/c ... 89405903f6
User avatar
dglent
 
Posts: 186
Joined: Mar 30th, '11, 07:04
Location: Paris region, France

Re: recoll fails to create index

Postby drachenchen » Jan 4th, '14, 06:35

Thanks for that information, dglent!

My problem has been the lack of SSE2 floating point instructions in my CPU. The Xapian backend needs to have this. I also found out that more recent versions of MS Office require SSE2 as well. -And Libre Office seems to have a lot of problems with normal display, leading me to think that it probably also wants the SSE2 f.p.i.

I haven't had the time to build Xapian for this antique box, but with the advent of more programs needing SSE2, a friend has taken pity on me, and so a more modern box, _with_ SSE2 CPU, is on its way. So maybe I will give it Mageia4, as well!

So, I guess this thread is solved, but by using the better hardware cheat. I think there is enough info, especially from doctor5000, that someone could custom build Xapian, and get Recoll working on an old box. I just ran out of time; it is all under demand by the actual world, not the virtual. Thanks again to everyone.
drachenchen
 
Posts: 11
Joined: Dec 7th, '13, 20:54

Re: recoll fails to create index

Postby doktor5000 » Jan 4th, '14, 09:41

drachenchen wrote:I think there is enough info, especially from doctor5000, that someone could custom build Xapian, and get Recoll working on an old box.

Just to repeat, I've got xapian packages with SSE disabled, see viewtopic.php?p=42265#p42265
I though you wanted to do those yourself for the learning effect ...
Cauldron is not for the faint of heart!
Caution: Hot, bubbling magic inside. May explode or cook your kittens!
----
Disclaimer: Beware of allergic reactions in answer to unconstructive complaint-type posts
User avatar
doktor5000
 
Posts: 18071
Joined: Jun 4th, '11, 10:10
Location: Leipzig, Germany


Return to Basic support

Who is online

Users browsing this forum: No registered users and 1 guest