Andrew Pollack's Blog
Technology, Family, Entertainment, Politics, and Random Noise| Professional Services | Second Signal | Presentations | Andrew's Blog | Support |
Rabbits down holes
By Andrew Pollack on 05/17/2005 at 12:35 PM EDTSometimes you chase the rabbit too far down the hole. In my never ending quest for high performance, I built an in memory index that works very much like a sorted view column in that its very quick to find an entry, and even support partial matches -- in fact, the constructor accepts a regular expression used to split the entry into the parts for granularity of partial matches. We tend to think in terms of any letter, but in my case splitting on periods was good enough and produces a far smaller index.
As you can guess, it won't scale. Oh, sure it scales enough for anything I can currently see putting in it, but go not too much further out and you run out of heap space. So, its got to go off to disk. Now I find myself halfway through the paper process of creating a fast on disk structure to match the index, and I realize -- its just not worth it. Its a great tool, but its tech that needs to be shelved so I can finish this project. Maybe it will reappear incarnated as my own full text index or something.
any thing you do, anything related must also be given away. As much of what I
do is commercial, I can't use that stuff.
on Apache most of the time you have an Apache 2.0 license. The same as in
Tomcat. So it should be possible to reuse it. Even M$ uses a .NET port of
Lucene in their desktop search.
Have a second look. E.g. the collections are Apache license. What parts were
GPL you liked?
;-) stw
Other Recent Stories...
- 01/26/2023Better Running VirtualBox or VMWARE Virtual Machines on Windows 10+ Forgive me, Reader, for I have sinned. I has been nearly 3 years since my last blog entry. The truth is, I haven't had much to say that was worthy of more than a basic social media post -- until today. For my current work, I was assigned a new laptop. It's a real powerhouse machine with 14 processor cores and 64 gigs of ram. It should be perfect for running my development environment in a virtual machine, but it wasn't. VirtualBox was barely starting, and no matter how many features I turned off, it could ......
- 04/04/2020How many Ventilators for the price of those tanks the Pentagon didn't even want?This goes WAY beyond Trump or Obama. This is decades of poor planning and poor use of funds. Certainly it should have been addressed in the Trump, Obama, Bush, Clinton, Bush, and Reagan administrations -- all of which were well aware of the implications of a pandemic. I want a military prepared to help us, not just hurt other people. As an American I expect that with the ridiculous funding of our military might, we are prepared for damn near everything. Not just killing people and breaking things, but ......
- 01/28/2020Copyright Troll WarningThere's a copyright troll firm that has automated reverse-image searches and goes around looking for any posted images that they can make a quick copyright claim on. This is not quite a scam because it's technically legal, but it's run very much like a scam. This company works with a few "clients" that have vast repositories of copyrighted images. The trolls do a reverse web search on those images looking for hits. When they find one on a site that looks like someone they can scare, they work it like ......
- 03/26/2019Undestanding how OAUTH scopes will bring the concept of APPS to your Domino server
- 02/05/2019Toro Yard Equipment - Not really a premium brand as far as I am concerned
- 10/08/2018Will you be at the NYC Launch Event for HCL Domino v10 -- Find me!
- 09/04/2018With two big projects on hold, I suddenly find myself very available for new short and long term projects.
- 07/13/2018Who is HCL and why is it a good thing that they are now the ones behind Notes and Domino?
- 03/21/2018Domino Apps on IOS is a Game Changer. Quit holding back.
- 02/15/2018Andrew’s Proposed Gun Laws
Did you have a look at Apache's Jakarta Commons? They have all kinds of stuff
on caching, collection and things we tend to reinvent.
:-) stw