Tag: Lucid Imagination

Making Search Play Well with Content Solutions

In keynote sessions at the recent Gilbane Boston Conference, three speakers in a row made points about content management solutions that are also significant to selection and implementation of enterprise search. Here is a list of paraphrased comments.

  • From Forrester analyst, Stephen Powers were these observations: 1. The promise has been there for years for an E (enterprise)CM suite to do everything but the reality is that no one vendor, even when they have all the pieces, integrates them well. 2. Be cautious about promises from vendors who claim to do it all; instead, focus on those who know how to do integration.
  • Tony Byrne of the Real Story Group observed about Google in the enterprise that they frequently fail because Google doesn’t really understand “how work gets done in the enterprise.”
  • Finally, Scott Liewehr of the Gilbane Group stated that a services firm selection is more important than the content management system application selection.

Taken together these statements may not substantiate the current state of the content management industry but they do point to a trend. Evidence is accruing that products and product suppliers must focus on playing nice together and work for the enterprise. Most tend not to do well, out-of-the-box, without the help of expertise and experts.

Nominally, vendors themselves have a service division to perform this function but the burden falls on the buyer to make the “big” decisions about integration and deployment.
The real solution is waiting in the wings and I am increasingly talking to these experts, system integrators. They come in all sizes and configurations; perhaps they don’t even self-identify as system integrators, but what they offer is deep expertise in a number of content software applications, including search.

Generally, the larger the operation the more substantial the number and types of products with which they have experience. They may have expertise in a number of web content management products or e-commerce offerings. A couple of large operations that I have encountered in Gilbane engagements are Avalon Consulting, and Search Technologies, which have divisions each specializing in a facet of content management including search. You need to explore whether their strengths and expertise are a good fit with your needs.

The smaller companies specialize, such as working with several search engines plus tools to improve metadata and vocabulary management so content is more findable. Specialists in enterprise search must still have an understanding of content management systems (CMS) because those are usually the source of metadata that feed high quality search. I’ve recently spoken with several small service providers whose commentaries and case work illustrate a solid and practical approach. Those you might want to look into are: Applied Relevance, Contegra Systems, Findwise, KAPS Group, Lucid Imagination, New Idea Engineering, and TNR Global.

Each of these companies has a specialty and niche, and I am not making explicit recommendations. The simple reason is that what you need and what you are already working on is unique to your enterprise. Without knowledge of your resources, special needs and goals my recommendations would be guesses. What I am sharing is the idea that you need experts who can give value when they are the right experts for your requirements.

The guidance here is to choose a search services firm that will move you efficiently and effectively along the path of systems integration. Expertise is available and you do not need to struggle alone knitting together best-of-breed components. Do your research and understand the differentiators among the companies. High touch, high integrity and commitment for the long haul should be high on your list of requirements – and of course, look for experience and expertise in deploying the technology solutions you want to use and integrate.

Next month I’ll share some tips on evaluating possible service organizations starting with techniques for doing research on the Web.

Lucene Open Source Community Commits to a Future in Search

It has been nearly two years since I commented on an article in Information Week, Open Source, Its Time has Come, Nov. 2008. My main point was the need for deep expertise to execute enterprise search really well. I predicted the growth of service companies with that expertise, particularly for open source search. Not long after I announced that, Lucid Imagination was launched, with its focus on building and supporting solutions based on Lucene and, its more turnkey version, Solr.

It has not taken long for Lucid Imagination (LI) to take charge of the Lucene/Solr community of practice (CoP), and to launch its own platform built on Solr, Lucidworks Enterprise. Open source depends on deep and sustained collaboration; LI stepped into the breach to ensure that the hundreds of contributors, users and committers have a forum. I am pretty committed to CoPs myself and know that nurturing a community for the long haul takes dedicated leadership. In this case it is undoubtedly enlightened self-interest that is driving LI. They are poised to become the strongest presence for driving continuous improvements to open source search, with Apache Lucene as the foundation.

Two weeks ago LI hosted Lucene Revolution, the first such conference in the US. It was attended by over 300 in Boston, October 7-8 and I can report that this CoP is vibrant, enthusiastic. Moderated by Steve Arnold, the program ran smoothly and with excellent sessions. Those I attended reflected a respectful exchange of opinions and ideas about tools, methods, practices and priorities. While there were allusions to vigorous debate among committers about priorities for code changes and upgrades, the mood was collaborative in spirit and tinged with humor, always a good way to operate when emotions and convictions are on stage.

From my 12 pages of notes come observations about the three principal categories of sessions:

  1. Discussions, debates and show-cases for significant changes or calls for changes to the code
  2. Case studies based on enterprise search applications and experiences
  3. Case studies based on the use of Lucene and Solr embedded in commercial applications

Since the first category was more technical in nature, I leave the reader with my simplistic conclusions: core Apache Lucene and Solr will continue to evolve in a robust and aggressive progression. There are sufficient committers to make a serious contribution. Many who have decades of search experience are driving the charge and they have cut their teeth on the more difficult problems of implementing enterprise solutions. In announcing Lucidworks Enterprise, LI is clearly bidding to become a new force in the enterprise search market.

New and sustained build-outs of Lucene/Solr will be challenged by developers with ideas for diverging architectures, or “forking” code, on which Eric Gries, LI CEO, commented in the final panel. He predicted that forking will probably be driven by the need to solve specific search problems that current code does not accommodate. This will probably be more of a challenge for the spinoffs than the core Lucene developers, and the difficulty of sustaining separate versions will ultimately fail.

Enterprise search cases reflected those for whom commercial turnkey applications will not or cannot easily be selected; for them open source will make sense. Coming from LI’s counterpart in the Linux world, Red Hat, are these earlier observations about why enterprises should seek to embrace open source solutions, in short the sorry state of quality assurance and code control in commercial products. Add to that the cost of services to install, implement and customize commercial search products. The argument would be to go with open source for many institutions when there is an imperative or call for major customization.

This appears to be the case for two types of enterprises that were featured on the program: educational institutions and government agencies. Both have procurement issues when it comes to making large capital expenditures. For them it is easier to begin with something free, like open source software, then make incremental improvements and customize over time. Labor and services are cost variables that can be distributed more creatively using multiple funding options. Featured on the program were the Smithsonian, Adhere Solutions doing systems integration work for a number of government agencies, MITRE (a federally funded research laboratory), U. of Michigan, and Yale. CISCO also presented, a noteworthy commercial enterprise putting Lucene/Solr to work.

The third category of presenters was, by far, the largest contingent of open source search adopters, producers of applications that leverage Lucene and Solr (and other open source software) into their offerings. They are solidly entrenched because they are diligent committers, and share in this community of like-minded practitioners who serve as an extended enterprise of technical resources that keeps their overhead low. I can imagine the attractiveness of a lean business that can run with an open source foundation, and operates in a highly agile mode. This must be enticing and exciting for developers who wilt at the idea of working in a constrained environment with layers of management and political maneuvering.

Among the companies building applications on Lucene that presented were: Access Innovations, Twitter, LinkedIn, Acquia, RivetLogic and Salesforce.com. These stand out as relatively mature adopters with traction in the marketplace. There were also companies present that contribute their value through Lucene/Solr partnerships in which their products or tools are complementary including: Basis Technology, Documill, and Loggly.

Links to presentations by organizations mentioned above will take you to conference highlights. Some will appeal to the technical reader for there was a lot of code sharing and technical tips in the slides. The diversity and scale of applications that are being supported by Lucene and Solr was impressive. Lucid Imagination and the speakers did a great job of illustrating why and how open source has a serious future in enterprise search. This was a confidence building exercise for the community.

Two sentiments at the end summed it up for me. On the technical front Eric Gries observed that it is usually clear what needs to be core (to the code) and what does not belong. Then there is a lot of gray area, and that will contribute to constant debate in the community. For the user community, Charlie Hull, of flax opined that customers don’t care whether (the code) is in the open source core or in the special “secret sauce” application, as long as the product does what they want.

© 2018 Bluebill Advisors

Theme by Anders NorenUp ↑