About Technology Industry

BNET Technology provides daily industry trends and news coverage with insights for managers and executives about all aspects of the high-tech industry. In addition to detailed tech company profiles, we bring you industry analysis on new mergers and acquisitions, tech products, investments, patents, and a host of other important technology related business issues.

Search Vendors Desperately Seeking Relevance

By Michael Hickins | Mar 24, 2009

If your name isn’t Google or Yahoo, being a search vendor is something like being a pro wrestler in the 1960s, with fervent but tiny crowds following you to dilapidated arenas in third-tier cities. Devotees of enterprise search insist that the technology will pay for itself, but the vendors are hard-pressed to prove it.

Enterprise search should be a no-brainer. These  companies, often founded and managed by PhDs,  use complex mathematical formulas to ferret out data strewn across a variety of data sources. The claim is that such technologies make it possible to efficiently locate information no matter where it is or how it’s been stored, whether in email, instant messaging, or what have you.

In practice, though, enterprise search vendors are hard-pressed to show tangible results outside a few specialized areas, often related to the production of data for regulatory compliance. Up to now, that’s left them to drum up enthusiasm over the merits of advanced features such as improved search-result “clustering” or “contextual searches” that don’t require precise search terms.

Set aside Google, which owns the low end of the market (and for whom enterprise search still represents less than one percent of sales), and Autonomy, which is making hay with compliance-related products in deals worth over $250,000. What’s left is a bunch of vendors trying to close deals in the $50,000 to $250,000 range, with little but variations on a theme to differentiate themselves.

Recently, they’ve taken to calling their technology “search-based applications,” a somewhat lame attempt to highlight the potential uses of enterprise search in conjunction with other applications. That, in turn, is supposed to significantly improve worker productivity.

Exalead is among the most active in trying to rebrand its technology as a companion to other applications, as opposed to just being a better information bloodhound. The same is true of Endeca and Attivio, a new company founded by former employees of FAST Search and Transfer, a highly regarded outfit that was acquired by Microsoft last spring. Indeed, acquisition is probably the preferred exit strategy for any of these vendors. (Hint to EMC: I know a vendor that would like a word with you.)

Other search vendors, like Recommind and Brainware, have created new regulatory niches for themselves. Regulations such as Sarbanes-Oxley and recent changes in the federal code of civil procedures can require companies to produce reams of electronic documents almost upon demand, which puts a premium on the ability to locate what’s needed as quickly and efficiently as possible.

IDC analyst Sue Feldman published a report in 2004, since quoted ad nauseam by vendors and analysts alike, to the effect that so-called knowledge workers can lose a company $6 million per year in time wasted looking for data. That’s hardly an argument you’d want to bring to your CEO at any time, but especially not in this environment.

Nick Patience, an analyst with the451Group, admits that search is a tough sell. Unlike software used to analyze data and generate reports, “the end result of a search is an ongoing process,” he told me. So, unlike “business intelligence” software that produces actionable information, such as an assessment of credit risk at a bank, search tools produce answers that merely help kick off the resolution of business problems.

Patience told me that some IT managers are bringing in search technology under the guise of compliance, but harbor more strategic plans. If that’s the case, they’d also better find an excuse to bring in a vendor that isn’t specialized in legal search, or they’ll miss out the more cutting-edge stuff.

It seems unlikely, but then again, so did pro wrestling, roller derby and stock car racing in the ’60s. Enterprise search vendors hope they’re not going to suffer the same fate as roller derby.

Michael Hickins is a professional writer and journalist with a passion for ferreting out the intersections between technology and culture.

BNET User Analysis

Web Buzz:
  • Correction: MarketShare Partners Has More Than 24 PhDs

    MediaPost - 256 days 17 hours 20 minutes ago

    A MediaDailyNews article on March 12 should have noted that analytics firm MarketShare Partners has more than two dozen PhDs on staff. The article had reported that there were four, but that is the number in the executive ranks

  • Timken Plots a Rust Belt Resurgence

    BusinessWeek - 40 days 10 hours 26 minutes ago

    Griffith and Smith in front of a wall listing Timken's U.S. patents in Canton, Ohio Michael Nemeth/Wonderful Machine By Stephen Baker Browse the BusinessWeek Archive You might look at Timken (TKR), the Canton (Ohio) manufacturer of bearings and specialty steel, and wonder if pursuing a diversification strategy is worth the bother. In the last...

  • Timetric Makes Web Data Useful with Time Series Analysis

    ReadWriteWeb - 111 days 2 hours 46 minutes ago

    A winner at this year's mini- Seedcamp in London, Timetric is an app from Inkling Software , a three-principle shop composed of chemistry and physics PhDs. The premise is fairly simple: Timetric was created to store, share, and analyze data over time. For predicting trends, proving assertions, or recommending actions, time series analysis...

  • Scholar proves that you can have fun with science

    South China Morning Post - 45 days 7 hours 26 minutes ago

    Dr Ji Xiaohua is founder and general manager of Songshuhui, a non-governmental scientific community on the mainland. Many of its members hold PhDs in various fields of natural science. They write interesting scientific stories with which to entertain themselves and the public. Their website, songshuhui.net, receives more than 80,000 visits a day

  • RF Micro Devices Actually Rallies off of Fundamentals

    Seeking Alpha - 74 days 22 hours 16 minutes ago

    Trader Mark submits: Pardon me for a moment here as for a day it feels like we've returned to simpler times ... like say 2006, when stocks moved based on fundamentals rather than being able to predict what 95 PhDs have programmed into HAL9000, and anticipating the correct variable function

 
Reply to Story

BNET TalkbackShare your ideas and expertise on this topic

Subscribe to this discussion via Email or RSS

  •  
    1

    Daniel Tunkelang

    03/24/09 | Report as spam

    RE: Search Vendors Desperately Seeking Relevance

    Web search consumers are generally happy with the status quo, so it will take a major improvement in that space to displace Google's near-hegemony. In contrast, many enterprises are unhappy with their status quo. If you think Sue Feldman is overplayed, check out the 2008 AIIM study:

    http://www.aiim.org/ResourceCenter/AIIMNews/PressReleases/Article.aspx?ID=34834

    I agree with you that the marketing language can get the way. So let's stick to substance.

    To one of your points, focusing on a niche like legal search is indeed a risky strategy if the end-goal is to be a generalist. That said, there will be vendors who develop specific domain expertise and thrive in those niches.

    But to your point about ROI, I think you overstate the challenge of making a ROI case for search--and that ties back to talking about search-based applications vs. search in the abstract. Search is often a key ingredient in applications that produce tangible income. It can be better site search leading to higher conversions or increased CPM ad revenue; better inside-the-firewall search leading to higher utilization rates for people or manufacturing parts; etc. And that ROI leads to deals worth well over $250K.

    I'll be happy to see pro wrestling go the way of the roller derby. But enterprise information needs are here to stay, and I'm excited to be in the business of addressing them.

  •  
    2

    warrenreese32

    03/24/09 | Report as spam

    RE: Search Vendors Desperately Seeking Relevance

    Sorry excuse for journalism, we expect facts. IDC
    measures enterprise search as one of the fastest growing
    software segments based on bottoms-up numbers at
    around 30 percent CAGR last year, and ROIs reported by
    customers in the hundreds of millions can commonly be
    found from all vendors. No, those aren't web search
    numbers, but they have an advertising business model.

  •  
    3

    Michael Hickins

    03/24/09 | Report as spam

    RE: Search Vendors Desperately Seeking Relevance

    Thanks for the comments. I do think enterprise search can offer a lot, but most observers with whom I've talked agree that it's been difficult for the vendors to differentiate themselves or find much traction.
    By the way, IDC's estimate for 2008 is around 22%, which sounds terrific, but starts at a relatively low base.
    Yes, vendors can produce success stories--but they always do. That doesn't mean they're reliable or even relevant.

  •  
    4

    ErikSherman

    03/25/09 | Report as spam

    RE: Search Vendors Desperately Seeking Relevance

    I think it's also easy to forget that search means things other than straight text. Video search, with realtime voice-to-text translation, has a number of applications in corporations. Image search not limited to metatags is important to let companies with such assets see if they are being used without permission on the web. (That includes trademark considerations as well as copyright.) I happen to think that music searching (finding the tune that sounds something like "this") could be big in the consumer space, though I don't know of anyone using the pattern matching and key shifting approaches that might prove useful. Maybe the biggest limitation in the search market is how we think of the techology and its possible uses.

  •  
    5

    msinville

    03/25/09 | Report as spam

    RE: Search Vendors Desperately Seeking Relevance

    Overall, this is a good article. As has been pointed out, several studies have shown that people are not satisfied with their legacy enterprise search solutions, precisely because of the limitations you noted. Merely searching ?unstructured data like email, instant messages, and Word files? does not generate significant productivity increases. Nor does having to learn a highly complex BI tool to access structured data, especially if the best result you can expect is ?actionable charts?. That?s why Attivio has always maintained that search is not enough...and neither is BI. The real power in business happens as search and business intelligence/data warehousing converge to enable unified information access. Users need to see all their content and data in one place, without the burden of pre-defined data modeling. While we?re confident (and appreciate your assessment) that we are ?a better bloodhound?, we don?t stop there. Attivio not only delivers data to users as new content matches their saved queries, we seamlessly integrate with other systems to execute business processes. Moving beyond simply finding information to using information in a meaningful way is where the true value lies.

  •  
    6

    YegorK

    03/26/09 | Report as spam

    RE: Search Vendors Desperately Seeking Relevance

    Michael, it?s interesting that you are mentioning ?search-based applications? as a separate class.

    We believe that they can significantly improve productivity if the embedded search can automatically ?validate? extracted data with other repositories of an organization without human intervention. While the traditional database lookup has long been used to fortify or append data from one source to another, it has always lacked the ability to ?interpret? information when there?s a similar but inexact match.

    Hence, the interpretation has always required exceptionally complex coding of business rules and IF/THEN statements to account for every conceivable scenario, or a human operator. Both options are expensive and neither scales effectively.

    Brainware, a company that you mention in your story, takes an entirely different approach and embeds its search technology (the only one in the world that is not based on keyword recognition) into its Intelligent Data Capture products. The technology works ?behind the scenes?, providing a whole range of unique features, such as the ability to compare extracted data from unstructured documents to any number of data sources to ensure the accuracy of the data extraction ? all in a fault tolerant manner.

    For example, vendor names extracted from invoices may have OCR errors due to use of company logos or the vendor addresses in the vendor master file do not match the remit to address on an invoice exactly.

    Using an intelligent search application that does not try to use the vendor name as a keyword to compare against a list of names allows 100% accurate extraction of data that can be matched against a separate data extract notwithstanding OCR errors. This is used, for example, to match item descriptions extracted from invoices with descriptions for the same items in a purchase order (for a 2-way match) or with a purchase order and a goods receipt (for a 3-way match), even though the wording used for the same item may be different.

    Benefits are significant and easy to measure: global companies that deploy such a solution typically reduce their manual data entry staff by upwards of 80%. This is the data you can bring to your CEO (in addition to Sue Feldman?s report).


Please add your comment:

  1. You are currently: a Guest |
  2.  

Basic HTML tags that work in comments are: bold (<b></b>), italic (<i></i>), underline (<u></u>), and hyperlink (<a href></a)

advertisement
advertisement
  • Click Here
  • Click Here
  • Click Here
advertisement