Open Source Software: The Community Model in 2021

I read “Why I Wouldn’t Invest in Open-Source Companies, Even Though I Ran One.” I became interested in open source search when I was assembling the first of three editions of Enterprise Search Report in the early 2000s. I debated whether to include Compass Search, the precursor to Shay Branon’s Elasticsearch reprise. Over the years, I have kept my eye on open source search and retrieval. I prepared a report for an the outfit IDC, which happily published sections of the document and offering my write ups for $3,000 on Amazon. Too bad IDC had no agreement with me, managers who made Daffy Duck look like a model for MBAs, and a keen desire to find a buyer. Ah, the book still resides on one of my back of drives, and it contains a run down of where open source was getting traction. I wrote the report in 2011 before getting the shaft-a-rama from a mid tier consulting firm. Great experience!

The report included a few nuggets which in 2011 not many experts in enterprise search recognized; for instance:

  1. Large companies were early and enthusiastic adopters of open source search; for example Lucene. Why? Reduce costs and get out of the crazy environment which put Fast Search & Transfer-type executives in prison for violating some rules and regulations. The phrase I heard in some of my interviews was, “We want to get out of the proprietary software handcuffs.” Plus big outfits had plenty of information technology resources to throw at balky open source software.
  2. Developers saw open source in general and contributing to open source information retrieval projects as a really super duper way to get hired. For example, IBM — an early enthusiast for a search system which mostly worked — used the committers as feedstock. The practice became popular among other outfits as well.
  3. Venture outfits stuffed with oh-so-technical MBAs realized that consulting services could be wrapped around free software. Sure, there were legal niceties in the open source licenses, but these were not a big deal when Silicon Valley super lawyers were just a text message away.

There were other findings as well, including the initiatives underway to embed open source search, content processing, and related functions into commercial products. Attivio (formed by former super star managers from Fast Search & Transfer), Lucid Works, IBM, and other bright lights adopted open source software to [a] reduce costs, [b] eliminate the R&D required to implement certain new features, and [c] develop expensive, proprietary components, training, and services.

Read more »


DarkCyber for June 9, 2020, Is Now Available: AI and Music Composition

The DarkCyber for June 9, 2020, presents a critical look at music generated by artificial intelligence. The focus is the award-winning song in the Eurovision AI 2020 competition. The interview discusses the characteristics of AI-generated music, its impact on music directors, how professional musicians deal with machine-created music, and the implications of non-numan music. The program is a criticism of the state-of-the-art for smart software. Instead of focusing on often over-hyped start ups and large companies making increasingly exaggerated claims, the Australian song and the two musicians make clear that AI is a work in progress. You can view the video at https://vimeo.com/427227666.

Kenny Toth, June 9, 2020

Latest News

Google Management: What Happens When Science Club Management Methods Emulate Secret Societies?

A secret society is one with special handshakes, initiation routines, and a code of conduct which prohibits certain behavior. Sometimes even a secret society has... Read more »

January 27, 2021 | Comment

Patents March On Despite Pandemic

Even during a pandemic, inventors shall invent. What is uncertain is how many of those ideas will eventually make it to fruition. GeekWire reports, “U.S. Patent... Read more »

January 27, 2021 | Comment

Humble Brag or Majestic Wisdom: The Waymo Method of Dealing with Pesky Tesla

John Krafcik (a Googler) is the head of Waymo. That’s a name which means one get “way more” than from any other outfit. Get it? Cool? “Waymo CEO Dismisses... Read more »

January 27, 2021 | Comment

IBM: Watson, What Is Going On?

I want to keep this brief. IBM is a company anchored in the past, and its management is demonstrating that agility, pivoting, buzzwords, and sci-fi technology are... Read more »

January 27, 2021 | Comment

Financial Guru: Cryptocurrency Observation of Note

Years ago I ran across an orthogonal financial thinker named Nouriel Roubini, a consultant, financial type, and professor at New York University. He wrote an essay... Read more »

January 27, 2021 | Comment

Online Immortality: Suddenly Death Makes Digital Headlines

I was surprised. Yes, I was. I read three news stories within a few minutes of their appearing in my newsfeed. The first — “AI Resurrects Legendary Spanish... Read more »

January 26, 2021 | Comment

CFOs and Their Digital Competencies: Ah, Ha, Forget Taxes and Demonstrating Revenue Growth

No joke. The title of this write up is serious, or as serious as mid tier consulting firms’ experts can be. “Gartner Details the Five Digital Competencies CFOs... Read more »

January 26, 2021 | Comment

Smart Software: Definitely More Exciting than a COBOL Accounting System

I found “A Closer Look at the AI Incident Database of Machine Learning Failures” for the jejune write up contains pointers to some useful resources: Resource... Read more »

January 26, 2021 | Comment

The Silicon Valley Way: Working 16 Hour Days in Four Hours?

Years ago I worked at a couple of outfits which expected professionals to work more than eight hours a day. At the nuclear outfit, those with an office, a helper... Read more »

January 26, 2021 | Comment

DarkCyber for January 26, 2021, Now Available

DarkCyber is a twice-a-month video news program. The stories cover cyber crime, lesser known Internet services, and online. The feature in the January 26, 2021,... Read more »

January 26, 2021 | Comment

  • Archives

  • Recent Posts

  • Meta