Comments on: Clustify: Identifying Similar Documents http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/ by Stephen E. Arnold Sun, 21 Mar 2010 14:15:46 +0000 http://wordpress.org/?v=2.9 hourly 1 By: Steve http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/comment-page-1/#comment-56571 Steve Fri, 19 Jun 2009 13:21:48 +0000 http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/#comment-56571 Interesting article. Came across it on a google search for clustering. Have you done other research into this area with other tools. There are several tools in the marketplace today, but I would be interested in how this clustify worked against the other tools. Interesting article. Came across it on a google search for clustering. Have you done other research into this area with other tools. There are several tools in the marketplace today, but I would be interested in how this clustify worked against the other tools.

]]> By: Stephen E. Arnold http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/comment-page-1/#comment-3112 Stephen E. Arnold Mon, 10 Mar 2008 17:35:36 +0000 http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/#comment-3112 Dmitri, you can see some of the features at www.magportal.com. Stephen Arnold, March 10, 2008, 1 35 pm Eastern Dmitri, you can see some of the features at http://www.magportal.com.

Stephen Arnold, March 10, 2008, 1 35 pm Eastern

]]> By: Dmitri http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/comment-page-1/#comment-3106 Dmitri Mon, 10 Mar 2008 16:31:35 +0000 http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/#comment-3106 Very interesting, too bad there is no online demo for this. Mining the concepts from text and tagging documents with them sounds like a very reasonable approach, as it gives the end user a quick grasp on the large body of documents (we are doing a similar thing). Regarding their legal implementation, I wonder if it is all based on derived tags, though; I think that a system like this also needs to have a dictionary with specific terms and semabntic constructs pertinent to the legal field. Glad I came across your blog Stephen, will keep following it. Very interesting, too bad there is no online demo for this. Mining the concepts from text and tagging documents with them sounds like a very reasonable approach, as it gives the end user a quick grasp on the large body of documents (we are doing a similar thing). Regarding their legal implementation, I wonder if it is all based on derived tags, though; I think that a system like this also needs to have a dictionary with specific terms and semabntic constructs pertinent to the legal field. Glad I came across your blog Stephen, will keep following it.

]]> By: Stephen E. Arnold http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/comment-page-1/#comment-3105 Stephen E. Arnold Mon, 10 Mar 2008 15:57:26 +0000 http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/#comment-3105 Thanks for posting Rob, I have looked at Carrot2, and it looks to me that Carrot2 can handle this job. You would have to write the middleware and hook into Carrot2. The stream function caught my eye with Clustify. Also, Vivisimo has a good clustering engine, and it works on the fly. I don't know, however, if Vivisimo makes that available as a stand alone. Stephen Arnold, March 10, 2008 Noon Eastern Thanks for posting Rob, I have looked at Carrot2, and it looks to me that Carrot2 can handle this job. You would have to write the middleware and hook into Carrot2. The stream function caught my eye with Clustify. Also, Vivisimo has a good clustering engine, and it works on the fly. I don’t know, however, if Vivisimo makes that available as a stand alone.

Stephen Arnold, March 10, 2008 Noon Eastern

]]> By: Rob Young http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/comment-page-1/#comment-3059 Rob Young Sun, 09 Mar 2008 22:14:20 +0000 http://arnoldit.com/wordpress/2008/03/09/clustify-identifying-similar-documents/#comment-3059 I wonder how easy it would be to write a contender for this using the <a href="http://project.carrot2.org/" rel="nofollow">Carrot2</a> clustering engine. The search could be managed identically with Lucene. So far I have only heard of Carrot2 being used for clustering resultsets (ie. comparatively tiny sets), but it does accept a stream as input so it may be possible to shape up a good contender. Thoughts? I wonder how easy it would be to write a contender for this using the Carrot2 clustering engine. The search could be managed identically with Lucene. So far I have only heard of Carrot2 being used for clustering resultsets (ie. comparatively tiny sets), but it does accept a stream as input so it may be possible to shape up a good contender.
Thoughts?

]]>