#TFIDF

Karsten Schmidt

@toxi.mastodon.thi.ng.ap.brid.gy

9 months ago

Commented and syntax-highlighted TypeScript source code/example from the project readme, showing different steps, transformations and analysis results and how to create a k-means clustering of 200+ projects

Recently I've combined various functions which I've been using in other projects (e.g. my personal PKM toolchain) and published them as new library https://thi.ng/text-analysis for better re-use:

- customizable, composable & extensible tokenization […]

[Original post on mastodon.thi.ng]

stdiff

@stdiff.bsky.social

10 months ago

Practical BM25 - Part 1: How Shards Affect Relevance Scoring in Elasticsearch Similarity ranking (relevancy) in Elasticsearch relates directly to the amount of shards in your index. Learn more about how shards and relevancy are related, as well what you should consider when tun...

> In Elasticsearch 5.0, we switched to Okapi BM25 as our default similarity algorithm

I have heard that the similarity algorithm of #Elasticsearch is a variant of #TFIDF, but I didn't know that it was #BM25.

@nsagheen.bsky.social

1 year ago

Implementing Machine Learning Data Storage Optimizations — Parallels of Inventory Management and C# The constant search for speed and efficiency in the field of data storage has prompted the development of creative storage solutions. In…

#InformationTechnology #SoftwareDevelopment #DataStorage #RAMDisk #TFIDF #MachineLearning #CSharp #SolidState #ABCClassification

Meng Li

@mengli512.bsky.social

1 year ago

Naive Bayes Classification (Part 2): How to Classify Documents?(Practical Data Analysis 15) Learn Naive Bayes for text classification, sentiment analysis, spam detection, and TF-IDF calculation using sklearn's powerful tools and techniques.

Learn Naive Bayes for text classification, sentiment analysis, spam detection, and TF-IDF calculation using sklearn's powerful tools and techniques.

#Python #sklearn #Bayes #TFIDF
open.substack.com/pub/pythonli...

Beni Arisandi

@benkwek.bsky.social

1 year ago

Did you know Boox uses TF-IDF scoring for accurate search results? It weighs word importance across documents, not just frequency! 🤯 #searchengine #dev #coding #javascript #boox #tfidf

stilearning.com/boox/guides/...