May 2024 Crawl Archive Now Available

The crawl archive for May 2024 is now available. The data was crawled between May 18th and May 31st, and contains 2.7 billion web pages (or 377 TiB of uncompressed content). This is our 100th crawl!

Massive 2,500-Page Google Document Leaked, Exposing Secret Search Ranking A

A Google document has leaked online that aims to include thousands of APIs aiming to rank better on Google Search for ranking.

Secrets from the Algorithm: Google Search’s Internal Engineering Documentat

Learn what you always wish you knew about Google's algorithms.

An SQL Vector Database To Enhance Text Search: How We Did It

Performance testing shows integrating Tantivy’s full-text search engine library into vector search significantly improves speed and performance.

OpenAI’s ChatGPT-powered search engine to be introduced next week

The search engine war is heating up. ChatGPT may introduce its search engine, which will rival Google, on Monday. Although

Perplexity’s latest partnership set to power SoundHound’s voice assistant

For Perplexity, the partnership with SoundHound marks the addition of another strong distribution channel expanding the reach of its LLM-driven search capabilities.

Perplexity AI: Exploring AI-powered search beyond Google

Perplexity's AI-powered search experience challenges Google's model by delivering conversational answers, citing sources and more.

Google Search Parameters (2024 Guide)

The Google Search URL parameters are important to understand whether you are maximizing the...

How 16 Companies are Dominating the World’s Google Search Results (2023 Edi

A deep-dive into how far fewer companies than you think have taken a hold of Google's search results.

Perplexity

Perplexity is a free AI-powered answer engine that provides accurate, trusted, and real-time answers to any question.

Full-Text Search for Ruby on Rails with Litesearch

In part six of our series, we'll use Litesearch, the last piece of the puzzle in LiteStack.

ChatGPT Prompts for Customer Personas

Identify and target personas of keywords, competitors, Reddit discussions, and more.

9 strategies for removing negative content from the web

Here are ways to remove webpages and online posts harmful to your brand – from privacy claims and copyright notices to legal measures.

Reddit Is a Marketing Goldmine

Reddit posts reveal brand awareness, sentiment, and more. Increasingly they appear in Google search results.

How Google Search and ranking works, according to Google’s Pandu Nayak

Learn how indexing, algorithms, deep learning systems, human raters, click and query data, and more shape Google's Search results.

7 reasons to replace advanced search with filters so users can easily find

Adam Silver – interaction designer - London, UK

Similarity Search, Part 4: Hierarchical Navigable Small World (HNSW) | by V

Hierarchical Navigable Small World (HNSW) is a state-of-the-art algorithm used for an approximate search of nearest neighbours. Under the…

Similarity Search, Part 3: Blending Inverted File Index and Product Quantiz

In the first two parts of this series we have discussed two fundamental algorithms in information retrieval: inverted file index and…

Building a Vector Search Engine Using HNSW and Cosine Similarity

Hierarchical Navigable Small World graphs (HNSW) is an algorithm that allows for efficient nearest neighbor search, and the Sentence…

Similarity Search, Part 1: kNN & Inverted File Index

Similarity search is a popular problem where given a query Q we need to find the most similar documents to it among all the documents D.

Similarity Search, Part 2: Product Quantization

Learn a powerful technique to effectively compress large data

Similarity Search, Part 5: Locality Sensitive Hashing (LSH)

Explore how similarity information can be incorporated into hash function

Similarity Search, Part 6: Random Projections with LSH Forest

Understand how to hash data and reflect its similarity by constructing random hyperplanes

Similarity Search, Part 7: LSH Compositions

Dive into combinations of LSH functions to guarantee a more reliable search

Top 5 Gems for Implementing a Search Engine in a Rails App

Thanks to gems, it is easy to implement a search engine into Rails applications. Of course, you have to choose which gem to use. While there are countless options, four stand out as the best. You will be happy with any of these options.

Introduction to Vector Similarity Search

Learn what vector search is and the metrics pertinent to decide the distance (or similarity) between objects.

​​Advanced Search UX Done Right — Powerful Examples and Tips

Learn about designing advanced search features. Explore key elements of search UI and build a user-friendly search input.

eBay’s Blazingly Fast Billion-Scale Vector Similarity Engine

The Similarity Engine's use cases include item-to-item similarity for text and image modality and user-to-item personalized recommendations based on a user’s historical behavior data.

Discoverability in UX and UI Design — 9 Techniques to Try

Try those 9 techniques and improve discoverability in your product. Make your users happy and create a smooth ux for them.

The Future of Ecommerce: How a Product Becomes a Purchase

General Partner Connie Chan on how leading brands are using AI and other technology to combine the serendipitous discovery of offline shopping with the infinite options of online shopping. Today, most of the Western world revolves around search-based online commerce. This means…

A different approach to fuzzy finding

Yandex ‘leak’ reveals 1,922 search ranking factors

SEOs have already started analyzing Yandex's search ranking factors, which include PageRank and several other link-related factors

DuckDuckGo Search Syntax | DuckDuckGo Help Pages

Learn how to use syntax on DuckDuckGo Private Search to get the search results you want.

Milvus · An Open Source Vector Similarity Search Engine - 开源向量相似度搜索引擎

Open-source vector database built for GenAI applications. Install with pip, perform high-speed searches, and scale to tens of billions of vectors.

Whitepages - Search, Find, Know | The largest and most trusted online direc

Whitepages | Find accurate phone numbers, addresses and emails from the most trusted U.S. white pages phone directory and address lookup since 1997.

[1702.04680v1] Visual Discovery at Pinterest

Over the past three years Pinterest has experimented with several visual search and recommendation services, including Related Pins (2014), Similar Looks (2015), Flashlight (2016) and Lens (2017)....

matsui528/nanopq: Pure python implementation of product quantization for nearest neighbor search

Pure python implementation of product quantization for nearest neighbor search - matsui528/nanopq

Product Quantization for Similarity Search

How to compress and fit a humongous set of vectors in memory for similarity search with asymmetric distance computation (ADC)

IVFPQ HNSW for Billion-scale Similarity Search | by Peggy Chang | Towards

The best indexing approach for billion-sized vector datasets

Similarity Search with IVFPQ

Find out how the inverted file index (IVF) is implemented alongside product quantization (PQ) for a fast and efficient approximate nearest…

NSVQ: Improved Vector Quantization technique for Neural Networks Training

Efficient vector quantization for machine learning optimizations (eps. vector quantized variational autoencoders), better than straight…

19 advanced Google search operators you need to know

Gain powerful insights to inform your marketing efforts. Use the following advanced Google search operators and commands to your advantage.

What is semantic search: A deep dive into entity-based search

Semantics = theory of meaning, yet most define semantic search with a focus on intent. “Meaning” is not the same as “intention.” Learn more.

25 Free Tools to Test Your Website

This all-new update to our popular resource includes tools to evaluate page speed, security, accessibility, regulatory compliance, code, and more.

I tried replacing Google with TikTok, and it worked better than I thought

TikTok won’t kill Google yet, but it’s a new and fun way to think about search.

For Gen Z, TikTok Is the New Search Engine (Published 2022)

Need to find a restaurant or figure out how to do something? Young people are turning to TikTok to search for answers. Google has noticed.

[P] My co-founder and I quit our engineering jobs at AWS to build “Tensor Search”. Here is why.

530 votes, 63 comments. My co-founder and I, a senior Amazon research scientist and AWS SDE respectively, launched Marqo a little over a week ago - a…

YaCy – your own search engine | Hacker News

Ask HN: I want to dive into how to make search engines | Hacker News

40,000 Recipes for Murder

Two scientists inadvertently open the Pandora’s Box of WMDs. What now?