captchas.md (4005B)
1 # CAPTCHAs 2 3 ## Background 4 5 I use VPNs most of the time despite concerns their usage may limit my fourth amendment rights [1]. One annoyance of using VPNs is being hit with CAPTCHAs. This isn't an issue when I use my Searxng instance because it doesn't have CAPTCHAs, but all modern, freely available, search engines do. 6 7 ## Methodology 8 9 EDIT: TODO - I used librewolf instead of mullvad browser because of some issues with multi-search engine opening 10 11 Each query was sent while connected to a U.S. based ProtonVPN exit node. While the exit nodes changed over time, the exit node was consistent across each search engine on the basis of a given query. To achieve this, I used the Multi engine search Firefox extension [2]. Additionally, I used my browser of choice, that supports Javascript, the Mullvad browser [3] to perform these evaluations. The only changes to the browser were adding the multi-search extension, removing the mullvad browser extension, and adding each of the search engines I was interested in testing as search engines in the browser settings. Finally, I created a "New Identity" after every 5 searches to see evaluate how often CAPTCHAs are shown when users have already completed them within the same "session". I also rotated my IP address every 5 searches by using a different random US-based protonvpn server. I considered resetting after every search, or using my browser naturally, but thought this would be a more consistent way to evalutate CAPTCHA rates. 12 13 Alongside tracking CAPTCHA hit rates, I also tracked how long it took to pass through the CAPTCHAs, and the search index of the result I was looking for. This index was the first result that contained a satisfactory answer to my query. I also tracked slop count, which was the count of the top 5 results that were AI slop / SEO spam sites, based on my subjective definitions of both. Since I am using Mullvad browser, which comes with uBlock origin out of the box, advertisements were never (obviously and statedly) displayed in search results. 14 15 ## Limitations 16 17 A few limitations are listed below: 18 19 - Mullvad browser 20 - I could be treated differently by each of the browsers on this basis 21 - Multi-search queries 22 - It is possible data is being shared between search engines on the backend, resulting in some search engines showing CAPTCHAs based on searches in other search engines that match the current search. This seems slightly unlikely, but Duckduckgo does primarily use Bing on the backend, so it's possible. 23 24 ## Description of My Search Habits 25 26 All searches are tracked in a md file [4???], but at a high-level, I was working, reading, and other general usage things. I don't think it's fair to say these are my normal habits because there was a non-zero amount of friction added by marking down this data as I used the web, but I didn't conciously make any changes to how I search the web. 27 28 ## Selected Search Engines 29 30 - Google 31 - Startpage 32 - Brave Search 33 - noai.duckduckgo.com 34 - Bing 35 - Ecosia 36 - Qwant 37 - Mojeek 38 - Yahoo 39 40 ## Unused Search Engines 41 42 - Kagi 43 - Kagi lacks a privacy respecting payment method. As such, this is a non-starter for me. If there was a browser that accepted crypto, and had accounts similar to Mullvad, I would consider using it. 44 - Searxng 45 - Searxng is what I like to use, but it does have some drawbacks. Specifically, if you aren't sharing your Searxng instance with other people, the IP address of yours server will get tied to your identity for tracking, reducing many of the privacy benefits associated with using a VPN. Additionally, since my Searxng instance is hosted on Hetzner, it frequently returns no results due to all upstreams replying with CAPTCHAs. While an interesting concept, I find it breaks down in practice. 46 - Perplexity 47 - I'll write about this. 48 49 [1] - https://www.wired.com/story/using-a-vpn-may-subject-you-to-nsa-spying/ 50 [2] - https://addons.mozilla.org/en-US/firefox/addon/multi-engine-search/ 51 [3] - https://mullvad.net/en/browser/ 52 [4] - TODO