For the team here at DuckDuckGo, we were excited not only to hit 14M searches in a single day but to also cross the threshold of 10B total private searches served. Of which 4B were from last year alone.
It is always an amazing and humbling moment when we hit a new milestone in our metrics. Our team is so incredibly passionate about what we do. To have people from all over the world rally around this concept of raising the standard of trust online and build this product is one thing. But, for users to endorse that mission at such a growing pace and to share us with their friends and family -- it lets us know we're truly making a difference for people who want to be more private online, and that is incredibly rewarding.
So thank you, to all of you who search with us, all of you who know privacy matters, and all of you who work along side us to show that privacy is not a fringe interest but something we can all have!
DDG is a great success story, I wish the whole team the best.
I wonder how an exit will play out though. A big factor with DDG is user trust - that seems to limit the list potential buyers to the few that could credibly maintain that trust.
Then there is the IPO route, but that has it's own challenges. You could argue that up until now DDG has had no competition because Google doesn't think it's worth raising its hand to swat a fly. But there is no flying under the radar after an IPO. What if Google promoted a new "no track" feature which matched DDGs benefits without having to do dumb things like append query arguments, modify location, and run plugins?
You might say Google would never give up this much tracking control, but there are two caveats. First, if it's just an option buried in settings there will be limited uptake yet DDG's ability to claim differentiation would be nullified. Secondly, as DDG itself says, search can still be a great business without having to track people.
If I were lucky enough to be in DDGs position I would push for a Microsoft acquisition. MS has kept enough promises in recent years that they just may be able provide DDG users enough guarantees to maintain the trust. People have mentioned Apple but that seems like a lower probability for a variety of reasons. An MS deal would avoid the massive hassle of an IPO and enough resources to chip away at Google indefinitely without being pressured into short term decisions.
For now I'm just glad DDG is here trying to do some good.
There is a financial sweet spot where the contributors to DuckDuckGo are fat and happy and there aren't greedy investors wanting to monetize all that trust.
Google has already occupied the greedy investor niche. DDG has carved out a niche where, I fear, the greatest threat is a lack of money for the people building and maintaining DDG. If they feel underappreciated, they may start to monetize that trust. The DDG team should be rewarded for their hard work.
A quick Google search indicates that they've taken on ~$3M in funding. Depending on their revenues & expenses, that may mean that their investors aren't clamoring for quick returns. But at some point most investors do want to see a ROI/exit.
Not if it's a vanity investment (I don't know if there's a better term for it). If some VCs know that their fund will ride on one or two unicorns (or network effects like in YC's case) and that the rest of the investments will fail or barrly return 1-5x, once it's clear what the unicorn is there's a little room for investments that aren't expected to have a financial ROI. Perhaps the investment gets the investors a foot in the door for future ventures by the team or into a field where they might not have deal flow, or they might just want the extra "street cred" and publicity. YC regularly gives slots with funding to nonprofits now, which by definition can't have a financial ROI.
Because they've taken VC money. Usually, even if a business becomes profitable investors do not want to wait out a long term approach or be involved in a "lifestyle" business.
we (USV) are the VCs who invested in DDG. we are very patient. and are happy to wait and see where this goes. this was a very small investment for us so there is no pressure on them from us.
What promises has Microsoft kept that would make me consider trusting privacy to them? A sale to Microsoft would mean the decision to use duckduckgo would rely solely on search performance, and as much as I love bangs it's not a better search engine.
No big company is perfect, so trust is a relative judgement. It's also somewhat based on values, so we may think have different opinions. For example, I would trust MS more than Oracle, or one of the big cable companies.
From a privacy point of view, it would be awesome if you stabilise the NoJS version of your search page:
https://duckduckgo.com/html/
* The above landing page doesn't work (typing a query and pressing enter returns me back to the same page).
* Even if I manually enter a search URL like this https://duckduckgo.com/html/?q=test it doesn't fully work (page navigation and requerying is broken).
Like MaxLeiter, this page works normally for me, so I thought I would do a bit of testing. I know this is a plain HTML version of DDG and no AJAX is involved, but bear with me, I want to illustrate a point.
From the browser console, the origin is that of the web page you're currently viewing, so you're free from CORS concerns.
So, from my browser console in Chrome 56, with duckduckgo.com/html/ open in the browser tab, I should be able to do this without any trouble:
But, surprise surprise, it doesn't work. There's no change in the document, where I'd obviously expect to see the search results page loaded, because the response was the home page -- as it is in your case, when you try to search for stuff.
So I tried to make a POST request without a body instead, appending the query parameter to the URL as one would with a GET request:
This worked perfectly, all the search results were loaded. Works as a plain GET request too. So what we seem to be able to surmise is that posting a request body causes the search to be rejected...
But that's absurd! The native submit behaviour of a form with method 'POST' necessarily sends a POST request with a body, the body can be of multiple types, specified by the enctype attribute, default being x-www-form-urlencoded, which mimics a GET request.
In my browser's dev tools, I checked the request in the networking panel. The fetch requests were all there, but they differed from the native requests in an important way: the body was called 'Form data' in native requests, where in fetches it appeared as 'Request payload'.
The latter is obviously not going to be identified by DDG or any website as form data to parse, so I tried fetching with the correct content-type header explicitly set:
So what was the point of this? We haven't really learned much, because handling form submissions via AJAX always requires such considerations, and that's irrelevant here anyway because the web page in question does not use AJAX, it's a plain HTML version of the site!
What we have determined is that there's most probably nothing wrong with their web page and the problem is more likely to be originating from your side.
I get the feeling that your browser is, for some reason, not applying the correct default enctype for the DDG/html form or uMatrix is interrupting the request and re-sending the request as a generic POST without the explicit content-type.
I've been unable to reproduce the bug on my machine. Do you use any other browser extensions? Does the site work in other browsers you may have?
Thank you for a great search engine! I swapped from Google as a default search to your guys' engine just shy of a year ago and haven't looked back. Keep up the great work :)
A thousand times this. Initially I wasn't a fan if I'm perfectly honest, but once I got my head around such brilliant things as the bang syntax I've been finding Google almost awkward to use by comparison. Being able to search Wikipedia with !w is brilliant.
For the curious, that's what the search "keyword" is for. Over time, Firefox has made it harder to add new search engines and find/modify their settings, but it definitely still works.
I use DDG Lite with Dillo, a fast non-Javascript GUI browser, but lately (I'd say since the first week of January, according to this message [1] in Dillo's mailing list), I'm unable to visit the search results using Dillo's native search box.
Instead of sending me to example.com, DDG redirects to a weird constructed address [2]). If I go to duckduckgo.com/lite and search there, it works fine. Any ideas? What would be the best (eh, sorry) place to post this?
Of course, thanks for your great work, and bangs are amazing!
This is to stop your HTTP referrer leaking your search terms:
"DuckDuckGo prevents search leakage by default. Instead, when you click on a link on our site, we route (redirect) that request in such a way so that it does not send your search terms to other sites. The other sites will still know that you visited them, but they will not know what search you entered beforehand."
https://duckduckgo.com/privacy
I've been using DuckDuckGo for the past year and love it. But this also gets me. I've been trying to evangelize with my colleagues and friends and the whole duck thing makes it hard for them to take seriously. One friend said the logo reminded them of Aflac.
And then all of a sudden we're talking about a duck instead of why private search is important.
Even better: You can work an making "google" a generic term for searching – "I'm googling it on DuckDuckGo" – which increases awareness of other search engines and decreases the association of the common activity "googling" with the company "Google".
I think it's been several years since I've actually visited duckduckgo.com. Modern browsers make it really easy to set DDG to your default search engine.
People often want to try it for a while before to set it as default. Same happened to me when I changed my default browser. All being said I think a rebranding would make it more competitive.
Pretty much the only time I switch away from your search engine is when I want to extend the time constraint to "Past Year", if you fix that you should increase your total searches this next year by at least 200... http://i.imgur.com/0O15hJV.png
I've been using DuckDuckGo since @yegg's first announcement of it (on reddit iirc). The relevance of the results compared to their competitors' has been noticeably improving over the years.
When a search doesn't quite give me what I'm looking for, I prepend !sp on my query (to use startpage.com). I use this less and less and for most things DDG gets me where I need to go.
I'm a huge fan. I'm thankful services like this are available--that respect our privacy. I did have good intentions of contributing to duckduckhack.com but have regretfully not gotten around to it yet.
I still insert `!g` in about 25% percent of my searches. Loved to see a metric on how many people do the same or append it on the search box after seeing the results.
I like DDG a lot, but I feel that Google knowing so much about me prevents it from showing ruby gems over ruby lang search results. Must say, this has improved greatly last year, but I don't trust DDG just yet fully.
I use !g if a DDG search doesn't give me anything useful, but this is far less than 25% of my searches, and in nearly every case, Google didn't have anything useful either.
Really the only times !g actually turns out to be useful is when I'm searching for something that's well within my filter bubble on Google, but generic enough that I get the wrong results when outside of my filter bubble (e.g. DDG). But that's not really all that often.
The key for switching to DuckDuckGo for me was to set it as the default searchengine / startpage on all browsers. While the relevance of search results is slightly (noticable) worse than Google, I think the tradeoff between privacy VS result-quality is worth it. Thanks for making such a great product!
DuckDuckGo employee here - Be sure to use the 'feedback' button that you find on the search results page whenever you feel a search isn't up to standards.
Our team has been working hard at increasing relevancy, but the best changes come when users let us know what they need.
Since we don't filter bubble results (https://www.ted.com/talks/eli_pariser_beware_online_filter_b...) results certainly feel different when making the leap, and that takes an adjustment period for most people. But, if you actually feel you have examples where you can't find what you're looking for, then we want to know so we can provide you a seamless search experience as well!
There was a long HN thread talking about DuckDuckGo results vs Google behavior.
Some people are put off by the fact that you don't substitute synonyms as aggressively as google. A concrete example was "foss [search term]". Google seems to rewrite this to "[open source] foobar", even with bubbling off.
I prefer the duck duck go behavior (and google's aggressive query rewriting drove me nuts back when I used google -- it makes it hard to run precise searches!). After all, if I bothered to type an obscure acronym, I'm looking for results that actually contain the acronym!
Maybe a "did you mean 'open source [search term]'" link at the top of the page, and even a preference toggle to enable aggressive query rewording by default would help.
I've had a lot of problems with literal searches on DDG over the years. That is, searches containing search terms in double quotes, like this: "my search terms".
DDG is committed to returning literal search results for the exact query that the user typed within double quotes, right? Sometimes I wonder if DDG is going the route of other search engines and trying to return "relevant" results instead of only results containing the exact search term the user asked for within double quotes.
Could you make clear exactly what DDG's policy is on exact search terms within double quotes? Does DDG honor such requests?
I use DDG as primary but any time the search results aren't relevant, I fall back to Google. I fall back a lot right now and I think this is the area for DDG to focus in.
Hey Adam, thanks for the tip! Will do for sure in the future.
Edge cases I have in mind are usually related to indexing of forum posts, where I search for a specific-term (say bookkeeping) and roughly know the Google results of the most important forums by heart, but DDG does not even show them.
Second case I just used yesterday was searching for an exact match for an @gmail address of a priest (for our marriage) where Google had a lot more results than DDG.
Not sure how this might affect privacy, or maybe you're doing it already, but couldn't you guys sample every time someone runs a search and then the same search with !g ?
Thanks for the suggestion. Part of the reason we don't do this is the returned search results on Google are Google's commercial property. To use them in such a capacity would require us to reach a commercial agreement with them. These agreements come with stipulations that we don't feel represent the privacy interests of our users, so we don't pursue such agreements.
The other reason, is because of the 'filter bubble' Google tailors results based on user tracking, which is what helps with result accuracy. So the results we as DuckDuckGo see on a query would be different than what you see. Plus, even if we could see your results, we wouldn't want to. We don't think it is good to be filter bubbled, we want to serve you the best results we can without censoring you. It should be your decision to a view a certain website, not ours!
I think the suggestion was more that you identify specific search urls which did not return a good result (hence the user went off to google). You could do this anonymously without tracking anyone or their usage of google or other search engines, or looking at the results on google.
As a DDG user I'd be really happy if you did this and think it would be the best way of identifying searches I'm unhappy with. I go to google now only if I'm not happy with the results from DDG.
I may be wrong but the reason is again privacy (and probably cost). If they tracked your queries and tied them back to you for future then they need to store your information or enough to tie to you and what you clicked on and the history to improve things. These all become things that they can be subpoenaed for which is anti-privacy.
Don't believe for a second that governments are not already banging at the door for access. The only ways to combat is either hosting in neutral offshore datacenter and incorporating there and living there is to not collect "useful" information in the first place on users. I think they went for the latter.
I often experience that ddg gives me results from really old websites. In cases this is OK, but when used for tracking down bugs or software errors it can be frustrating.
At DuckDuckGo we've got open-source Instant Answers that currently pull in information from over 1100 sources:
(https://duck.co/ia)
If you know of a good data source for scheduled flights you can easily contribute an Instant Answer, or leave the source as a suggestion for our community!
This is a significant subset of what ITA does though - just a list of what flights go on each day of the week and at what time. I expect that can be built for significantly less than 700 million, certainly among the popular airports that most people search for. I suspect they might have had it before the ITA purchase as well but not 100% sure. The Google flights search with pricing and custom dates and routes came after ITA was bought I think.
It's basically QPX. Not just flights and times, but prices as well. It is the most significant part of ITA.
Flights, times, and fares is deceptively hard to get right. There's a reason there are only a few providers.
Edit: Ahh. If you're saying DDG could get by with just flights and times, and no fares, I see what you mean. That seems to be reflected in the pricing for the FlightStats product vs Google's flight/times/fares API pricing, yes. Parity with Google search requires fares though.
Setting it to default was what also got me using it daily. I've known about it for a long time but never used it much simply because when I open a new tab I want to search from there.
I'd say I'm happy with the search results I get and never find myself going to google unless I need a map. I also really like that they adopted the quick results if you hit something common and get a excerpt which usually has my answer in it right at the top of the search results.
Yes, I encountered this. Soon after I had set ddg to the default on all my browsers (mobile & desktop), I found that DDGs results have been perfectly acceptable most of the time.
Further, I find that I use shortcuts like !w, !yt, or plain "!" much more often than I use !g due to poor (or simply less targeted) search results.
I couldn't find anything obviously authoritative, but various sources suggested Google does 3500m or so daily searches.
That puts DDG at less than 1%, but their percentage growth is huge. It can't continue forever, but they could be a significant search engine if it doesn't peter out too soon.
I tried DDG several times, but it finally stuck earlier this year. I'm really happy it's available as an alternative.
It's difficult to define what constitutes a "search" these days. Since google release autocomplete search in 2004 [1], each letter you type into the search bar results in a search query.
So simply searching for "superbowl 2017" would result in 14 searches because there are 14 characters. So, do you count that as 1 search or 14?
No, search as you type only happened with Instant Search, which launched in September 2010. From 2004 on, you still needed to press Enter to perform an actual search.
Even now, you can inspect JS traffic and see that usually there aren't 14 searches when you enter [superbowl 2017]. Internal metrics reflect a lot of that nuance and more.
Source: I own a Google Instant shirt because I was in one of the teams involved in months of testing and in the launch.
Good point. However when you switch to a different search engine in your browser, you'll likely still have incremental search for the new search provider.
I suspect the main reason for Google's stranglehold is that it's usually set up as the default search engine for many web browsers (both for desktop and mobile) and the vast majority of users don't change that.
In spite of its good growth rate, DDG will have to change tack if it wants to make the leap to the next stage.
This seems right. I could imagine Apple leaving some money on the table to avoid Google search on the iPhone, if people wouldn't perceive DDG as inferior.
Just trying it now, when you go "back" after clicking Images you go to duckduckgo.com, not the previous page you were on. The url changes, so it's a bit strange.
Results are decent, though the results page seems harder to skim read.
DuckDuckGo is great and I've actually had surprising success in getting non-tech people to try it out, and stick with it! My girlfriend has set it as default it in all of her devices, she loves the !bang searches (imdb, wiki, etc.) and lack of ads.
Also, half of my co-workers. !python, !mdn, etc.
I think the biggest hurdle going forward is the fact that DDG is much better for English results than in other languages (we work half in French), but I hope the project grows and grows. Google needs to go down eventually!
Given the climate of political discord that is occurring on Google sites, especially google "news" (which gets prominent placement in many google searches now), I've switched my iPhone default search in Safari to DDG. I've been pleasantly surprised that I don't need to google things for 90% of searches.
If you increase the time scale, the acceleration doesn't seem so big--it looks like there's a fairly linear trend.
What's interesting to me is that there's such a consistent drop in searches around the holidays. I'd expect some drop, but not that big, relatively speaking.
DDG is a great search engine. I missed the lack of personalized search that Google gets you, but once you get used and learn how to search properly, you start loving it.
And I moved from Google on my phone due to the AMP crap.
I'm annoyed that I can't set DDG has the default search engine in Chrome (Android). I hold a bookmark though so 'duc' autocompletes to duckduckgo. Not too inconvenient.
1) Install Chrome Canary. 2) Type duckduckgo.com in the address bar. 3) Do a search from the search box. 4) Repeat step 2 and 3 for a decent number of times (say 5 to 8 times). 5) Go to settings->Search engine. Here you should see duckduckgo.com in the recently visited section along with the usual options.
I'd love to see if there's a similar uptrend in usage for other services who advertise privacy as part of their value. Anecdotally, a large chunk of my social network has joined Signal just in the last few days, and without any prompting from me. This is speculation, but it may be that many people who were ambivalent about surveillance under Obama are concerned about surveillance under Trump, and we'll see more user demand for privacy for the next few years.
I've been using DDG for a couple years, not that too many people would know about it. Heh. Good enough for what I do, and having to go a few pages deep sometimes doesn't really bother me, and in fact routinely exposes me to resources that I was not aware of.
I have, and will continue to, pass good privacy practices on to others, particularly non-tech users, even though people don't always have the time for privacy discussions, they become aware of the issues.
I wonder why DDG bang search is praised like its a first time phenomena ?
What ? ... did people live in a cave all this time ? It existed for more then a decade all around. Some examples include early Opera, chrome, vimium plugin, Surfraw (linux CLI search tool) etc...
Anyway, DDG is refreshing. You can even turn off adds in the options. Google may be a great search engine but as far as I am concerned, it can delete 'don't be evil' phrase from its mission statement.
>In addition, the search engine is celebrating a
combined total of 10 billion searches performed,
with 4 billion searches conducted in December 2016
alone.
This can't be right, can it? DDG's been around for years, and nearly half of its total use volume has been in the past month?
With 4 billion searches in December 2016, DDG would have had on average 129 million searches every day of december. I have to assume this actually meant 4 billion searches in 2016
I switched to DDG as my default search everywhere a few months ago, and I recommend everyone does. The results are passable and when they aren't there is always !g
It's good enough and they are not spying on me. I am going to start installing it on people's computers that I fix. They usually have Ask toolbar or something anyway lol.
One very useful differentiating feature DDG could add would be a discussion forum search filter, like Google used to have before discontinuing it in 2014.
I have used it for about a month. I feel like it may be good for most people, but google is far more precise for hard to find pages and answers to programming questions, error strings, etc.
As some others have mentioned you can check out https://duckduckhack.com/ our open-source community that powers our Instant Answers (the answers that appear before the search results/ads).
Our community has helped us pull in data from over 1100 sources to make amazing experiences.
The value of this is that you can build out anything you are passionate about. It creates some great niche experiences.
I've had some problems with DDG's bang searches on some sites where the sites' search URLs moved or could use better search parameters. Where can users report broken bang searches or suggest better options?
DDG has a lot of open source code on GitHub. A list mapping bang search terms to site URLs could be maintained as a simple text file on GitHub so contributors could test them or suggest improvements.
duckduckgo have significantly changed the way i use the web. namely the bangs feature. simply put it's ingenious.
https://duckduckgo.com/bang
the search has improved in the past few years but when it fails i merely have to add a !g to the query.
It will be there soon. Looks like all the changes to support this landed recently. Though it's not so much DDG being in the list, but the available search engines will be the last 5 search engines you visited.
We wrote a post covering it in our newly launched blog: https://spreadprivacy.com/10-billion-fc7808c91343
It is always an amazing and humbling moment when we hit a new milestone in our metrics. Our team is so incredibly passionate about what we do. To have people from all over the world rally around this concept of raising the standard of trust online and build this product is one thing. But, for users to endorse that mission at such a growing pace and to share us with their friends and family -- it lets us know we're truly making a difference for people who want to be more private online, and that is incredibly rewarding.
So thank you, to all of you who search with us, all of you who know privacy matters, and all of you who work along side us to show that privacy is not a fringe interest but something we can all have!