Skip to content

Commit

Permalink
Merge pull request #473 from duckduckgo/junderhill/update-duckassistb…
Browse files Browse the repository at this point in the history
…ot-useragent

Update duckassistbot.md
  • Loading branch information
junderhill authored Oct 18, 2024
2 parents 412635b + 505af3a commit 391355f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion _docs/results/duckassistbot.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ order: 1450

DuckAssistBot is a specialized web crawler for [DuckDuckGo Search](https://duckduckgo.com) that crawls pages in real-time for answers generated by [DuckAssist]({{ site.baseurl }}/results/duckassist/), which prominently cites its sources. This data is not used in any way to train AI models.

If you’re a publisher, you may opt out of being a potential source for DuckAssist answers by modifying the [robots.txt](https://metacpan.org/module/WWW::RobotRules){:target="\_blank"}{:rel="noopener noreferrer"} file for your domain(s). Once you’ve updated the file to disallow the DuckAssistBot user agent, the change will take effect after 72 hours and DuckAssistBot will stop crawling your site. The crawler’s user agent will appear as `DuckAssistBot/1.1; (+http://duckduckgo.com/duckassistbot.html)` and originates from the following IP addresses:
If you’re a publisher, you may opt out of being a potential source for DuckAssist answers by modifying the [robots.txt](https://metacpan.org/module/WWW::RobotRules){:target="\_blank"}{:rel="noopener noreferrer"} file for your domain(s). Once you’ve updated the file to disallow the DuckAssistBot user agent, the change will take effect after 72 hours and DuckAssistBot will stop crawling your site. The crawler’s user agent will appear as `DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html)` and originates from the following IP addresses:

- 57.152.72.128
- 51.8.253.152
Expand Down

0 comments on commit 391355f

Please sign in to comment.