| 蜘蛛 | 404 路径 | Nginx 建议配置 (自动编号) | User-Agent |
|---|---|---|---|
| Bing | /activity/115051/www.taobao.com |
location = /activity/115051/www.taobao.com { rewrite ^/activity/115051/www\.taobao\.com$ /new_path/n001.html last; } |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 |
| Bing | /sitemap.txt |
location = /sitemap.txt { rewrite ^/sitemap\.txt$ /new_path/n002.html last; } |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 |