| 蜘蛛 | 404 路径 | Nginx 建议配置 (自动编号) | User-Agent |
|---|---|---|---|
| Douyin | /html/20250601/96256.html |
location = /html/20250601/96256.html { rewrite ^/html/20250601/96256\.html$ /new_path/n001.html last; } |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/) |
/zhuantibaodao/ |
location /zhuantibaodao/ { rewrite ^/zhuantibaodao/(.*)$ /new_path/ last; } |
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/143.0.7499.192 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) |