caibotmi

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-09 23:22:56 +08:00

be0bc603b7 fix: 帖子时间解析过滤2053等异常年份，使用crawled_at兜底

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-07 19:43:25 +08:00

c20a2f50ce feat: 增量脚本去掉LIMIT - 每次跑完所有待处理帖子

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-07 19:34:08 +08:00

25129bfc07 fix: 修复增量提取NOT IN子查询bug - 改用NOT EXISTS避免类型转换问题

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-07 15:30:08 +08:00

b9554562de feat: 新增冠字号增量提取脚本 - 每天3点/11点/16点增量同步藏品数据

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-07 14:38:46 +08:00

8a100a9a95 fix: 修复帖子内容解析 - 清理网站免责声明和底部导航

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-07 12:24:03 +08:00

35d238555f feat: 新增藏品和用户Tab

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-07 09:19:44 +08:00

52ece4f412 docs: 添加2号3号服务器运维手册

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-07 09:15:11 +08:00

b0bb3372fa fix: 修复 save_full_post SQL 参数不匹配问题

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-07 00:05:54 +08:00

e112b4c1e6 feat: v0.0.4 - 冠字号提取功能

caibotmi pushed tag v0.0.4 to caibotmi/CoolBotDataSys

2026-04-07 00:05:54 +08:00

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-06 23:29:53 +08:00

65162298c5 feat: v0.0.3 - 分类逻辑优化

caibotmi pushed tag v0.0.3 to caibotmi/CoolBotDataSys

2026-04-06 23:29:53 +08:00

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-06 16:42:51 +08:00

1c0f74ccb6 feat: v0.0.2 - 帖子正文爬取优化

caibotmi pushed tag v0.0.2 to caibotmi/CoolBotDataSys

2026-04-06 16:42:51 +08:00

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-06 14:41:13 +08:00

07b2e5c7b5 feat: v0.0.1 - CoolBotDataSys 完整版本

76d87adadb fix: database.py get_db + crawl_today.py内容提取+作者入库修复

4282eac809 fix: extract author_username from <b> tags in postuserinfo div

9d418f3d8c fix: crawl_today.py - BeautifulSoup解析 + 去掉日期过滤 + 修复post_id正则

Compare 4 commits »

caibotmi pushed tag v0.0.1 to caibotmi/CoolBotDataSys

2026-04-06 14:41:13 +08:00

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-05 10:13:15 +08:00

c330d3f0c2 fix: 修复yichens_spider_v4.py两处bug

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-05 09:45:31 +08:00

9a6f0de418 feat: 添加一尘网爬虫v4 - BeautifulSoup解析 + 日期格式修复

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-05 09:39:26 +08:00

79409317f9 fix: 更新config.yaml - 数据库改为PostgreSQL端口5432，爬虫间隔改为15分钟

caibotmi pushed to main at caibotmi/CoolBotDataSys

2026-04-04 20:02:14 +08:00

c4e029a20a feat: 完成一尘数据采集完整功能